-- Logs begin at Mon 2022-09-19 14:13:23 UTC, end at Mon 2022-09-19 15:12:22 UTC. -- Sep 19 14:42:17.360478 dv-cinder-756711-11-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 19 14:42:17.371243 dv-cinder-756711-11-smb devstack@keystone.service[81440]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 19 14:42:17.373322 dv-cinder-756711-11-smb devstack@keystone.service[81440]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Sep 19 14:42:17 2022] *** Sep 19 14:42:17.373322 dv-cinder-756711-11-smb devstack@keystone.service[81440]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 19 14:42:17.373322 dv-cinder-756711-11-smb devstack@keystone.service[81440]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 19 14:42:17.373322 dv-cinder-756711-11-smb devstack@keystone.service[81440]: nodename: dv-cinder-756711-11-smb Sep 19 14:42:17.373322 dv-cinder-756711-11-smb devstack@keystone.service[81440]: machine: x86_64 Sep 19 14:42:17.373322 dv-cinder-756711-11-smb devstack@keystone.service[81440]: clock source: unix Sep 19 14:42:17.373322 dv-cinder-756711-11-smb devstack@keystone.service[81440]: pcre jit disabled Sep 19 14:42:17.373322 dv-cinder-756711-11-smb devstack@keystone.service[81440]: detected number of CPU cores: 4 Sep 19 14:42:17.373322 dv-cinder-756711-11-smb devstack@keystone.service[81440]: current working directory: / Sep 19 14:42:17.373322 dv-cinder-756711-11-smb devstack@keystone.service[81440]: detected binary path: /usr/bin/uwsgi-core Sep 19 14:42:17.373931 dv-cinder-756711-11-smb devstack@keystone.service[81440]: your processes number limit is 47680 Sep 19 14:42:17.373931 dv-cinder-756711-11-smb devstack@keystone.service[81440]: your memory page size is 4096 bytes Sep 19 14:42:17.373931 dv-cinder-756711-11-smb devstack@keystone.service[81440]: detected max file descriptor number: 2048 Sep 19 14:42:17.373931 dv-cinder-756711-11-smb devstack@keystone.service[81440]: lock engine: pthread robust mutexes Sep 19 14:42:17.373931 dv-cinder-756711-11-smb devstack@keystone.service[81440]: thunder lock: enabled Sep 19 14:42:17.373931 dv-cinder-756711-11-smb devstack@keystone.service[81440]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 19 14:42:17.373931 dv-cinder-756711-11-smb devstack@keystone.service[81440]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 19 14:42:17.412805 dv-cinder-756711-11-smb devstack@keystone.service[81440]: Python main interpreter initialized at 0x5648f8ef89c0 Sep 19 14:42:17.412805 dv-cinder-756711-11-smb devstack@keystone.service[81440]: python threads support enabled Sep 19 14:42:17.412805 dv-cinder-756711-11-smb devstack@keystone.service[81440]: your server socket listen backlog is limited to 100 connections Sep 19 14:42:17.412805 dv-cinder-756711-11-smb devstack@keystone.service[81440]: your mercy for graceful operations on workers is 90 seconds Sep 19 14:42:17.413110 dv-cinder-756711-11-smb devstack@keystone.service[81440]: mapped 403077 bytes (393 KB) for 2 cores Sep 19 14:42:17.413195 dv-cinder-756711-11-smb devstack@keystone.service[81440]: *** Operational MODE: preforking *** Sep 19 14:42:17.413475 dv-cinder-756711-11-smb devstack@keystone.service[81440]: *** uWSGI is running in multiple interpreter mode *** Sep 19 14:42:17.413475 dv-cinder-756711-11-smb devstack@keystone.service[81440]: spawned uWSGI master process (pid: 81440) Sep 19 14:42:17.413657 dv-cinder-756711-11-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 19 14:42:17.414422 dv-cinder-756711-11-smb devstack@keystone.service[81440]: spawned uWSGI worker 1 (pid: 81451, cores: 1) Sep 19 14:42:17.414514 dv-cinder-756711-11-smb devstack@keystone.service[81440]: spawned uWSGI worker 2 (pid: 81452, cores: 1) Sep 19 14:42:17.414690 dv-cinder-756711-11-smb devstack@keystone.service[81440]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 19 14:42:21.678870 dv-cinder-756711-11-smb devstack@keystone.service[81451]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 19 14:42:21.678870 dv-cinder-756711-11-smb devstack@keystone.service[81451]: from cryptography.utils import int_from_bytes Sep 19 14:42:21.679662 dv-cinder-756711-11-smb devstack@keystone.service[81451]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 19 14:42:21.679662 dv-cinder-756711-11-smb devstack@keystone.service[81451]: from cryptography.utils import int_from_bytes Sep 19 14:42:21.680768 dv-cinder-756711-11-smb devstack@keystone.service[81452]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 19 14:42:21.680768 dv-cinder-756711-11-smb devstack@keystone.service[81452]: from cryptography.utils import int_from_bytes Sep 19 14:42:21.681230 dv-cinder-756711-11-smb devstack@keystone.service[81452]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 19 14:42:21.681230 dv-cinder-756711-11-smb devstack@keystone.service[81452]: from cryptography.utils import int_from_bytes Sep 19 14:42:21.728433 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 19 14:42:21.728630 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 19 14:42:21.728822 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] command line args: [] {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 19 14:42:21.729092 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 19 14:42:21.729269 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] ================================================================================ {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 19 14:42:21.730109 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] admin_token = **** {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:42:21.730546 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] config_dir = [] {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:42:21.730741 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:42:21.730925 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] config_source = [] {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:42:21.731103 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] debug = True {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:42:21.731300 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:42:21.731561 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 19 14:42:21.731633 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 19 14:42:21.731700 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:42:21.731840 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] command line args: [] {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 19 14:42:21.731925 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:42:21.732068 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 19 14:42:21.732149 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:42:21.732254 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] ================================================================================ {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 19 14:42:21.732390 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:42:21.732563 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] list_limit = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:42:21.732666 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] admin_token = **** {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:42:21.732767 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] log_config_append = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:42:21.732862 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] config_dir = [] {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:42:21.732975 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:42:21.733077 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:42:21.733178 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] log_dir = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:42:21.733280 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] config_source = [] {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:42:21.733376 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] log_file = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:42:21.733476 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] debug = True {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:42:21.733595 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:42:21.733676 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:42:21.733772 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:42:21.733831 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:42:21.733939 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:42:21.734048 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:42:21.734156 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:42:21.734266 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:42:21.734351 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:42:21.734477 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:42:21.734558 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:42:21.734687 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] list_limit = None {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:42:21.734768 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:42:21.734841 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] log_config_append = None {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:42:21.734936 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:42:21.735022 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:42:21.735147 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] log_dir = None {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:42:21.735227 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:42:21.735304 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] log_file = None {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:42:21.735425 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:42:21.735506 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:42:21.735609 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:42:21.735748 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:42:21.735827 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:42:21.736003 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:42:21.736086 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:42:21.736255 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:42:21.736356 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:42:21.736487 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:42:21.736571 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:42:21.736642 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:42:21.736863 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:42:21.737055 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.72/identity {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:42:21.737185 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:42:21.737276 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] publish_errors = False {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:42:21.737353 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:42:21.737467 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:42:21.737547 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:42:21.737675 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:42:21.737784 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:42:21.737868 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:42:21.738022 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:42:21.738104 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:42:21.738275 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:42:21.738361 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:42:21.738519 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] standard_threads = False {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:42:21.738599 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:42:21.738750 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:42:21.738829 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:42:21.738993 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:42:21.739169 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:42:21.739264 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.72/identity {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:42:21.739343 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] use_journal = False {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:42:21.739422 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] publish_errors = False {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:42:21.739500 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] use_json = False {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:42:21.739652 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:42:21.739731 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] use_stderr = False {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:42:21.739825 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] use_syslog = False {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:42:21.739953 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:42:21.740036 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:42:21.740113 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:42:21.740288 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:42:21.740387 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.740554 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.740707 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:42:21.740785 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] standard_threads = False {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:42:21.740860 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.741012 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:42:21.741101 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.741263 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:42:21.741350 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.741444 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:42:21.741523 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.741624 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] use_journal = False {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:42:21.741736 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.741821 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] use_json = False {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:42:21.741964 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] use_stderr = False {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:42:21.742049 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.742142 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] use_syslog = False {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:42:21.742227 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.742376 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:42:21.742455 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.742636 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.742715 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.742878 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.742963 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.743123 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.743207 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.743361 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.743441 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.743607 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.743699 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.743849 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.743933 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.744085 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.744164 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.744343 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.744434 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.744600 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.744690 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.744843 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.744923 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.745686 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.745782 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.745927 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.746051 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.746183 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.746316 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.746428 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.746569 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.746682 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.746817 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.746972 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.747048 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.747167 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.747266 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.747427 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.747519 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.747687 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.747771 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.747939 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.748013 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.748181 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.748269 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.748432 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.748511 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.748664 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.748751 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.748909 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.749000 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.749154 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.749232 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.749389 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.749473 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.749635 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.749721 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.749863 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.749947 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.750097 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.750175 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.750329 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.750412 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.750556 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.750652 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.750786 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.750876 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.751011 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.751097 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.751238 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.751316 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.751474 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.751551 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.751718 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.751803 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.751946 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.752030 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.752180 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.752265 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.752430 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.752591 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.752666 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.752735 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.752886 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.752968 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.753118 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.753203 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.753345 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.753428 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.753576 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.753652 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.753807 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.753891 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.754040 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.754119 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.754274 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.754352 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.754506 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.754591 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.754733 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.754811 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.754972 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.755047 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.755202 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.755280 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.755437 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.755505 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.755669 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.755754 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.756005 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.756131 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.756289 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.756420 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.756420 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.756551 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.756669 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.756758 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.756838 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.756910 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.757068 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.757149 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.757303 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.757385 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.757549 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.757669 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.757791 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.757871 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.758043 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.758131 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.758257 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.758382 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.758480 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.758567 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.758727 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.758807 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.758965 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.759045 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.759200 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.759276 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.759441 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.759520 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.759676 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.759757 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.759938 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.760024 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.760155 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.760235 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.760410 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.760561 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.760680 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.760788 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.760899 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.761044 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.761138 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.761302 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.761387 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.761549 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.761628 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.761793 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.761882 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.762043 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.762130 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.762286 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.762366 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.762525 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.762613 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.762763 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.762849 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.762999 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.763078 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.763234 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.763321 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.763464 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.763544 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.763693 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.763772 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.763923 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.764079 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.764155 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.764226 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.764393 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.764489 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.764636 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.764718 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.764874 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.764955 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.765121 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.765207 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.765358 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.765438 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.765610 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.765690 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.765856 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.765935 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.766094 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.766173 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.766322 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] auth.external = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.766402 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.766553 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.766632 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.766793 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.766871 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.767029 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.767116 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.767276 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.767357 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] auth.password = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.767503 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] auth.token = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.767595 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.767748 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.767831 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.767986 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.768069 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.768231 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.768315 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.768485 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.768567 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.768734 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.768817 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.768973 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] auth.external = None {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.769052 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.769203 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.769282 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.769440 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] credential.caching = True {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.769522 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.769687 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.769768 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.769935 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.770016 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] auth.password = None {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.770167 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] auth.token = None {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.770251 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.770409 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.770494 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.770648 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.770728 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.770881 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.770961 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.771127 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.771206 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.771374 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.771457 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.771609 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.771691 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.771847 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.771927 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.772087 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] credential.caching = True {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.772168 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.772345 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.772428 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.772611 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.772691 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.772849 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.772928 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.773098 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.773180 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.773331 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] federation.caching = True {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.773412 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.773567 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.773647 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.773812 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.773894 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.774056 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.774143 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.774285 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.774365 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.774529 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.774611 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.774762 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.774842 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.775014 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.775094 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.775250 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.775331 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.775501 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.775587 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.775737 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.775829 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.775983 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.776063 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] federation.caching = True {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.776276 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.777742 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] identity.caching = True {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.777825 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.777911 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.777988 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.777988 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.778116 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.778186 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.778186 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.778300 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.778378 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.778378 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.778378 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.778591 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.778749 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.778904 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.778981 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] identity.caching = True {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.779058 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.779235 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.779324 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.779481 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.779571 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.779722 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.779802 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.779966 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.780088 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.780199 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.780287 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.780455 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.780538 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.780688 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.780768 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.780934 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.781027 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.781179 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.781260 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.781417 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.781496 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.781656 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.781745 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.781892 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.781972 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.782141 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.782221 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.782383 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.782470 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.782621 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.782701 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.782852 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.782931 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.783088 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.783176 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.783318 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.783442 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.783554 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.783634 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.783803 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.783940 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.784023 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.784099 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.784273 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.784392 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.784527 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.784628 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.784769 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.784851 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.785011 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.785091 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.785248 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.785336 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.785494 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.785580 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.785726 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.785805 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.785954 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.786041 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.786190 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.786270 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.786419 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.786499 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.786654 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.786736 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.786892 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.786972 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.787122 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.787201 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.787355 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.787442 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.787585 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.787664 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.787827 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.787907 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.788066 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.788184 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.788315 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.788426 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.788578 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.788728 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.788819 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.788896 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.789059 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.789140 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.789323 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.789421 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.789548 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.789647 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.789785 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.789895 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.790026 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] ldap.user = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.790148 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.790270 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.790405 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.790530 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.790651 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.790764 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.790895 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.791012 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.791145 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.791259 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.791385 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] ldap.user = None {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.791504 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.791632 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.791741 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.792535 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.792620 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.792775 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.792886 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.793013 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.793148 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.793251 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.793405 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.793487 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.793661 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.793741 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.793907 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.793989 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.794147 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.794228 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.794391 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.794474 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.794635 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.794717 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.794863 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.794942 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.795101 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.795180 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.795336 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.795416 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.795572 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.795652 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.795808 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.795887 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.796042 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.796124 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.796285 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.796390 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.796550 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.796629 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.796784 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.796871 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.797031 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.797117 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.797259 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.797338 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.797502 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.797582 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.797734 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.797813 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.797969 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.798049 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.798206 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.798290 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.798447 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.798576 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.798711 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.798836 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.798971 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.799109 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.799236 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.799362 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.799490 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] resource.caching = True {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.799616 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.799749 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.799874 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.800001 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.800125 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.800251 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.800396 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.800529 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.800657 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.800781 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.800917 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.801044 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.801170 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.801303 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.801429 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] resource.caching = True {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.801555 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.801680 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.801804 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.801928 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.802063 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] role.caching = True {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.802197 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.802327 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] role.driver = sql {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.802457 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.802843 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.802969 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.803172 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.803301 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.803428 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.803554 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.803681 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.803813 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.803937 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.804063 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.804188 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.804311 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] role.caching = True {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.804512 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.804649 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] role.driver = sql {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.804788 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.804914 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.805045 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.805171 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.805296 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.805429 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.805556 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.805680 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.805806 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.805930 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.806055 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.806187 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.806312 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.806446 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.806446 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.806682 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.806807 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.806938 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.807063 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.807186 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.807310 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.807496 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.807628 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.807762 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.807890 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.808164 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.808164 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.808443 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.808568 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.808568 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.808820 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.808945 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.809069 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.809193 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.809326 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.809452 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.809577 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.809702 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.809826 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.809952 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.810093 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.810219 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.810343 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.810468 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.810592 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.810715 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.810848 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.810975 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.811100 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.811222 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.811345 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.811470 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] token.caching = True {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.811601 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.811738 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.811863 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.811986 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.812113 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.812236 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.812394 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.812519 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.812646 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.812771 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.812896 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.813021 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.813154 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.813279 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.813409 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.813555 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.813631 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] token.caching = True {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.813702 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.813782 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.813855 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.813926 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.813997 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.814066 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.814142 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.814142 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.814281 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.814281 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.814407 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.814407 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.814541 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.814636 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.814720 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.814720 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.814850 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.814921 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.814991 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] database.connection = **** {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.815061 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.815139 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.815213 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.815283 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.815352 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.815422 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.815492 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.815569 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.815569 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.815699 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.815769 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.815840 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.815918 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.815998 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.816124 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.816218 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.816381 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.816467 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] database.connection = **** {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.816621 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.816702 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.816864 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.816957 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.817101 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.817182 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.817349 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.817430 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.817585 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.817673 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.817828 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.817908 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.818056 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.818136 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.818296 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.818385 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.818536 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.818616 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.818688 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 19 14:42:21.818760 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.819012 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.819255 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.819509 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.819749 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.820001 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.820238 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.820512 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.820757 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:42:21.820931 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 19 14:42:21.848435 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:42:21.848655 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:42:21.848877 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:42:21.850239 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:42:21.850474 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:42:21.850704 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:42:21.857301 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:42:21.859167 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:42:21.885642 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:42:21.886360 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:42:21.887087 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:42:21.887318 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:42:21.940377 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:42:21.941123 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:42:21.989306 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:42:21.989537 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:42:21.990671 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:42:21.990909 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:42:22.145247 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:42:22.145487 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:42:22.145576 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:42:22.145657 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:42:22.145731 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:42:22.145874 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:42:22.145960 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:42:22.146089 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:42:22.146173 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:42:22.146302 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:42:22.146396 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:42:22.146519 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:42:22.169204 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:42:22.169429 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:42:22.169649 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:42:22.169734 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:42:22.169867 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:42:22.169951 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:42:22.170084 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:42:22.170167 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:42:22.170297 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:42:22.170390 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:42:22.170508 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:42:22.170591 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:42:22.170722 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:42:22.170939 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:42:22.181847 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:42:22.182296 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:42:22.195304 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:42:22.195477 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:42:22.195696 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:42:22.195915 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:42:22.196129 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:42:22.196422 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:42:22.196570 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:42:22.201656 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:42:22.201887 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:42:22.202114 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:42:22.202337 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:42:22.203047 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:42:22.203047 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:42:22.203047 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:42:22.213148 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.213358 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 19 14:42:22.214201 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.214292 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.214411 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 19 14:42:22.214495 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 19 14:42:22.214692 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.214782 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.214937 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 19 14:42:22.215020 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.215212 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.215305 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.215474 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.215558 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.215732 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.215988 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.225006 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.225283 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.225551 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.225635 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.225826 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.225909 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.226099 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.226383 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.233360 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81451) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 14:42:22.234177 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81452) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 14:42:22.236231 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81451) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 14:42:22.236535 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.236818 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.237094 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81452) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 14:42:22.237191 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.237374 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.237457 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.237631 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.237716 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.237896 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.237980 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.238166 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.238259 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.238435 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.238517 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.238701 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.238782 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.238964 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.239036 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.239235 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.239509 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.239777 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.262178 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.263169 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.263625 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81451) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 14:42:22.263908 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.264658 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81452) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 14:42:22.264942 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.268581 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81451) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 14:42:22.268861 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.269138 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.269586 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81452) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 14:42:22.269872 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.270158 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.275416 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81451) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 14:42:22.275701 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.276553 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81452) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 14:42:22.276836 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.281531 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81451) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 14:42:22.281823 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.282110 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.282396 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.282531 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81452) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 14:42:22.282674 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.282769 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.282951 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.283035 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.283219 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.283305 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.283484 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.283569 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.283826 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.284082 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.284368 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.299552 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.299828 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.300836 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.301121 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.303965 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81451) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 14:42:22.305204 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81452) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 14:42:22.307192 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.307532 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.308451 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.308746 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.311756 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81451) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 14:42:22.312906 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81452) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 14:42:22.314883 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81451) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 14:42:22.315963 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81452) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 14:42:22.318106 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.318401 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.318678 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.318957 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.319144 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.319228 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.319446 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.319540 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.319733 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.320016 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.320296 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.320606 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.335737 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81451) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 14:42:22.336024 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.336292 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.336580 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.336734 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81452) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 14:42:22.337021 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.337287 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.337548 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.343567 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.344478 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.345131 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.346033 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.346651 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.346935 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.347558 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.347835 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.349651 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81451) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 14:42:22.349934 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.350212 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.350489 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.350615 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81452) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 14:42:22.350802 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.350936 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.351070 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.351350 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.351735 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.362932 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81451) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 14:42:22.363218 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.363478 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81452) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 14:42:22.363610 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.363766 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.363895 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.364054 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.364184 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.364356 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.364489 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.364711 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.364849 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.365015 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.365312 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.380644 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81451) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 14:42:22.381277 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81452) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 14:42:22.383538 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81451) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 14:42:22.384215 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81452) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 14:42:22.386519 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.387268 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.387989 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.388823 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.389482 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81451) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 14:42:22.389741 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.390129 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.390285 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81452) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 14:42:22.390567 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.390968 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.396499 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.397408 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.397959 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81451) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 14:42:22.398855 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81452) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 14:42:22.400847 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.401315 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.401636 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.401912 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.402041 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.402308 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.402597 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.402878 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.409729 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81451) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 14:42:22.410015 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.410295 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.410727 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81452) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 14:42:22.411017 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.411297 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.417695 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81451) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 14:42:22.417974 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.418250 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.418521 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.418771 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81452) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 14:42:22.418901 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.419054 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.419193 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.419329 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.419502 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.419628 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.419753 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.419877 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.420020 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.420155 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.420281 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.420432 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.420577 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.420723 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.420853 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.420982 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.421110 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.421247 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.421378 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.421506 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.421682 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.421957 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.422246 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:42:22.455754 dv-cinder-756711-11-smb devstack@keystone.service[81451]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5648f8ef89c0 pid: 81451 (default app) Sep 19 14:42:22.456880 dv-cinder-756711-11-smb devstack@keystone.service[81452]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5648f8ef89c0 pid: 81452 (default app) Sep 19 14:42:22.458968 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86290216-a804-4c60-a115-a6f3c1344861 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:22.459252 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86290216-a804-4c60-a115-a6f3c1344861 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:22.459524 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86290216-a804-4c60-a115-a6f3c1344861 None None] PATH_INFO: `/v3` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:22.463642 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1/1] 10.222.0.72 () {50 vars in 791 bytes} [Mon Sep 19 14:42:22 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:29.220576 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6061cf4-3feb-40ac-bc40-34bb4eb7b97f None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:29.221062 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6061cf4-3feb-40ac-bc40-34bb4eb7b97f None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:29.221166 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6061cf4-3feb-40ac-bc40-34bb4eb7b97f None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:29.225336 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1/2] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:42:29 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 14:42:29.230900 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da67d64a-9a94-40f8-90de-e19bc1f1b7b3 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:29.231342 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da67d64a-9a94-40f8-90de-e19bc1f1b7b3 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:29.231485 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da67d64a-9a94-40f8-90de-e19bc1f1b7b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:29.302094 dv-cinder-756711-11-smb devstack@keystone.service[81451]: INFO dbcounter [None req-da67d64a-9a94-40f8-90de-e19bc1f1b7b3 None None] Registered counter for database keystone Sep 19 14:42:29.320882 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG oslo_db.sqlalchemy.engines [None req-da67d64a-9a94-40f8-90de-e19bc1f1b7b3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81451) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 14:42:29.327744 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writer thread running {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 14:42:29.505839 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG passlib.handlers.bcrypt [None req-da67d64a-9a94-40f8-90de-e19bc1f1b7b3 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81451) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 19 14:42:29.506148 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG passlib.handlers.bcrypt [None req-da67d64a-9a94-40f8-90de-e19bc1f1b7b3 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81451) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 19 14:42:29.565087 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-da67d64a-9a94-40f8-90de-e19bc1f1b7b3 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:42:29.566706 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-da67d64a-9a94-40f8-90de-e19bc1f1b7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:42:29.694655 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 2/3] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:42:29 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 465 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Sep 19 14:42:30.188217 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6061cf4-3feb-40ac-bc40-34bb4eb7b97f None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:30.259307 dv-cinder-756711-11-smb devstack@keystone.service[81452]: INFO dbcounter [None req-c6061cf4-3feb-40ac-bc40-34bb4eb7b97f None None] Registered counter for database keystone Sep 19 14:42:30.281159 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG oslo_db.sqlalchemy.engines [None req-c6061cf4-3feb-40ac-bc40-34bb4eb7b97f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81452) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 14:42:30.287389 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writer thread running {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 14:42:30.406978 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6061cf4-3feb-40ac-bc40-34bb4eb7b97f None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:30.411220 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d22590-1be1-4f83-aec9-0df9c08599f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:30.411860 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d22590-1be1-4f83-aec9-0df9c08599f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:30.412143 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d22590-1be1-4f83-aec9-0df9c08599f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:30.412445 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d22590-1be1-4f83-aec9-0df9c08599f8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:30.421252 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d22590-1be1-4f83-aec9-0df9c08599f8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:30.489639 dv-cinder-756711-11-smb devstack@keystone.service[81452]: WARNING keystone.common.rbac_enforcer.enforcer [None req-04d22590-1be1-4f83-aec9-0df9c08599f8 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 19 14:42:30.490275 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d22590-1be1-4f83-aec9-0df9c08599f8 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:30.504149 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 2/4] 10.222.0.72 () {58 vars in 1324 bytes} [Mon Sep 19 14:42:30 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 14:42:30.510173 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da67d64a-9a94-40f8-90de-e19bc1f1b7b3 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:30.528000 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da67d64a-9a94-40f8-90de-e19bc1f1b7b3 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:30.532505 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13d4193-f8b7-4b9b-87cf-8ac03fe47c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:30.533624 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13d4193-f8b7-4b9b-87cf-8ac03fe47c60 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:30.533910 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13d4193-f8b7-4b9b-87cf-8ac03fe47c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:30.534189 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13d4193-f8b7-4b9b-87cf-8ac03fe47c60 admin admin] PATH_INFO: `/v3/projects/feee070208394133a3522f3d666241d3` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:30.535775 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13d4193-f8b7-4b9b-87cf-8ac03fe47c60 admin admin] RBAC: Authorizing `identity:get_project(project_id=feee070208394133a3522f3d666241d3)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:30.589650 dv-cinder-756711-11-smb devstack@keystone.service[81451]: WARNING keystone.common.rbac_enforcer.enforcer [None req-d13d4193-f8b7-4b9b-87cf-8ac03fe47c60 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 19 14:42:30.589997 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13d4193-f8b7-4b9b-87cf-8ac03fe47c60 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:30.594516 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 3/5] 10.222.0.72 () {56 vars in 1207 bytes} [Mon Sep 19 14:42:30 2022] GET /identity/v3/projects/feee070208394133a3522f3d666241d3 => generated 344 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:32.712725 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e008074-a712-4f69-8acb-fcbd498a2e16 None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:32.713299 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e008074-a712-4f69-8acb-fcbd498a2e16 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:32.713299 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e008074-a712-4f69-8acb-fcbd498a2e16 None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:32.717862 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 3/6] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:42:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:42:32.723268 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320399ee-43c7-4858-9e03-813fc54fdc44 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:32.723690 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320399ee-43c7-4858-9e03-813fc54fdc44 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:32.723818 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320399ee-43c7-4858-9e03-813fc54fdc44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:32.743931 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-320399ee-43c7-4858-9e03-813fc54fdc44 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:42:32.745496 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-320399ee-43c7-4858-9e03-813fc54fdc44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:42:32.753169 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 4/7] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:42:32 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Sep 19 14:42:33.018938 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e008074-a712-4f69-8acb-fcbd498a2e16 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:33.031054 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e008074-a712-4f69-8acb-fcbd498a2e16 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:33.035332 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f951f644-36d3-461b-ba88-32d19b1d56e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:33.035931 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f951f644-36d3-461b-ba88-32d19b1d56e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:33.036216 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f951f644-36d3-461b-ba88-32d19b1d56e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:33.036532 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f951f644-36d3-461b-ba88-32d19b1d56e8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:33.044671 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f951f644-36d3-461b-ba88-32d19b1d56e8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:33.046439 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f951f644-36d3-461b-ba88-32d19b1d56e8 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:33.055343 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 4/8] 10.222.0.72 () {58 vars in 1324 bytes} [Mon Sep 19 14:42:33 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 14:42:33.061551 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320399ee-43c7-4858-9e03-813fc54fdc44 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:33.070491 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320399ee-43c7-4858-9e03-813fc54fdc44 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:33.074778 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c7dcac-fcff-49fb-9daf-0acfe0c0b203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:33.075388 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c7dcac-fcff-49fb-9daf-0acfe0c0b203 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:33.075666 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c7dcac-fcff-49fb-9daf-0acfe0c0b203 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:33.075939 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c7dcac-fcff-49fb-9daf-0acfe0c0b203 admin admin] PATH_INFO: `/v3/users/2f19d59289e4450ca5e67c69c2e3b80c` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:33.077250 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c7dcac-fcff-49fb-9daf-0acfe0c0b203 admin admin] RBAC: Authorizing `identity:get_user(user_id=2f19d59289e4450ca5e67c69c2e3b80c)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:33.079086 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c7dcac-fcff-49fb-9daf-0acfe0c0b203 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:33.080619 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 5/9] 10.222.0.72 () {56 vars in 1198 bytes} [Mon Sep 19 14:42:33 2022] GET /identity/v3/users/2f19d59289e4450ca5e67c69c2e3b80c => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:35.343395 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907bf0ea-735c-4c40-aa10-76f14b61b6d6 None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:35.343931 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907bf0ea-735c-4c40-aa10-76f14b61b6d6 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:35.344065 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907bf0ea-735c-4c40-aa10-76f14b61b6d6 None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:35.345450 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 5/10] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:42:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:42:35.350705 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733a2d97-5ebe-4c66-af96-eb430f85956f None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:35.351137 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733a2d97-5ebe-4c66-af96-eb430f85956f None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:35.351415 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733a2d97-5ebe-4c66-af96-eb430f85956f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:35.369721 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-733a2d97-5ebe-4c66-af96-eb430f85956f None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:42:35.371846 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-733a2d97-5ebe-4c66-af96-eb430f85956f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:42:35.389438 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c6f5c6-9bc0-4e1e-b2d4-41e7f466b02e None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:35.389811 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c6f5c6-9bc0-4e1e-b2d4-41e7f466b02e None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:35.390162 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c6f5c6-9bc0-4e1e-b2d4-41e7f466b02e None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:35.391551 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 6/11] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:42:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 14:42:35.396615 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91be034-c922-4753-9157-a22b24f9a037 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:35.396903 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91be034-c922-4753-9157-a22b24f9a037 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:35.397178 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91be034-c922-4753-9157-a22b24f9a037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:35.440490 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG passlib.handlers.bcrypt [None req-d91be034-c922-4753-9157-a22b24f9a037 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81452) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 19 14:42:35.440888 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG passlib.handlers.bcrypt [None req-d91be034-c922-4753-9157-a22b24f9a037 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81452) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 19 14:42:35.454292 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 6/12] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:42:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:42:35.490437 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-d91be034-c922-4753-9157-a22b24f9a037 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:42:35.492023 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-d91be034-c922-4753-9157-a22b24f9a037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:42:35.590485 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 7/13] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:42:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 14:42:35.730729 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733a2d97-5ebe-4c66-af96-eb430f85956f None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:35.755046 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:35.839919 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733a2d97-5ebe-4c66-af96-eb430f85956f None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:35.860211 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91be034-c922-4753-9157-a22b24f9a037 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:35.873397 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ad92c4-1580-4c35-8d3f-ffafebdd8e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:35.874053 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ad92c4-1580-4c35-8d3f-ffafebdd8e67 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:35.874320 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ad92c4-1580-4c35-8d3f-ffafebdd8e67 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:35.874592 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ad92c4-1580-4c35-8d3f-ffafebdd8e67 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:35.885425 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ad92c4-1580-4c35-8d3f-ffafebdd8e67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:42:35.896497 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-49ad92c4-1580-4c35-8d3f-ffafebdd8e67 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:42:35.896497 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:35.896497 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:35.896497 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:35.896497 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:35.896497 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:35.896497 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:35.896497 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:35.896497 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:35.896497 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:35.896497 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:35.896497 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:35.896497 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:42:35.896497 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:42:35.896497 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:42:35.896497 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:42:35.897608 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:42:35.897608 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:42:35.897608 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:42:35.897608 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:42:35.897608 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:35.897608 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:35.897608 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:35.897608 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:35.897608 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:35.897608 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:35.897608 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:35.897608 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:35.897608 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:35.897608 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:35.897608 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:35.897608 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:35.898624 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:35.898624 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:35.898624 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:35.898624 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:35.898624 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:42:35.898624 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:42:35.898624 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:42:35.898624 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:42:35.898624 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:42:35.898624 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:42:35.898624 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:42:35.898624 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:42:35.898624 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 7/14] 10.222.0.72 () {56 vars in 1096 bytes} [Mon Sep 19 14:42:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:35.903834 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ad92c4-1580-4c35-8d3f-ffafebdd8e67 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:35.962297 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91be034-c922-4753-9157-a22b24f9a037 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:35.965144 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:35.984487 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:36.000444 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4e5b66-ea39-45eb-808f-d58d09870688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:36.001341 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4e5b66-ea39-45eb-808f-d58d09870688 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:36.001629 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4e5b66-ea39-45eb-808f-d58d09870688 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:36.001910 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4e5b66-ea39-45eb-808f-d58d09870688 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:36.002303 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ad92c4-1580-4c35-8d3f-ffafebdd8e67 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:36.037441 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2c2433-f4d4-40dc-85a9-806405a4ef50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:36.038050 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c2433-f4d4-40dc-85a9-806405a4ef50 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:36.038334 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c2433-f4d4-40dc-85a9-806405a4ef50 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:36.038610 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c2433-f4d4-40dc-85a9-806405a4ef50 None admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:36.039276 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2c2433-f4d4-40dc-85a9-806405a4ef50 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:36.039582 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2c2433-f4d4-40dc-85a9-806405a4ef50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:36.041015 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2c2433-f4d4-40dc-85a9-806405a4ef50 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:36.053364 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 8/15] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Sep 19 14:42:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:42:36.060583 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2c2433-f4d4-40dc-85a9-806405a4ef50 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:36.068698 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4e5b66-ea39-45eb-808f-d58d09870688 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:36.070216 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4e5b66-ea39-45eb-808f-d58d09870688 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:36.160538 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2c2433-f4d4-40dc-85a9-806405a4ef50 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:36.168884 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 8/16] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Sep 19 14:42:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 19 14:42:36.174490 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4e5b66-ea39-45eb-808f-d58d09870688 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:36.177268 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:36.195205 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9a6a95-531c-4aac-b079-b1ef55f705a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:36.195844 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9a6a95-531c-4aac-b079-b1ef55f705a6 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:36.196126 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9a6a95-531c-4aac-b079-b1ef55f705a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:36.196434 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9a6a95-531c-4aac-b079-b1ef55f705a6 None admin] PATH_INFO: `/v3/users/2f19d59289e4450ca5e67c69c2e3b80c` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:36.197586 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9a6a95-531c-4aac-b079-b1ef55f705a6 None admin] RBAC: Authorizing `identity:get_user(user_id=2f19d59289e4450ca5e67c69c2e3b80c)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:36.199667 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9a6a95-531c-4aac-b079-b1ef55f705a6 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:36.201259 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 9/17] 10.222.0.72 () {56 vars in 1177 bytes} [Mon Sep 19 14:42:36 2022] GET /identity/v3/users/2f19d59289e4450ca5e67c69c2e3b80c => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:42:36.206619 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9a6a95-531c-4aac-b079-b1ef55f705a6 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:36.220867 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:36.278209 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4e5b66-ea39-45eb-808f-d58d09870688 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:36.306678 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9a6a95-531c-4aac-b079-b1ef55f705a6 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:36.319635 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53a164e-d6af-48bd-bdf3-f8fa0dff366d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:36.320525 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53a164e-d6af-48bd-bdf3-f8fa0dff366d None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:36.320810 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53a164e-d6af-48bd-bdf3-f8fa0dff366d None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:36.321089 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53a164e-d6af-48bd-bdf3-f8fa0dff366d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:36.341111 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53a164e-d6af-48bd-bdf3-f8fa0dff366d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:36.342430 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a989f76a-20dd-4ca2-9b08-2c00bdae45ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:36.342594 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53a164e-d6af-48bd-bdf3-f8fa0dff366d None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:36.343054 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a989f76a-20dd-4ca2-9b08-2c00bdae45ac None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:36.343331 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a989f76a-20dd-4ca2-9b08-2c00bdae45ac None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:36.343600 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a989f76a-20dd-4ca2-9b08-2c00bdae45ac None admin] PATH_INFO: `/v3/domains/default` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:36.344735 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a989f76a-20dd-4ca2-9b08-2c00bdae45ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:36.346183 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a989f76a-20dd-4ca2-9b08-2c00bdae45ac None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:36.347704 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 10/18] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:42:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:42:36.353358 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a989f76a-20dd-4ca2-9b08-2c00bdae45ac None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:36.361269 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-b53a164e-d6af-48bd-bdf3-f8fa0dff366d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:36.361269 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:36.361269 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:36.361269 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:36.361269 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:36.361269 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:36.361269 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:36.361269 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:36.361269 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:36.361269 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:36.361269 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:36.361269 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:36.361269 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:42:36.361269 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:42:36.361269 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:42:36.361269 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:42:36.362428 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:36.362428 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:36.362428 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:36.362428 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:36.362428 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:36.362428 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:36.362428 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:36.362428 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:36.362428 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:36.362428 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:36.362428 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:36.362428 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:36.362428 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:36.362428 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:36.362428 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:36.362428 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:36.362428 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:42:36.363222 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:42:36.363222 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:36.363222 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:42:36.363222 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 9/19] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:42:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:42:36.369296 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53a164e-d6af-48bd-bdf3-f8fa0dff366d None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:36.424818 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:36.437927 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:36.458200 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a989f76a-20dd-4ca2-9b08-2c00bdae45ac None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:36.475759 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53a164e-d6af-48bd-bdf3-f8fa0dff366d None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:36.493712 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ba33aa-a6ae-4e05-a771-2508607ba870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:36.494330 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ba33aa-a6ae-4e05-a771-2508607ba870 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:36.494614 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ba33aa-a6ae-4e05-a771-2508607ba870 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:36.494890 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ba33aa-a6ae-4e05-a771-2508607ba870 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:36.496163 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ba33aa-a6ae-4e05-a771-2508607ba870 None admin] RBAC: Adding query filter params (role.id=ddb643577b2e4e478100ec370decfaeb, scope.domain.id=default, user.id=2f19d59289e4450ca5e67c69c2e3b80c) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:36.496638 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ba33aa-a6ae-4e05-a771-2508607ba870 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:36.498090 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ba33aa-a6ae-4e05-a771-2508607ba870 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:36.504683 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 11/20] 10.222.0.72 () {56 vars in 1322 bytes} [Mon Sep 19 14:42:36 2022] GET /identity/v3/role_assignments?user.id=2f19d59289e4450ca5e67c69c2e3b80c&scope.domain.id=default&role.id=ddb643577b2e4e478100ec370decfaeb => generated 233 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:42:36.509713 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347ff5fd-00dd-4a3f-bcd6-5557e6bbcdb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:36.510332 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ff5fd-00dd-4a3f-bcd6-5557e6bbcdb2 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:36.510612 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ff5fd-00dd-4a3f-bcd6-5557e6bbcdb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:36.510942 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ff5fd-00dd-4a3f-bcd6-5557e6bbcdb2 None admin] PATH_INFO: `/v3/domains` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:36.511759 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347ff5fd-00dd-4a3f-bcd6-5557e6bbcdb2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:36.512116 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347ff5fd-00dd-4a3f-bcd6-5557e6bbcdb2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:36.513593 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347ff5fd-00dd-4a3f-bcd6-5557e6bbcdb2 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:36.533058 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 10/21] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Sep 19 14:42:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:42:38.968350 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77803a9-7a47-42a4-954a-9417abfb81be None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:38.968863 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77803a9-7a47-42a4-954a-9417abfb81be None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:38.968942 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77803a9-7a47-42a4-954a-9417abfb81be None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:38.970349 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 12/22] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:42:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:42:38.989340 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d0ffb6-ba4a-47c2-9fa4-78ac043add9d None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:38.989828 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d0ffb6-ba4a-47c2-9fa4-78ac043add9d None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:38.989916 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d0ffb6-ba4a-47c2-9fa4-78ac043add9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:39.016923 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-e0d0ffb6-ba4a-47c2-9fa4-78ac043add9d None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:42:39.018175 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-e0d0ffb6-ba4a-47c2-9fa4-78ac043add9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:42:39.112473 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 11/23] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:42:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:42:39.133160 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db8041d-b2c6-494a-aa98-3e0eba207d8a None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:39.133430 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db8041d-b2c6-494a-aa98-3e0eba207d8a None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:39.133713 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db8041d-b2c6-494a-aa98-3e0eba207d8a None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:39.135045 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 13/24] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:42:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:42:39.140813 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e54de0-541a-4550-9c7c-f143f5220775 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:39.141103 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e54de0-541a-4550-9c7c-f143f5220775 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:39.141565 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e54de0-541a-4550-9c7c-f143f5220775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:39.169174 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-21e54de0-541a-4550-9c7c-f143f5220775 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:42:39.170303 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-21e54de0-541a-4550-9c7c-f143f5220775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:42:39.228717 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:39.254591 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 12/25] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:42:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:42:39.502017 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb7a1b3-e41b-49e1-a4d8-58350c63a954 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:39.502404 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb7a1b3-e41b-49e1-a4d8-58350c63a954 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:39.502589 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb7a1b3-e41b-49e1-a4d8-58350c63a954 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:39.503934 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 14/26] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:42:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:42:39.530227 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93859eb-c23c-4942-9596-15a2236b6728 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:39.530514 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93859eb-c23c-4942-9596-15a2236b6728 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:39.530788 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93859eb-c23c-4942-9596-15a2236b6728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:39.561392 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-c93859eb-c23c-4942-9596-15a2236b6728 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:42:39.562602 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-c93859eb-c23c-4942-9596-15a2236b6728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:42:39.642386 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 13/27] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:42:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:42:39.688632 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb7a1b3-e41b-49e1-a4d8-58350c63a954 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:39.746382 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93859eb-c23c-4942-9596-15a2236b6728 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:39.887143 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb7a1b3-e41b-49e1-a4d8-58350c63a954 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:39.953954 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93859eb-c23c-4942-9596-15a2236b6728 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:39.966508 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:39.976493 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab28e22-5f98-4da1-92fd-1aae52cabf8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:39.978411 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab28e22-5f98-4da1-92fd-1aae52cabf8f None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:39.979050 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab28e22-5f98-4da1-92fd-1aae52cabf8f None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:39.981353 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab28e22-5f98-4da1-92fd-1aae52cabf8f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:40.005749 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab28e22-5f98-4da1-92fd-1aae52cabf8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:42:40.014471 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-cab28e22-5f98-4da1-92fd-1aae52cabf8f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:42:40.014471 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:40.014471 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:40.014471 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:40.014471 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:40.014471 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:40.014471 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:40.014471 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:40.014471 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:40.014471 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:40.014471 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:40.014471 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:40.014471 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:42:40.014471 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:42:40.014471 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:42:40.014471 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:42:40.015312 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:42:40.015312 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:42:40.015312 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:42:40.015312 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:42:40.015312 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:40.015312 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:40.015312 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:40.015312 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:40.015312 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:40.015312 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:40.015312 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:40.015312 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:40.015312 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:40.015312 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:40.015312 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:40.015312 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:40.016086 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:40.016086 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:40.016086 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:40.016086 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:40.016086 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:42:40.016086 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:42:40.016086 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:42:40.016086 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:42:40.016086 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:42:40.016086 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:42:40.016086 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:42:40.016086 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:42:40.021688 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e959e25-4e17-49d4-a4a5-81b4f45cfbd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:40.022897 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e959e25-4e17-49d4-a4a5-81b4f45cfbd2 None admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:40.024264 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 15/28] 10.222.0.72 () {56 vars in 1096 bytes} [Mon Sep 19 14:42:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:40.024770 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e959e25-4e17-49d4-a4a5-81b4f45cfbd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:40.025243 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e959e25-4e17-49d4-a4a5-81b4f45cfbd2 None admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:40.027197 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e9e2f9-20e4-404b-ad0f-65d8a159eccc None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:40.028090 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e959e25-4e17-49d4-a4a5-81b4f45cfbd2 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:40.029726 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e959e25-4e17-49d4-a4a5-81b4f45cfbd2 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:40.030209 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e9e2f9-20e4-404b-ad0f-65d8a159eccc None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:40.030741 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e9e2f9-20e4-404b-ad0f-65d8a159eccc None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:40.035670 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 16/29] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:42:40 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:42:40.036629 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e9e2f9-20e4-404b-ad0f-65d8a159eccc None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:40.045178 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:40.180417 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 14/30] 10.222.0.72 () {60 vars in 1131 bytes} [Mon Sep 19 14:42:39 2022] POST /identity/v3/roles => generated 219 bytes in 435 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 14:42:40.185459 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5434b791-ec21-43f9-8d0f-fcbca98debd6 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:40.185997 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5434b791-ec21-43f9-8d0f-fcbca98debd6 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:40.185997 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5434b791-ec21-43f9-8d0f-fcbca98debd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:40.193817 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e9e2f9-20e4-404b-ad0f-65d8a159eccc None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:40.215599 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-5434b791-ec21-43f9-8d0f-fcbca98debd6 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:42:40.217236 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-5434b791-ec21-43f9-8d0f-fcbca98debd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:42:40.275567 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb46fe2-4ba4-4d31-9b6c-a88ba70640a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:40.276198 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb46fe2-4ba4-4d31-9b6c-a88ba70640a1 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:40.276573 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb46fe2-4ba4-4d31-9b6c-a88ba70640a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:40.276857 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb46fe2-4ba4-4d31-9b6c-a88ba70640a1 None admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:40.277792 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb46fe2-4ba4-4d31-9b6c-a88ba70640a1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:40.278100 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb46fe2-4ba4-4d31-9b6c-a88ba70640a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:40.279541 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb46fe2-4ba4-4d31-9b6c-a88ba70640a1 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:40.307763 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 17/31] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Sep 19 14:42:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:40.308715 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb46fe2-4ba4-4d31-9b6c-a88ba70640a1 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:40.359110 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 15/32] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:42:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:42:40.359795 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5434b791-ec21-43f9-8d0f-fcbca98debd6 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:40.472778 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:40.543702 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb46fe2-4ba4-4d31-9b6c-a88ba70640a1 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:40.561622 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:40.572590 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5434b791-ec21-43f9-8d0f-fcbca98debd6 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:40.587398 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dbc3ee-0060-4356-ab5f-eee2179b4882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:40.588250 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dbc3ee-0060-4356-ab5f-eee2179b4882 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:40.588569 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dbc3ee-0060-4356-ab5f-eee2179b4882 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:40.588886 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dbc3ee-0060-4356-ab5f-eee2179b4882 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:40.601731 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dbc3ee-0060-4356-ab5f-eee2179b4882 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:40.603537 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dbc3ee-0060-4356-ab5f-eee2179b4882 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:40.616024 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368141a4-d39b-4380-a4b9-fe3a3c0a7e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:40.616886 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368141a4-d39b-4380-a4b9-fe3a3c0a7e47 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:40.617331 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368141a4-d39b-4380-a4b9-fe3a3c0a7e47 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:40.617747 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368141a4-d39b-4380-a4b9-fe3a3c0a7e47 None admin] PATH_INFO: `/v3/users/2f19d59289e4450ca5e67c69c2e3b80c` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:40.619474 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368141a4-d39b-4380-a4b9-fe3a3c0a7e47 None admin] RBAC: Authorizing `identity:get_user(user_id=2f19d59289e4450ca5e67c69c2e3b80c)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:40.621280 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368141a4-d39b-4380-a4b9-fe3a3c0a7e47 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:40.622120 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-03dbc3ee-0060-4356-ab5f-eee2179b4882 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:40.622120 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:40.622120 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:40.622120 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:40.622120 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:40.622120 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:40.622120 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:40.622120 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:40.622120 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:40.622120 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:40.622120 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:40.622120 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:40.622120 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:42:40.622120 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:42:40.622120 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:42:40.622120 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:42:40.623116 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:40.623116 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:40.623116 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:40.623116 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:40.623116 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:40.623116 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:40.623116 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:40.623116 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:40.623116 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:40.623116 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:40.623116 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:40.623116 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:40.623116 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:40.623116 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:40.623116 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:40.623116 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:40.623116 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:42:40.624064 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:42:40.624064 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:40.624064 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:42:40.624064 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 18/33] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:42:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:40.624928 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cac282-bac6-413c-ba95-e321a4c6af40 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:40.625260 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cac282-bac6-413c-ba95-e321a4c6af40 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:40.625533 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cac282-bac6-413c-ba95-e321a4c6af40 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:40.626331 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 16/34] 10.222.0.72 () {56 vars in 1177 bytes} [Mon Sep 19 14:42:40 2022] GET /identity/v3/users/2f19d59289e4450ca5e67c69c2e3b80c => generated 247 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:40.626893 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 19/35] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:42:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:42:40.632948 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368141a4-d39b-4380-a4b9-fe3a3c0a7e47 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:40.633640 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cac282-bac6-413c-ba95-e321a4c6af40 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:40.752296 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368141a4-d39b-4380-a4b9-fe3a3c0a7e47 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:40.757425 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cac282-bac6-413c-ba95-e321a4c6af40 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:40.775147 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:40.787997 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc3ce0c-501c-4b4d-855e-f5058a825ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:40.788667 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc3ce0c-501c-4b4d-855e-f5058a825ff9 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:40.788948 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc3ce0c-501c-4b4d-855e-f5058a825ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:40.789222 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc3ce0c-501c-4b4d-855e-f5058a825ff9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:40.790331 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc3ce0c-501c-4b4d-855e-f5058a825ff9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:40.791782 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc3ce0c-501c-4b4d-855e-f5058a825ff9 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:40.792200 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ac2b61-2caa-417d-94cb-de6a45ee66d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:40.792966 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac2b61-2caa-417d-94cb-de6a45ee66d9 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:40.793243 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac2b61-2caa-417d-94cb-de6a45ee66d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:40.793413 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 17/36] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:42:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:42:40.793565 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac2b61-2caa-417d-94cb-de6a45ee66d9 None admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:40.794146 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ac2b61-2caa-417d-94cb-de6a45ee66d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:40.794446 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ac2b61-2caa-417d-94cb-de6a45ee66d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:40.794537 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae28c30e-ce2d-4998-930c-4b5a7b13c1eb None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:40.794794 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae28c30e-ce2d-4998-930c-4b5a7b13c1eb None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:40.795061 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae28c30e-ce2d-4998-930c-4b5a7b13c1eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:40.795819 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ac2b61-2caa-417d-94cb-de6a45ee66d9 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:40.814792 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 20/37] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Sep 19 14:42:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:40.815843 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ac2b61-2caa-417d-94cb-de6a45ee66d9 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:40.816361 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-ae28c30e-ce2d-4998-930c-4b5a7b13c1eb None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:42:40.817554 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-ae28c30e-ce2d-4998-930c-4b5a7b13c1eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:42:40.844561 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:40.885316 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 18/38] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:42:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:42:40.887822 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1e6638-4858-438c-8db0-ae0452d631fa None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:40.887822 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1e6638-4858-438c-8db0-ae0452d631fa None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:40.887996 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1e6638-4858-438c-8db0-ae0452d631fa None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:40.891768 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 19/39] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:42:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:42:40.896601 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1e6638-4858-438c-8db0-ae0452d631fa None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:40.927644 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ac2b61-2caa-417d-94cb-de6a45ee66d9 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:40.965379 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5b45c2-3125-4f16-b770-73f7c62f2c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:40.965998 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5b45c2-3125-4f16-b770-73f7c62f2c4a None admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:40.966288 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5b45c2-3125-4f16-b770-73f7c62f2c4a None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:40.966568 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5b45c2-3125-4f16-b770-73f7c62f2c4a None admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:40.967286 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5b45c2-3125-4f16-b770-73f7c62f2c4a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:40.968663 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5b45c2-3125-4f16-b770-73f7c62f2c4a None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:41.003871 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1e6638-4858-438c-8db0-ae0452d631fa None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:41.039676 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a275db9-0e62-493b-acf7-d28a8c2d9cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:41.040322 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a275db9-0e62-493b-acf7-d28a8c2d9cd7 None admin] REQUEST_METHOD: `PUT` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:41.040628 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a275db9-0e62-493b-acf7-d28a8c2d9cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:41.040908 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a275db9-0e62-493b-acf7-d28a8c2d9cd7 None admin] PATH_INFO: `/v3/domains/default/users/2f19d59289e4450ca5e67c69c2e3b80c/roles/ddb643577b2e4e478100ec370decfaeb` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:41.043350 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a275db9-0e62-493b-acf7-d28a8c2d9cd7 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=2f19d59289e4450ca5e67c69c2e3b80c, role_id=ddb643577b2e4e478100ec370decfaeb)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:41.044821 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a275db9-0e62-493b-acf7-d28a8c2d9cd7 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:41.059927 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 20/40] 10.222.0.72 () {58 vars in 1361 bytes} [Mon Sep 19 14:42:40 2022] PUT /identity/v3/domains/default/users/2f19d59289e4450ca5e67c69c2e3b80c/roles/ddb643577b2e4e478100ec370decfaeb => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:42:41.068706 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a275db9-0e62-493b-acf7-d28a8c2d9cd7 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:41.092500 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 21/41] 10.222.0.72 () {60 vars in 1131 bytes} [Mon Sep 19 14:42:40 2022] POST /identity/v3/roles => generated 225 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:42:41.094206 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a67154-3253-4b1f-93ee-14646cba7ac2 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:41.094432 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a67154-3253-4b1f-93ee-14646cba7ac2 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:41.094716 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a67154-3253-4b1f-93ee-14646cba7ac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:41.097905 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:41.117784 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-94a67154-3253-4b1f-93ee-14646cba7ac2 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:42:41.119384 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-94a67154-3253-4b1f-93ee-14646cba7ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:42:41.169182 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:41.222274 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a275db9-0e62-493b-acf7-d28a8c2d9cd7 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:41.230052 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 22/42] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:42:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:42:41.231021 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a67154-3253-4b1f-93ee-14646cba7ac2 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:41.291653 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b07ef0-e70b-4ed7-b18c-34252bddbb0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:41.292277 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b07ef0-e70b-4ed7-b18c-34252bddbb0a None admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:41.292601 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b07ef0-e70b-4ed7-b18c-34252bddbb0a None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:41.292878 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b07ef0-e70b-4ed7-b18c-34252bddbb0a None admin] PATH_INFO: `/v3/projects` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:41.293566 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b07ef0-e70b-4ed7-b18c-34252bddbb0a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:41.301940 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b07ef0-e70b-4ed7-b18c-34252bddbb0a None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:41.349719 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 21/43] 10.222.0.72 () {60 vars in 1141 bytes} [Mon Sep 19 14:42:41 2022] POST /identity/v3/projects => generated 301 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:42:41.399996 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a67154-3253-4b1f-93ee-14646cba7ac2 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:41.443868 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427477fb-a0c3-48d3-87ac-f8f5f425fbf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:41.444534 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427477fb-a0c3-48d3-87ac-f8f5f425fbf0 None admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:41.444822 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427477fb-a0c3-48d3-87ac-f8f5f425fbf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:41.445102 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427477fb-a0c3-48d3-87ac-f8f5f425fbf0 None admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:41.445844 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427477fb-a0c3-48d3-87ac-f8f5f425fbf0 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:41.447459 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427477fb-a0c3-48d3-87ac-f8f5f425fbf0 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:41.466306 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 23/44] 10.222.0.72 () {60 vars in 1131 bytes} [Mon Sep 19 14:42:41 2022] POST /identity/v3/roles => generated 223 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:42:41.531571 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b07ef0-e70b-4ed7-b18c-34252bddbb0a None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:41.628175 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:41.659049 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b07ef0-e70b-4ed7-b18c-34252bddbb0a None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:41.696935 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac90e54-4f67-4e47-a220-311909be15bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:41.697579 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac90e54-4f67-4e47-a220-311909be15bf None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:41.697864 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac90e54-4f67-4e47-a220-311909be15bf None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:41.698142 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac90e54-4f67-4e47-a220-311909be15bf None admin] PATH_INFO: `/v3/domains/default` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:41.699722 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac90e54-4f67-4e47-a220-311909be15bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:41.701211 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac90e54-4f67-4e47-a220-311909be15bf None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:41.702969 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 22/45] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:42:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:41.708658 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427477fb-a0c3-48d3-87ac-f8f5f425fbf0 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:41.844313 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:41.917978 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427477fb-a0c3-48d3-87ac-f8f5f425fbf0 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:41.952204 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b8aa65-59b7-4362-b1b8-fd0f88a7d0ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:41.952850 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b8aa65-59b7-4362-b1b8-fd0f88a7d0ce None admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:41.953131 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b8aa65-59b7-4362-b1b8-fd0f88a7d0ce None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:41.953405 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b8aa65-59b7-4362-b1b8-fd0f88a7d0ce None admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:41.954062 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b8aa65-59b7-4362-b1b8-fd0f88a7d0ce None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:41.955506 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b8aa65-59b7-4362-b1b8-fd0f88a7d0ce None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:41.984405 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 24/46] 10.222.0.72 () {60 vars in 1141 bytes} [Mon Sep 19 14:42:41 2022] POST /identity/v3/projects => generated 312 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:42:43.404052 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6911509-f0dd-4092-b4d9-1a50a6f670a1 None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:43.404601 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6911509-f0dd-4092-b4d9-1a50a6f670a1 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:43.404708 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6911509-f0dd-4092-b4d9-1a50a6f670a1 None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:43.405978 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 23/47] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:42:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:42:43.411431 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c94d3a-49ad-4260-9ff9-4d3a6d21b0b5 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:43.411813 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c94d3a-49ad-4260-9ff9-4d3a6d21b0b5 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:43.412058 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c94d3a-49ad-4260-9ff9-4d3a6d21b0b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:43.430694 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-c1c94d3a-49ad-4260-9ff9-4d3a6d21b0b5 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:42:43.431866 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-c1c94d3a-49ad-4260-9ff9-4d3a6d21b0b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:42:43.497879 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 25/48] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:42:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:42:43.762448 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6911509-f0dd-4092-b4d9-1a50a6f670a1 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:43.863077 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6911509-f0dd-4092-b4d9-1a50a6f670a1 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:43.900740 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ec512e-c3e2-42f9-9cc3-062c1e6032c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:43.901379 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ec512e-c3e2-42f9-9cc3-062c1e6032c7 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:43.901662 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ec512e-c3e2-42f9-9cc3-062c1e6032c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:43.901939 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ec512e-c3e2-42f9-9cc3-062c1e6032c7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:43.915853 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ec512e-c3e2-42f9-9cc3-062c1e6032c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:42:43.922787 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-65ec512e-c3e2-42f9-9cc3-062c1e6032c7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:42:43.922787 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:43.922787 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:43.922787 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:43.922787 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:43.922787 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:43.922787 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:43.922787 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:43.922787 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:43.922787 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:43.922787 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:43.922787 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:43.922787 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:42:43.922787 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:42:43.922787 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:42:43.922787 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:42:43.923619 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:42:43.923619 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:42:43.923619 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:42:43.923619 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:42:43.923619 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:43.923619 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:43.923619 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:43.923619 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:43.923619 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:43.923619 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:43.923619 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:43.923619 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:43.923619 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:43.923619 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:43.923619 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:43.923619 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:43.924611 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:43.924611 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:43.924611 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:43.924611 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:43.924611 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:42:43.924611 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:42:43.924611 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:42:43.924611 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:42:43.924611 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:42:43.924611 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:42:43.924611 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:42:43.924611 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:42:43.924611 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 24/49] 10.222.0.72 () {56 vars in 1096 bytes} [Mon Sep 19 14:42:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:43.930024 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c94d3a-49ad-4260-9ff9-4d3a6d21b0b5 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:43.951224 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:44.043547 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c94d3a-49ad-4260-9ff9-4d3a6d21b0b5 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:44.079827 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72da01c1-ba33-4255-a4ee-8f3f64a4f868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:44.080492 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72da01c1-ba33-4255-a4ee-8f3f64a4f868 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:44.080782 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72da01c1-ba33-4255-a4ee-8f3f64a4f868 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:44.081061 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72da01c1-ba33-4255-a4ee-8f3f64a4f868 None admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:44.081726 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72da01c1-ba33-4255-a4ee-8f3f64a4f868 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:44.082031 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72da01c1-ba33-4255-a4ee-8f3f64a4f868 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:44.083426 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72da01c1-ba33-4255-a4ee-8f3f64a4f868 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:44.091689 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 26/50] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Sep 19 14:42:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:44.097513 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ec512e-c3e2-42f9-9cc3-062c1e6032c7 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:44.100418 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:44.152235 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98667e70-3bc4-4b22-9732-91c721617b92 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:44.152550 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98667e70-3bc4-4b22-9732-91c721617b92 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:44.152837 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98667e70-3bc4-4b22-9732-91c721617b92 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:44.154168 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 27/51] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:42:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 14:42:44.159162 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b7e5b-8274-4b2a-9ab5-54604e4a1d7e None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:44.159452 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b7e5b-8274-4b2a-9ab5-54604e4a1d7e None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:44.159734 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b7e5b-8274-4b2a-9ab5-54604e4a1d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:44.179087 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-910b7e5b-8274-4b2a-9ab5-54604e4a1d7e None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:42:44.180313 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-910b7e5b-8274-4b2a-9ab5-54604e4a1d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:42:44.200317 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ec512e-c3e2-42f9-9cc3-062c1e6032c7 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:44.233957 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01569ce6-7d95-4eb0-b23e-7fa177f89193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:44.234859 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01569ce6-7d95-4eb0-b23e-7fa177f89193 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:44.235290 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01569ce6-7d95-4eb0-b23e-7fa177f89193 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:44.235565 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01569ce6-7d95-4eb0-b23e-7fa177f89193 None admin] PATH_INFO: `/v3/users/2f19d59289e4450ca5e67c69c2e3b80c` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:44.236754 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01569ce6-7d95-4eb0-b23e-7fa177f89193 None admin] RBAC: Authorizing `identity:get_user(user_id=2f19d59289e4450ca5e67c69c2e3b80c)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:44.238220 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01569ce6-7d95-4eb0-b23e-7fa177f89193 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:44.239802 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 25/52] 10.222.0.72 () {56 vars in 1177 bytes} [Mon Sep 19 14:42:44 2022] GET /identity/v3/users/2f19d59289e4450ca5e67c69c2e3b80c => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:44.245350 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01569ce6-7d95-4eb0-b23e-7fa177f89193 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:44.249144 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 28/53] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:42:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 14:42:44.312862 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:44.343975 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01569ce6-7d95-4eb0-b23e-7fa177f89193 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:44.376529 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d310bc-3218-4824-955b-a33962401959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:44.377149 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d310bc-3218-4824-955b-a33962401959 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:44.377432 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d310bc-3218-4824-955b-a33962401959 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:44.377706 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d310bc-3218-4824-955b-a33962401959 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:44.378824 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d310bc-3218-4824-955b-a33962401959 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:44.380261 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d310bc-3218-4824-955b-a33962401959 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:44.381837 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 26/54] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:42:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:42:44.387805 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910b7e5b-8274-4b2a-9ab5-54604e4a1d7e None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:44.390428 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:44.486989 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910b7e5b-8274-4b2a-9ab5-54604e4a1d7e None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:44.523924 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d310bc-3218-4824-955b-a33962401959 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:44.529813 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3688fc82-b05d-48c4-9cd5-b4126b966508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:44.530429 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3688fc82-b05d-48c4-9cd5-b4126b966508 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:44.530712 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3688fc82-b05d-48c4-9cd5-b4126b966508 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:44.530988 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3688fc82-b05d-48c4-9cd5-b4126b966508 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:44.531718 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3688fc82-b05d-48c4-9cd5-b4126b966508 None admin] RBAC: Adding query filter params (role.id=ddb643577b2e4e478100ec370decfaeb, scope.domain.id=default, user.id=2f19d59289e4450ca5e67c69c2e3b80c) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:44.532031 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3688fc82-b05d-48c4-9cd5-b4126b966508 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:44.533536 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3688fc82-b05d-48c4-9cd5-b4126b966508 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:44.540076 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 29/55] 10.222.0.72 () {56 vars in 1322 bytes} [Mon Sep 19 14:42:44 2022] GET /identity/v3/role_assignments?user.id=2f19d59289e4450ca5e67c69c2e3b80c&scope.domain.id=default&role.id=ddb643577b2e4e478100ec370decfaeb => generated 530 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:44.736220 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d310bc-3218-4824-955b-a33962401959 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:44.770212 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0906bd17-2963-4a5d-9e5f-9c436fe282e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:44.770848 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0906bd17-2963-4a5d-9e5f-9c436fe282e2 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:44.771129 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0906bd17-2963-4a5d-9e5f-9c436fe282e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:44.771403 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0906bd17-2963-4a5d-9e5f-9c436fe282e2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:44.772528 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0906bd17-2963-4a5d-9e5f-9c436fe282e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:44.773965 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0906bd17-2963-4a5d-9e5f-9c436fe282e2 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:44.775519 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 27/56] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:42:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:42:44.781352 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3688fc82-b05d-48c4-9cd5-b4126b966508 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:44.848758 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:44.883089 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3688fc82-b05d-48c4-9cd5-b4126b966508 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:44.917294 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902d19cc-526c-4af8-ad78-51bcf94c621d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:44.918048 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d19cc-526c-4af8-ad78-51bcf94c621d None admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:44.918336 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d19cc-526c-4af8-ad78-51bcf94c621d None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:44.918615 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d19cc-526c-4af8-ad78-51bcf94c621d None admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:44.919273 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902d19cc-526c-4af8-ad78-51bcf94c621d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:44.920776 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902d19cc-526c-4af8-ad78-51bcf94c621d None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:44.946395 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 30/57] 10.222.0.72 () {60 vars in 1140 bytes} [Mon Sep 19 14:42:44 2022] POST /identity/v3/projects => generated 298 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:42:47.085878 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d9e77f-83cb-47eb-8107-2cf73da228b2 None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:47.086379 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d9e77f-83cb-47eb-8107-2cf73da228b2 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:47.086462 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d9e77f-83cb-47eb-8107-2cf73da228b2 None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:47.087771 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 28/58] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:42:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:42:47.093176 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276edc85-78fa-4659-a7dc-00cd53c85c8f None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:47.093605 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276edc85-78fa-4659-a7dc-00cd53c85c8f None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:47.093733 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276edc85-78fa-4659-a7dc-00cd53c85c8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:47.111826 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-276edc85-78fa-4659-a7dc-00cd53c85c8f None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:42:47.113053 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-276edc85-78fa-4659-a7dc-00cd53c85c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:42:47.177929 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 31/59] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:42:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:42:47.445731 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d9e77f-83cb-47eb-8107-2cf73da228b2 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:47.455437 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:47.546769 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d9e77f-83cb-47eb-8107-2cf73da228b2 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:47.579768 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeeadee-4c6c-4ae0-ad86-a29bbf11494c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:47.580414 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeeadee-4c6c-4ae0-ad86-a29bbf11494c None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:47.580699 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeeadee-4c6c-4ae0-ad86-a29bbf11494c None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:47.580975 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeeadee-4c6c-4ae0-ad86-a29bbf11494c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:47.582076 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeeadee-4c6c-4ae0-ad86-a29bbf11494c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:47.583506 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeeadee-4c6c-4ae0-ad86-a29bbf11494c None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:47.585084 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 29/60] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:42:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:47.590774 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276edc85-78fa-4659-a7dc-00cd53c85c8f None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:47.638644 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:47.696418 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276edc85-78fa-4659-a7dc-00cd53c85c8f None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:47.728716 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e9a85a-976b-4116-b8dc-67c5f5d6208a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:47.729316 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e9a85a-976b-4116-b8dc-67c5f5d6208a None admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:47.729597 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e9a85a-976b-4116-b8dc-67c5f5d6208a None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:47.730360 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e9a85a-976b-4116-b8dc-67c5f5d6208a None admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:47.730994 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e9a85a-976b-4116-b8dc-67c5f5d6208a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:47.732456 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e9a85a-976b-4116-b8dc-67c5f5d6208a None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:47.758439 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 32/61] 10.222.0.72 () {60 vars in 1132 bytes} [Mon Sep 19 14:42:47 2022] POST /identity/v3/users => generated 275 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:42:50.719117 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcdcf41-e58f-4e1d-bbcd-43f9c975e7e9 None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:50.719617 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcdcf41-e58f-4e1d-bbcd-43f9c975e7e9 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:50.719689 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcdcf41-e58f-4e1d-bbcd-43f9c975e7e9 None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:50.721117 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 30/62] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:42:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:42:50.728533 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ff1a3f-cb6d-4d42-8baf-346eb419c678 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:50.728978 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ff1a3f-cb6d-4d42-8baf-346eb419c678 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:50.729157 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ff1a3f-cb6d-4d42-8baf-346eb419c678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:50.751501 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-61ff1a3f-cb6d-4d42-8baf-346eb419c678 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:42:50.752724 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-61ff1a3f-cb6d-4d42-8baf-346eb419c678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:42:50.834793 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 33/63] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:42:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:42:51.174976 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2f267b-d9d2-4fdb-acdf-faded2f92347 None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:51.175156 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2f267b-d9d2-4fdb-acdf-faded2f92347 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:51.175441 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2f267b-d9d2-4fdb-acdf-faded2f92347 None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:51.176938 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 31/64] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:42:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:42:51.188086 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5c74e8-7a50-4d9d-9c74-886fcc8d56eb None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:51.188403 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5c74e8-7a50-4d9d-9c74-886fcc8d56eb None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:51.188687 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5c74e8-7a50-4d9d-9c74-886fcc8d56eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:51.196486 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2f267b-d9d2-4fdb-acdf-faded2f92347 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:51.209882 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-4d5c74e8-7a50-4d9d-9c74-886fcc8d56eb None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:42:51.211072 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-4d5c74e8-7a50-4d9d-9c74-886fcc8d56eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:42:51.262308 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:51.356031 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:51.370343 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 34/65] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:42:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:42:51.387052 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2f267b-d9d2-4fdb-acdf-faded2f92347 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:51.405601 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc474e3-e003-4259-8b25-a0f07ada97dd None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:51.405901 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc474e3-e003-4259-8b25-a0f07ada97dd None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:51.406166 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc474e3-e003-4259-8b25-a0f07ada97dd None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:51.412474 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 35/66] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:42:51 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:42:51.418572 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f671d4-9d5b-4ac5-b8d8-81609174d5b4 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:51.418860 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f671d4-9d5b-4ac5-b8d8-81609174d5b4 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:51.419143 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f671d4-9d5b-4ac5-b8d8-81609174d5b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:51.456889 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eb60d3-1928-4859-a011-81a64ba66bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:51.457536 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb60d3-1928-4859-a011-81a64ba66bea None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:51.457820 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb60d3-1928-4859-a011-81a64ba66bea None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:51.458097 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb60d3-1928-4859-a011-81a64ba66bea None admin] PATH_INFO: `/v3/roles/member` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:51.460598 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-b7f671d4-9d5b-4ac5-b8d8-81609174d5b4 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:42:51.461804 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-b7f671d4-9d5b-4ac5-b8d8-81609174d5b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:42:51.479247 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35eb60d3-1928-4859-a011-81a64ba66bea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:42:51.485101 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-35eb60d3-1928-4859-a011-81a64ba66bea None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 14:42:51.485101 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:51.485101 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:51.485101 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:51.485101 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:51.485101 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:51.485101 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:51.485101 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:51.485101 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:51.485101 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:51.485101 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:51.485101 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:51.485101 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:42:51.485101 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:42:51.485101 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:42:51.485101 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:42:51.485925 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:42:51.485925 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:42:51.485925 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:42:51.485925 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:42:51.485925 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:51.485925 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:51.485925 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:51.485925 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:51.485925 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:51.485925 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:51.485925 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:51.485925 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:51.485925 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:51.485925 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:51.485925 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:51.485925 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:51.486656 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:51.486656 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:51.486656 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:51.486656 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:51.486656 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:42:51.486656 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:42:51.486656 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:42:51.486656 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:42:51.486656 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:42:51.486656 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:42:51.486656 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 14:42:51.486656 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:42:51.487217 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 32/67] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Sep 19 14:42:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:51.492989 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eb60d3-1928-4859-a011-81a64ba66bea None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:51.575078 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 36/68] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:42:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 14:42:51.649982 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eb60d3-1928-4859-a011-81a64ba66bea None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:51.698946 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19317311-69f2-40f1-932b-fa1bdc138445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:51.699563 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19317311-69f2-40f1-932b-fa1bdc138445 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:51.699844 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19317311-69f2-40f1-932b-fa1bdc138445 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:51.700119 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19317311-69f2-40f1-932b-fa1bdc138445 None admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:51.700814 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19317311-69f2-40f1-932b-fa1bdc138445 None admin] RBAC: Adding query filter params (name=member) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:51.701120 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19317311-69f2-40f1-932b-fa1bdc138445 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:51.702494 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19317311-69f2-40f1-932b-fa1bdc138445 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:51.704136 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:51.723648 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f671d4-9d5b-4ac5-b8d8-81609174d5b4 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:51.723970 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 33/69] 10.222.0.72 () {56 vars in 1101 bytes} [Mon Sep 19 14:42:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:51.730409 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19317311-69f2-40f1-932b-fa1bdc138445 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:51.837365 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:51.844455 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f671d4-9d5b-4ac5-b8d8-81609174d5b4 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:51.884641 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9340326-626f-4d1e-ba0f-c52e7634d0a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:51.885719 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9340326-626f-4d1e-ba0f-c52e7634d0a6 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:51.886308 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9340326-626f-4d1e-ba0f-c52e7634d0a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:51.886924 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9340326-626f-4d1e-ba0f-c52e7634d0a6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:51.898537 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9340326-626f-4d1e-ba0f-c52e7634d0a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:42:51.904518 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-f9340326-626f-4d1e-ba0f-c52e7634d0a6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:42:51.904518 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:51.904518 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:51.904518 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:51.904518 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:51.904518 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:51.904518 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:51.904518 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:51.904518 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:51.904518 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:51.904518 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:51.904518 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:51.904518 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:42:51.904518 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:42:51.904518 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:42:51.904518 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:42:51.905360 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:42:51.905360 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:42:51.905360 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:42:51.905360 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:42:51.905360 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:51.905360 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:51.905360 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:51.905360 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:51.905360 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:51.905360 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:51.905360 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:51.905360 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:51.905360 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:51.905360 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:51.905360 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:51.905360 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:51.906116 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:51.906116 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:51.906116 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:51.906116 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:51.906116 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:42:51.906116 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:42:51.906116 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:42:51.906116 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:42:51.906116 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:42:51.906116 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:42:51.906116 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:42:51.906116 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:42:51.906116 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 37/70] 10.222.0.72 () {56 vars in 1096 bytes} [Mon Sep 19 14:42:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:42:51.906808 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9340326-626f-4d1e-ba0f-c52e7634d0a6 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:51.922203 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19317311-69f2-40f1-932b-fa1bdc138445 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:51.958034 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831d2f47-a306-47af-ac8f-d553e4fd3d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:51.958669 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d2f47-a306-47af-ac8f-d553e4fd3d52 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:51.958947 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d2f47-a306-47af-ac8f-d553e4fd3d52 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:51.959213 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d2f47-a306-47af-ac8f-d553e4fd3d52 None admin] PATH_INFO: `/v3/users/2d21d93228b342d49931ee559e5dfa9c` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:51.973936 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831d2f47-a306-47af-ac8f-d553e4fd3d52 None admin] RBAC: Authorizing `identity:get_user(user_id=2d21d93228b342d49931ee559e5dfa9c)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:51.975325 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831d2f47-a306-47af-ac8f-d553e4fd3d52 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:51.977268 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 34/71] 10.222.0.72 () {56 vars in 1177 bytes} [Mon Sep 19 14:42:51 2022] GET /identity/v3/users/2d21d93228b342d49931ee559e5dfa9c => generated 275 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:42:51.978486 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ca8e92-8a2c-4132-9c39-5b8bf2d7c15c None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:51.978768 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ca8e92-8a2c-4132-9c39-5b8bf2d7c15c None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:51.979043 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ca8e92-8a2c-4132-9c39-5b8bf2d7c15c None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:51.980641 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 35/72] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:42:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:42:51.981594 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ca8e92-8a2c-4132-9c39-5b8bf2d7c15c None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:52.017842 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9340326-626f-4d1e-ba0f-c52e7634d0a6 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:52.039057 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:52.057132 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1207246-62f6-41d9-84d3-fa97127d5d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:52.057760 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1207246-62f6-41d9-84d3-fa97127d5d95 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:52.058666 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1207246-62f6-41d9-84d3-fa97127d5d95 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:52.059159 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1207246-62f6-41d9-84d3-fa97127d5d95 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:52.069257 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1207246-62f6-41d9-84d3-fa97127d5d95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:42:52.075072 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-e1207246-62f6-41d9-84d3-fa97127d5d95 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 14:42:52.075072 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:52.075072 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:52.075072 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:52.075072 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:52.075072 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:52.075072 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:52.075072 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:52.075072 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:52.075072 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:52.075072 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:52.075072 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:52.075072 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:42:52.075072 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:42:52.075072 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:42:52.075072 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:42:52.075919 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:42:52.075919 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:42:52.075919 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:42:52.075919 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:42:52.075919 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:52.075919 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:52.075919 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:52.075919 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:52.075919 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:52.075919 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:52.075919 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:52.075919 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:52.075919 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:52.075919 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:52.075919 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:52.075919 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:52.081176 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:52.081176 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:52.081176 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:52.081176 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:52.081176 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:42:52.081176 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:42:52.081176 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:42:52.081176 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:42:52.081176 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:42:52.081176 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:42:52.081176 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 14:42:52.081176 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:42:52.081176 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 38/73] 10.222.0.72 () {56 vars in 1114 bytes} [Mon Sep 19 14:42:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:52.081176 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9696e6e-e661-4aed-b60b-d6af86e26f97 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:52.081894 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9696e6e-e661-4aed-b60b-d6af86e26f97 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:52.081894 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9696e6e-e661-4aed-b60b-d6af86e26f97 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:52.081894 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 39/74] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:42:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:42:52.081894 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9696e6e-e661-4aed-b60b-d6af86e26f97 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:52.090508 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ca8e92-8a2c-4132-9c39-5b8bf2d7c15c None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:52.098202 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:52.127465 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8952d171-fdc7-47b5-8ae1-0282471ec2db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:52.128068 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8952d171-fdc7-47b5-8ae1-0282471ec2db None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:52.128372 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8952d171-fdc7-47b5-8ae1-0282471ec2db None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:52.128662 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8952d171-fdc7-47b5-8ae1-0282471ec2db None admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:52.129312 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8952d171-fdc7-47b5-8ae1-0282471ec2db None admin] RBAC: Adding query filter params (name=admin) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:52.129613 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8952d171-fdc7-47b5-8ae1-0282471ec2db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:52.131312 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8952d171-fdc7-47b5-8ae1-0282471ec2db None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:52.142323 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 36/75] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Sep 19 14:42:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:52.148103 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7bf2cd-de88-49d9-8638-0afc16ac9aa9 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:52.148425 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7bf2cd-de88-49d9-8638-0afc16ac9aa9 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:52.148704 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7bf2cd-de88-49d9-8638-0afc16ac9aa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:52.166006 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-6f7bf2cd-de88-49d9-8638-0afc16ac9aa9 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:42:52.167229 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-6f7bf2cd-de88-49d9-8638-0afc16ac9aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:42:52.188185 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9696e6e-e661-4aed-b60b-d6af86e26f97 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:52.222012 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b97bb9-4f21-4c53-886e-6158c053b076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:52.222618 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b97bb9-4f21-4c53-886e-6158c053b076 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:52.222897 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b97bb9-4f21-4c53-886e-6158c053b076 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:52.223168 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b97bb9-4f21-4c53-886e-6158c053b076 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:52.233668 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 37/76] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:42:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:42:52.234687 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7bf2cd-de88-49d9-8638-0afc16ac9aa9 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:52.284248 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:52.312948 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b97bb9-4f21-4c53-886e-6158c053b076 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:52.314436 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b97bb9-4f21-4c53-886e-6158c053b076 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:52.329405 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:52.342121 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7bf2cd-de88-49d9-8638-0afc16ac9aa9 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:52.380355 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917a62b0-dae4-448f-8574-211d572ce44b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:52.380985 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917a62b0-dae4-448f-8574-211d572ce44b None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:52.381264 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917a62b0-dae4-448f-8574-211d572ce44b None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:52.381542 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917a62b0-dae4-448f-8574-211d572ce44b None admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:52.382291 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917a62b0-dae4-448f-8574-211d572ce44b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:52.382601 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917a62b0-dae4-448f-8574-211d572ce44b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:52.384066 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917a62b0-dae4-448f-8574-211d572ce44b None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:52.392439 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 38/77] 10.222.0.72 () {56 vars in 1111 bytes} [Mon Sep 19 14:42:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:52.398101 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f874c-ddc5-4490-8497-070f71c2a7e0 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:52.398399 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f874c-ddc5-4490-8497-070f71c2a7e0 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:52.398684 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f874c-ddc5-4490-8497-070f71c2a7e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:52.418791 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-d43f874c-ddc5-4490-8497-070f71c2a7e0 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:42:52.420145 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-d43f874c-ddc5-4490-8497-070f71c2a7e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:42:52.429486 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 40/78] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Sep 19 14:42:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 14:42:52.429486 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b97bb9-4f21-4c53-886e-6158c053b076 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:52.493651 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 39/79] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:42:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:42:52.494831 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43f874c-ddc5-4490-8497-070f71c2a7e0 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:52.549153 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b97bb9-4f21-4c53-886e-6158c053b076 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:52.556551 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:52.564937 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:52.591155 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db84abb-f3cb-4dbe-a0fe-f9aaec585167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:52.592068 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db84abb-f3cb-4dbe-a0fe-f9aaec585167 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:52.592382 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db84abb-f3cb-4dbe-a0fe-f9aaec585167 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:52.592912 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db84abb-f3cb-4dbe-a0fe-f9aaec585167 None admin] PATH_INFO: `/v3/users/2f19d59289e4450ca5e67c69c2e3b80c` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:52.594893 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db84abb-f3cb-4dbe-a0fe-f9aaec585167 None admin] RBAC: Authorizing `identity:get_user(user_id=2f19d59289e4450ca5e67c69c2e3b80c)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:52.596383 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db84abb-f3cb-4dbe-a0fe-f9aaec585167 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:52.598182 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 41/80] 10.222.0.72 () {56 vars in 1177 bytes} [Mon Sep 19 14:42:52 2022] GET /identity/v3/users/2f19d59289e4450ca5e67c69c2e3b80c => generated 247 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:52.599342 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db84abb-f3cb-4dbe-a0fe-f9aaec585167 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:52.630163 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43f874c-ddc5-4490-8497-070f71c2a7e0 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:52.671802 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b31da4-08a0-4073-84ae-bca2a6f97aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:52.673029 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b31da4-08a0-4073-84ae-bca2a6f97aee None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:52.673863 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b31da4-08a0-4073-84ae-bca2a6f97aee None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:52.674578 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b31da4-08a0-4073-84ae-bca2a6f97aee None admin] PATH_INFO: `/v3/users/2d21d93228b342d49931ee559e5dfa9c` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:52.675975 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b31da4-08a0-4073-84ae-bca2a6f97aee None admin] RBAC: Authorizing `identity:get_user(user_id=2d21d93228b342d49931ee559e5dfa9c)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:52.677668 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b31da4-08a0-4073-84ae-bca2a6f97aee None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:52.680020 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 40/81] 10.222.0.72 () {56 vars in 1177 bytes} [Mon Sep 19 14:42:52 2022] GET /identity/v3/users/2d21d93228b342d49931ee559e5dfa9c => generated 275 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:52.686208 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b31da4-08a0-4073-84ae-bca2a6f97aee None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:52.717608 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db84abb-f3cb-4dbe-a0fe-f9aaec585167 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:52.754439 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975b3310-172f-4ac7-b88e-6845b15349b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:52.755254 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975b3310-172f-4ac7-b88e-6845b15349b9 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:52.755536 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975b3310-172f-4ac7-b88e-6845b15349b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:52.755810 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975b3310-172f-4ac7-b88e-6845b15349b9 None admin] PATH_INFO: `/v3/projects/f2d0f3b33b264908b42ee8c76c5527f3` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:52.756937 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975b3310-172f-4ac7-b88e-6845b15349b9 None admin] RBAC: Authorizing `identity:get_project(project_id=f2d0f3b33b264908b42ee8c76c5527f3)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:52.759039 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975b3310-172f-4ac7-b88e-6845b15349b9 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:52.766146 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 42/82] 10.222.0.72 () {56 vars in 1186 bytes} [Mon Sep 19 14:42:52 2022] GET /identity/v3/projects/f2d0f3b33b264908b42ee8c76c5527f3 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:52.766146 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975b3310-172f-4ac7-b88e-6845b15349b9 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:52.791546 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b31da4-08a0-4073-84ae-bca2a6f97aee None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:52.799301 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:52.817673 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:52.827508 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5893db2d-c0a7-435e-8a02-5a80e7788d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:52.828145 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5893db2d-c0a7-435e-8a02-5a80e7788d3c None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:52.828466 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5893db2d-c0a7-435e-8a02-5a80e7788d3c None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:52.828744 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5893db2d-c0a7-435e-8a02-5a80e7788d3c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:52.829866 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5893db2d-c0a7-435e-8a02-5a80e7788d3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:52.831319 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5893db2d-c0a7-435e-8a02-5a80e7788d3c None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:52.832912 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 41/83] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:42:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:52.833687 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5893db2d-c0a7-435e-8a02-5a80e7788d3c None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:52.868668 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975b3310-172f-4ac7-b88e-6845b15349b9 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:52.902494 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dcd12a-de3f-4f0f-bf61-043f546279c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:52.903126 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dcd12a-de3f-4f0f-bf61-043f546279c6 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:52.903413 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dcd12a-de3f-4f0f-bf61-043f546279c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:52.903693 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dcd12a-de3f-4f0f-bf61-043f546279c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:52.936862 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5893db2d-c0a7-435e-8a02-5a80e7788d3c None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:52.970760 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81677187-4b5f-4178-b000-4dcfafd84844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:52.971283 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dcd12a-de3f-4f0f-bf61-043f546279c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:52.971384 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81677187-4b5f-4178-b000-4dcfafd84844 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:52.971626 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81677187-4b5f-4178-b000-4dcfafd84844 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:52.971898 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81677187-4b5f-4178-b000-4dcfafd84844 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:52.972811 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dcd12a-de3f-4f0f-bf61-043f546279c6 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:53.014284 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:53.021043 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:53.039779 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81677187-4b5f-4178-b000-4dcfafd84844 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:53.041275 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81677187-4b5f-4178-b000-4dcfafd84844 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:53.072055 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 43/84] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Sep 19 14:42:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 14:42:53.073107 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dcd12a-de3f-4f0f-bf61-043f546279c6 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:53.139901 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 42/85] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Sep 19 14:42:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 14:42:53.140782 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81677187-4b5f-4178-b000-4dcfafd84844 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:53.175994 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dcd12a-de3f-4f0f-bf61-043f546279c6 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:53.210110 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73d88e6-af11-493f-9b0d-77ca12c1c0db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:53.210723 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73d88e6-af11-493f-9b0d-77ca12c1c0db None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:53.211008 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73d88e6-af11-493f-9b0d-77ca12c1c0db None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:53.211289 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73d88e6-af11-493f-9b0d-77ca12c1c0db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:53.212013 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73d88e6-af11-493f-9b0d-77ca12c1c0db None admin] RBAC: Adding query filter params (role.id=efa0e5b3413748dc828a89b12d67df79, scope.project.id=f2d0f3b33b264908b42ee8c76c5527f3, user.id=2d21d93228b342d49931ee559e5dfa9c) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:53.212338 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73d88e6-af11-493f-9b0d-77ca12c1c0db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:53.212455 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:53.213980 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73d88e6-af11-493f-9b0d-77ca12c1c0db None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:53.219957 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 44/86] 10.222.0.72 () {56 vars in 1374 bytes} [Mon Sep 19 14:42:53 2022] GET /identity/v3/role_assignments?user.id=2d21d93228b342d49931ee559e5dfa9c&scope.project.id=f2d0f3b33b264908b42ee8c76c5527f3&role.id=efa0e5b3413748dc828a89b12d67df79 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:53.220759 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73d88e6-af11-493f-9b0d-77ca12c1c0db None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:53.239135 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:53.260069 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81677187-4b5f-4178-b000-4dcfafd84844 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:53.301032 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36558fa-1348-4d5f-b637-f9fdb3383f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:53.301605 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36558fa-1348-4d5f-b637-f9fdb3383f10 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:53.301900 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36558fa-1348-4d5f-b637-f9fdb3383f10 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:53.302176 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36558fa-1348-4d5f-b637-f9fdb3383f10 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:53.313904 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36558fa-1348-4d5f-b637-f9fdb3383f10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:42:53.319032 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-e36558fa-1348-4d5f-b637-f9fdb3383f10 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 14:42:53.319032 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:53.319032 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:53.319032 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:53.319032 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:53.319032 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:53.319032 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:53.319032 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:53.319032 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:53.319032 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:53.319032 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:53.319032 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:53.319032 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:42:53.319032 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:42:53.319032 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:42:53.319032 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:42:53.319903 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:42:53.319903 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:42:53.319903 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:42:53.319903 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:42:53.319903 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:53.319903 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:53.319903 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:53.319903 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:53.319903 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:53.319903 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:53.319903 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:53.319903 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:53.319903 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:53.319903 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:53.319903 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:53.319903 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:53.320695 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:53.320695 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:53.320695 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:53.320695 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:53.320695 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:42:53.320695 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:42:53.320695 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:42:53.320695 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:42:53.320695 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:42:53.320695 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:42:53.320695 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 14:42:53.320695 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:42:53.320695 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 43/87] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Sep 19 14:42:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:53.321330 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36558fa-1348-4d5f-b637-f9fdb3383f10 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:53.351252 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73d88e6-af11-493f-9b0d-77ca12c1c0db None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:53.393578 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c681decf-7e5f-4cf2-8a25-59e1bd3adaad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:53.394152 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c681decf-7e5f-4cf2-8a25-59e1bd3adaad None admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:53.394442 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c681decf-7e5f-4cf2-8a25-59e1bd3adaad None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:53.394722 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c681decf-7e5f-4cf2-8a25-59e1bd3adaad None admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:53.395561 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c681decf-7e5f-4cf2-8a25-59e1bd3adaad None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:53.397341 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c681decf-7e5f-4cf2-8a25-59e1bd3adaad None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:53.420874 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 45/88] 10.222.0.72 () {60 vars in 1132 bytes} [Mon Sep 19 14:42:53 2022] POST /identity/v3/users => generated 289 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:42:53.422042 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c681decf-7e5f-4cf2-8a25-59e1bd3adaad None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:53.439078 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36558fa-1348-4d5f-b637-f9fdb3383f10 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:53.487415 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098671dd-8e53-4dff-a448-d6de2b254014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:53.488149 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098671dd-8e53-4dff-a448-d6de2b254014 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:53.488474 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098671dd-8e53-4dff-a448-d6de2b254014 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:53.488757 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098671dd-8e53-4dff-a448-d6de2b254014 None admin] PATH_INFO: `/v3/projects/f2d0f3b33b264908b42ee8c76c5527f3` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:53.490125 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098671dd-8e53-4dff-a448-d6de2b254014 None admin] RBAC: Authorizing `identity:get_project(project_id=f2d0f3b33b264908b42ee8c76c5527f3)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:53.491955 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098671dd-8e53-4dff-a448-d6de2b254014 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:53.494490 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 44/89] 10.222.0.72 () {56 vars in 1186 bytes} [Mon Sep 19 14:42:53 2022] GET /identity/v3/projects/f2d0f3b33b264908b42ee8c76c5527f3 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:53.495363 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098671dd-8e53-4dff-a448-d6de2b254014 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:53.499048 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:53.526294 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:53.565631 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c681decf-7e5f-4cf2-8a25-59e1bd3adaad None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:53.605748 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d8c7c4-a99e-45f3-810c-e3f183570921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:53.606482 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d8c7c4-a99e-45f3-810c-e3f183570921 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:53.606771 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d8c7c4-a99e-45f3-810c-e3f183570921 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:53.607053 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d8c7c4-a99e-45f3-810c-e3f183570921 None admin] PATH_INFO: `/v3/projects/f2d0f3b33b264908b42ee8c76c5527f3` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:53.608502 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d8c7c4-a99e-45f3-810c-e3f183570921 None admin] RBAC: Authorizing `identity:get_project(project_id=f2d0f3b33b264908b42ee8c76c5527f3)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:53.609990 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d8c7c4-a99e-45f3-810c-e3f183570921 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:53.611995 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 46/90] 10.222.0.72 () {56 vars in 1186 bytes} [Mon Sep 19 14:42:53 2022] GET /identity/v3/projects/f2d0f3b33b264908b42ee8c76c5527f3 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:53.612624 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d8c7c4-a99e-45f3-810c-e3f183570921 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:53.631434 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098671dd-8e53-4dff-a448-d6de2b254014 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:53.674296 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cacf3c-3183-4184-b4f3-b9300222185d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:53.674915 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cacf3c-3183-4184-b4f3-b9300222185d None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:53.675200 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cacf3c-3183-4184-b4f3-b9300222185d None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:53.675473 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cacf3c-3183-4184-b4f3-b9300222185d None admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:53.676142 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cacf3c-3183-4184-b4f3-b9300222185d None admin] RBAC: Adding query filter params (name=member) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:53.677413 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cacf3c-3183-4184-b4f3-b9300222185d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:53.678078 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cacf3c-3183-4184-b4f3-b9300222185d None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:53.691002 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 45/91] 10.222.0.72 () {56 vars in 1101 bytes} [Mon Sep 19 14:42:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:53.691930 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cacf3c-3183-4184-b4f3-b9300222185d None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:53.740212 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d8c7c4-a99e-45f3-810c-e3f183570921 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:53.771691 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:53.789578 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fdfb07-073e-42c5-9641-04a781292960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:53.789578 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fdfb07-073e-42c5-9641-04a781292960 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:53.789863 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fdfb07-073e-42c5-9641-04a781292960 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:53.790145 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fdfb07-073e-42c5-9641-04a781292960 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:53.790891 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fdfb07-073e-42c5-9641-04a781292960 None admin] RBAC: Adding query filter params (role.id=ddb643577b2e4e478100ec370decfaeb, scope.project.id=f2d0f3b33b264908b42ee8c76c5527f3, user.id=2f19d59289e4450ca5e67c69c2e3b80c) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:53.791203 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fdfb07-073e-42c5-9641-04a781292960 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:53.793643 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fdfb07-073e-42c5-9641-04a781292960 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:53.801521 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 47/92] 10.222.0.72 () {56 vars in 1374 bytes} [Mon Sep 19 14:42:53 2022] GET /identity/v3/role_assignments?user.id=2f19d59289e4450ca5e67c69c2e3b80c&scope.project.id=f2d0f3b33b264908b42ee8c76c5527f3&role.id=ddb643577b2e4e478100ec370decfaeb => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:53.802634 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fdfb07-073e-42c5-9641-04a781292960 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:53.806023 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:53.838984 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cacf3c-3183-4184-b4f3-b9300222185d None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:53.884288 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26efadd5-a23a-4b66-89a8-e38e7d64e962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:53.885315 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26efadd5-a23a-4b66-89a8-e38e7d64e962 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:53.885937 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26efadd5-a23a-4b66-89a8-e38e7d64e962 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:53.886458 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26efadd5-a23a-4b66-89a8-e38e7d64e962 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:53.887517 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26efadd5-a23a-4b66-89a8-e38e7d64e962 None admin] RBAC: Adding query filter params (role.id=962ee04d08ae41b08c1a5108c54c7469, scope.project.id=f2d0f3b33b264908b42ee8c76c5527f3, user.id=2d21d93228b342d49931ee559e5dfa9c) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:53.888038 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26efadd5-a23a-4b66-89a8-e38e7d64e962 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:53.889754 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26efadd5-a23a-4b66-89a8-e38e7d64e962 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:53.901020 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 46/93] 10.222.0.72 () {56 vars in 1374 bytes} [Mon Sep 19 14:42:53 2022] GET /identity/v3/role_assignments?user.id=2d21d93228b342d49931ee559e5dfa9c&scope.project.id=f2d0f3b33b264908b42ee8c76c5527f3&role.id=962ee04d08ae41b08c1a5108c54c7469 => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:53.992297 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fdfb07-073e-42c5-9641-04a781292960 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:54.041070 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888a1337-2c2d-471b-87c0-5524bec82eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:54.041735 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a1337-2c2d-471b-87c0-5524bec82eda None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:54.042021 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a1337-2c2d-471b-87c0-5524bec82eda None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:54.043410 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a1337-2c2d-471b-87c0-5524bec82eda None admin] PATH_INFO: `/v3/users/2d21d93228b342d49931ee559e5dfa9c` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:54.050178 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888a1337-2c2d-471b-87c0-5524bec82eda None admin] RBAC: Authorizing `identity:get_user(user_id=2d21d93228b342d49931ee559e5dfa9c)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:54.050178 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888a1337-2c2d-471b-87c0-5524bec82eda None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:54.050178 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 48/94] 10.222.0.72 () {56 vars in 1177 bytes} [Mon Sep 19 14:42:53 2022] GET /identity/v3/users/2d21d93228b342d49931ee559e5dfa9c => generated 275 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:54.056980 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26efadd5-a23a-4b66-89a8-e38e7d64e962 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:54.204406 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26efadd5-a23a-4b66-89a8-e38e7d64e962 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:54.233641 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:54.243524 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d233dc61-d085-47d3-97e0-35839d482aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:54.244164 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d233dc61-d085-47d3-97e0-35839d482aeb None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:54.244488 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d233dc61-d085-47d3-97e0-35839d482aeb None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:54.244766 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d233dc61-d085-47d3-97e0-35839d482aeb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:54.337839 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d233dc61-d085-47d3-97e0-35839d482aeb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:54.342986 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d233dc61-d085-47d3-97e0-35839d482aeb None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:54.468538 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 47/95] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Sep 19 14:42:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 14:42:54.474278 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888a1337-2c2d-471b-87c0-5524bec82eda None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:54.581065 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:54.623370 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888a1337-2c2d-471b-87c0-5524bec82eda None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:54.673721 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8576a5-1bd1-4c85-a229-baed41f371bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:54.674372 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8576a5-1bd1-4c85-a229-baed41f371bc None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:54.674661 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8576a5-1bd1-4c85-a229-baed41f371bc None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:54.674944 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8576a5-1bd1-4c85-a229-baed41f371bc None admin] PATH_INFO: `/v3/projects/e5bc3f4c812143e2986c993cbccac024` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:54.676100 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8576a5-1bd1-4c85-a229-baed41f371bc None admin] RBAC: Authorizing `identity:get_project(project_id=e5bc3f4c812143e2986c993cbccac024)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:54.677619 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8576a5-1bd1-4c85-a229-baed41f371bc None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:54.680034 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 49/96] 10.222.0.72 () {56 vars in 1186 bytes} [Mon Sep 19 14:42:54 2022] GET /identity/v3/projects/e5bc3f4c812143e2986c993cbccac024 => generated 312 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:54.686881 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d233dc61-d085-47d3-97e0-35839d482aeb None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:54.716055 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:54.829915 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d233dc61-d085-47d3-97e0-35839d482aeb None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:54.874274 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a3baaa-37ba-4d42-b2ec-2999c3d149d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:54.874910 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a3baaa-37ba-4d42-b2ec-2999c3d149d0 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:54.875151 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a3baaa-37ba-4d42-b2ec-2999c3d149d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:54.875424 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a3baaa-37ba-4d42-b2ec-2999c3d149d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:54.876147 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a3baaa-37ba-4d42-b2ec-2999c3d149d0 None admin] RBAC: Adding query filter params (role.id=efa0e5b3413748dc828a89b12d67df79, scope.project.id=e5bc3f4c812143e2986c993cbccac024, user.id=2d21d93228b342d49931ee559e5dfa9c) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:54.876484 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a3baaa-37ba-4d42-b2ec-2999c3d149d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:54.877922 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a3baaa-37ba-4d42-b2ec-2999c3d149d0 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:54.884285 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 48/97] 10.222.0.72 () {56 vars in 1374 bytes} [Mon Sep 19 14:42:54 2022] GET /identity/v3/role_assignments?user.id=2d21d93228b342d49931ee559e5dfa9c&scope.project.id=e5bc3f4c812143e2986c993cbccac024&role.id=efa0e5b3413748dc828a89b12d67df79 => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:56.638915 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469d7bbb-0c88-4836-a1fc-bf6e30d601c5 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:56.639455 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469d7bbb-0c88-4836-a1fc-bf6e30d601c5 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:56.639455 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469d7bbb-0c88-4836-a1fc-bf6e30d601c5 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:56.641088 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 50/98] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:42:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:42:56.646711 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2339f6-07ea-42b2-b871-13a6f0bdb3d8 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:56.647648 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2339f6-07ea-42b2-b871-13a6f0bdb3d8 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:56.648143 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2339f6-07ea-42b2-b871-13a6f0bdb3d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:56.673494 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-0c2339f6-07ea-42b2-b871-13a6f0bdb3d8 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:42:56.675075 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-0c2339f6-07ea-42b2-b871-13a6f0bdb3d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:42:56.765111 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 49/99] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:42:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:42:56.785925 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e3add-288d-4683-87f3-8152092c32c5 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:56.785925 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e3add-288d-4683-87f3-8152092c32c5 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:56.785925 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e3add-288d-4683-87f3-8152092c32c5 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:56.785925 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 51/100] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:42:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:42:56.797937 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef27e992-e6c4-4917-8af2-3780b14cbe7f None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:56.798505 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef27e992-e6c4-4917-8af2-3780b14cbe7f None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:56.798969 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef27e992-e6c4-4917-8af2-3780b14cbe7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:56.810117 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8340e4a-378a-4c9d-9909-4d02be1c39d8 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:56.810665 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8340e4a-378a-4c9d-9909-4d02be1c39d8 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:56.811133 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8340e4a-378a-4c9d-9909-4d02be1c39d8 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:56.812668 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 52/101] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:42:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 14:42:56.817725 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c963a2-a6d2-49dd-b8e5-8d99ae967a43 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:56.818235 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c963a2-a6d2-49dd-b8e5-8d99ae967a43 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:56.818700 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c963a2-a6d2-49dd-b8e5-8d99ae967a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:56.860391 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-ef27e992-e6c4-4917-8af2-3780b14cbe7f None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:42:56.860391 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-ef27e992-e6c4-4917-8af2-3780b14cbe7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:42:56.861825 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-77c963a2-a6d2-49dd-b8e5-8d99ae967a43 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:42:56.863205 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-77c963a2-a6d2-49dd-b8e5-8d99ae967a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:42:56.896789 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:57.010377 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 50/102] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:42:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:42:57.046500 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 53/103] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:42:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 14:42:57.173451 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef27e992-e6c4-4917-8af2-3780b14cbe7f None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:57.332289 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef27e992-e6c4-4917-8af2-3780b14cbe7f None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:57.397773 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7870a159-952d-4623-a129-9e95a08f1c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:57.398450 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7870a159-952d-4623-a129-9e95a08f1c2b None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:57.398736 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7870a159-952d-4623-a129-9e95a08f1c2b None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:57.399008 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7870a159-952d-4623-a129-9e95a08f1c2b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:57.399342 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c963a2-a6d2-49dd-b8e5-8d99ae967a43 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:57.441047 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7870a159-952d-4623-a129-9e95a08f1c2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:42:57.450415 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-7870a159-952d-4623-a129-9e95a08f1c2b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 14:42:57.450415 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:57.450415 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:57.450415 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:57.450415 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:57.450415 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:57.450415 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:57.450415 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:57.450415 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:57.450415 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:57.450415 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:57.450415 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:57.450415 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:42:57.450415 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:42:57.450415 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:42:57.450415 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:42:57.451451 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:42:57.451451 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:42:57.451451 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:42:57.451451 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:42:57.451451 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:57.451451 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:57.451451 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:57.451451 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:57.451451 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:57.451451 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:57.451451 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:57.451451 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:57.451451 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:57.451451 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:57.451451 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:57.451451 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:57.452838 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:57.452838 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:57.452838 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:57.452838 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:57.452838 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:42:57.452838 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:42:57.452838 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:42:57.452838 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:42:57.452838 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:42:57.452838 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:42:57.452838 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 14:42:57.452838 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:42:57.452838 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 51/104] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Sep 19 14:42:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:57.456585 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7870a159-952d-4623-a129-9e95a08f1c2b None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:57.476034 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:57.552710 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:57.573348 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7870a159-952d-4623-a129-9e95a08f1c2b None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:57.619075 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c963a2-a6d2-49dd-b8e5-8d99ae967a43 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:57.620021 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deff23a9-c25e-432e-ad5c-0cf81bbf271a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:57.621512 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff23a9-c25e-432e-ad5c-0cf81bbf271a None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:57.623688 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff23a9-c25e-432e-ad5c-0cf81bbf271a None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:57.624172 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff23a9-c25e-432e-ad5c-0cf81bbf271a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:57.648455 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deff23a9-c25e-432e-ad5c-0cf81bbf271a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:42:57.659290 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-deff23a9-c25e-432e-ad5c-0cf81bbf271a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 14:42:57.659290 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:57.659290 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:57.659290 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:57.659290 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:57.659290 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:57.659290 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:57.659290 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:57.659290 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:57.659290 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:57.659290 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:57.659290 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:57.659290 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:42:57.659290 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:42:57.659290 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:42:57.659290 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:42:57.660190 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:42:57.660190 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:42:57.660190 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:42:57.660190 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:42:57.660190 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:57.660190 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:57.660190 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:57.660190 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:57.660190 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:57.660190 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:57.660190 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:57.660190 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:57.660190 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:57.660190 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:57.660190 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:57.660190 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:57.660979 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:57.660979 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:57.660979 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:57.660979 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:57.660979 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:42:57.660979 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:42:57.660979 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:42:57.660979 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:42:57.660979 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:42:57.660979 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:42:57.660979 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 14:42:57.660979 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:42:57.664529 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 52/105] 10.222.0.72 () {56 vars in 1114 bytes} [Mon Sep 19 14:42:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:57.669581 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deff23a9-c25e-432e-ad5c-0cf81bbf271a None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:57.703600 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c524c8c7-cb87-4397-a064-5961ecf95120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:57.704972 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c524c8c7-cb87-4397-a064-5961ecf95120 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:57.705451 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c524c8c7-cb87-4397-a064-5961ecf95120 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:57.705918 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c524c8c7-cb87-4397-a064-5961ecf95120 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:57.718598 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c524c8c7-cb87-4397-a064-5961ecf95120 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:42:57.726181 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-c524c8c7-cb87-4397-a064-5961ecf95120 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 14:42:57.726181 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:57.726181 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:57.726181 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:57.726181 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:57.726181 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:57.726181 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:57.726181 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:57.726181 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:57.726181 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:57.726181 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:57.726181 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:57.726181 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:42:57.726181 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:42:57.726181 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:42:57.726181 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:42:57.727023 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:42:57.727023 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:42:57.727023 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:42:57.727023 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:42:57.727023 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:57.727023 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:57.727023 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:57.727023 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:57.727023 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:57.727023 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:57.727023 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:57.727023 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:57.727023 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:57.727023 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:57.727023 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:57.727023 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:57.727812 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:57.727812 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:57.727812 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:57.727812 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:57.727812 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:42:57.727812 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:42:57.727812 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:42:57.727812 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:42:57.727812 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:42:57.727812 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:42:57.727812 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 14:42:57.727812 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:42:57.731140 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 54/106] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Sep 19 14:42:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:57.732920 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c524c8c7-cb87-4397-a064-5961ecf95120 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:57.778551 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:57.814454 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deff23a9-c25e-432e-ad5c-0cf81bbf271a None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:57.848896 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c524c8c7-cb87-4397-a064-5961ecf95120 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:57.851170 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1277e6aa-729b-459d-a9b5-ff5ad17fe064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:57.851797 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1277e6aa-729b-459d-a9b5-ff5ad17fe064 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:57.852081 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1277e6aa-729b-459d-a9b5-ff5ad17fe064 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:57.852386 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1277e6aa-729b-459d-a9b5-ff5ad17fe064 None admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:57.853060 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1277e6aa-729b-459d-a9b5-ff5ad17fe064 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:57.853367 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1277e6aa-729b-459d-a9b5-ff5ad17fe064 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:57.854757 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1277e6aa-729b-459d-a9b5-ff5ad17fe064 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:57.864668 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 53/107] 10.222.0.72 () {56 vars in 1101 bytes} [Mon Sep 19 14:42:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:57.870303 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cdea75-db1a-4808-a9fc-bb7fd0d8f30c None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:57.870662 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cdea75-db1a-4808-a9fc-bb7fd0d8f30c None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:57.871453 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cdea75-db1a-4808-a9fc-bb7fd0d8f30c None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:57.872854 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 54/108] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:42:57 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:42:57.877724 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cdea75-db1a-4808-a9fc-bb7fd0d8f30c None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:57.879058 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:57.887811 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b7dae0-7bdd-480c-a1e7-07f286e2902f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:57.888703 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b7dae0-7bdd-480c-a1e7-07f286e2902f None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:57.889150 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b7dae0-7bdd-480c-a1e7-07f286e2902f None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:57.889630 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b7dae0-7bdd-480c-a1e7-07f286e2902f None admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:57.890456 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b7dae0-7bdd-480c-a1e7-07f286e2902f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:57.890968 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b7dae0-7bdd-480c-a1e7-07f286e2902f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:57.892554 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b7dae0-7bdd-480c-a1e7-07f286e2902f None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:57.901501 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 55/109] 10.222.0.72 () {56 vars in 1111 bytes} [Mon Sep 19 14:42:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:57.903349 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303af038-efb2-4f63-8c8d-36c18c1d8d71 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:57.903635 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303af038-efb2-4f63-8c8d-36c18c1d8d71 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:57.903906 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303af038-efb2-4f63-8c8d-36c18c1d8d71 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:57.905166 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 56/110] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:42:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:42:57.909431 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303af038-efb2-4f63-8c8d-36c18c1d8d71 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:58.002050 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cdea75-db1a-4808-a9fc-bb7fd0d8f30c None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:58.016425 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303af038-efb2-4f63-8c8d-36c18c1d8d71 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:58.041109 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbfcf95-cf8e-4f9c-8d88-40424c85d9fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:58.041868 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbfcf95-cf8e-4f9c-8d88-40424c85d9fa None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:58.042241 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbfcf95-cf8e-4f9c-8d88-40424c85d9fa None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:58.042669 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbfcf95-cf8e-4f9c-8d88-40424c85d9fa None admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:58.043702 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbfcf95-cf8e-4f9c-8d88-40424c85d9fa None admin] RBAC: Adding query filter params (name=member) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:58.044010 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbfcf95-cf8e-4f9c-8d88-40424c85d9fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:58.045440 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbfcf95-cf8e-4f9c-8d88-40424c85d9fa None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:58.046903 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:58.055362 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 55/111] 10.222.0.72 () {56 vars in 1101 bytes} [Mon Sep 19 14:42:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:58.056696 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381784b2-7cec-4115-bdad-3e055ea962cd None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:58.056981 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381784b2-7cec-4115-bdad-3e055ea962cd None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:58.057256 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381784b2-7cec-4115-bdad-3e055ea962cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:58.057672 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd68603-9860-4edc-bd83-30917182161b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:58.058865 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd68603-9860-4edc-bd83-30917182161b None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:58.059150 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd68603-9860-4edc-bd83-30917182161b None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:58.059428 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd68603-9860-4edc-bd83-30917182161b None admin] PATH_INFO: `/v3/users/db1fbe7fb6434d6581e75c1b73484d3e` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:58.075438 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd68603-9860-4edc-bd83-30917182161b None admin] RBAC: Authorizing `identity:get_user(user_id=db1fbe7fb6434d6581e75c1b73484d3e)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:58.077061 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd68603-9860-4edc-bd83-30917182161b None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:58.078019 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-381784b2-7cec-4115-bdad-3e055ea962cd None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:42:58.078815 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 57/112] 10.222.0.72 () {56 vars in 1177 bytes} [Mon Sep 19 14:42:57 2022] GET /identity/v3/users/db1fbe7fb6434d6581e75c1b73484d3e => generated 289 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:58.079577 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-381784b2-7cec-4115-bdad-3e055ea962cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:42:58.083997 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd68603-9860-4edc-bd83-30917182161b None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:58.136067 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:58.152100 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 56/113] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:42:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:42:58.157822 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a12ff11-89bd-4d43-a767-28ac8a7f5103 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:58.158847 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a12ff11-89bd-4d43-a767-28ac8a7f5103 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:58.159160 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a12ff11-89bd-4d43-a767-28ac8a7f5103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:58.179169 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-8a12ff11-89bd-4d43-a767-28ac8a7f5103 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:42:58.180633 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-8a12ff11-89bd-4d43-a767-28ac8a7f5103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:42:58.188108 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd68603-9860-4edc-bd83-30917182161b None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:58.222901 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59662bd-56a6-4970-bcc7-5b1d8eafc940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:58.223539 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59662bd-56a6-4970-bcc7-5b1d8eafc940 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:58.223834 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59662bd-56a6-4970-bcc7-5b1d8eafc940 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:58.224108 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59662bd-56a6-4970-bcc7-5b1d8eafc940 None admin] PATH_INFO: `/v3/users/2d21d93228b342d49931ee559e5dfa9c` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:58.225273 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59662bd-56a6-4970-bcc7-5b1d8eafc940 None admin] RBAC: Authorizing `identity:get_user(user_id=2d21d93228b342d49931ee559e5dfa9c)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:58.226741 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59662bd-56a6-4970-bcc7-5b1d8eafc940 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:58.228533 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 58/114] 10.222.0.72 () {56 vars in 1177 bytes} [Mon Sep 19 14:42:58 2022] GET /identity/v3/users/2d21d93228b342d49931ee559e5dfa9c => generated 275 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:58.229194 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59662bd-56a6-4970-bcc7-5b1d8eafc940 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:58.259705 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 57/115] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:42:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:42:58.260647 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a12ff11-89bd-4d43-a767-28ac8a7f5103 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:58.320257 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:58.366562 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59662bd-56a6-4970-bcc7-5b1d8eafc940 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:58.379571 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a12ff11-89bd-4d43-a767-28ac8a7f5103 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:58.385300 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:58.406593 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36279c52-b9c2-4c75-a661-dacb0ed03226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:58.407372 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36279c52-b9c2-4c75-a661-dacb0ed03226 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:58.407761 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36279c52-b9c2-4c75-a661-dacb0ed03226 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:58.408139 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36279c52-b9c2-4c75-a661-dacb0ed03226 None admin] PATH_INFO: `/v3/users/2d21d93228b342d49931ee559e5dfa9c` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:58.409849 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36279c52-b9c2-4c75-a661-dacb0ed03226 None admin] RBAC: Authorizing `identity:get_user(user_id=2d21d93228b342d49931ee559e5dfa9c)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:58.411959 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36279c52-b9c2-4c75-a661-dacb0ed03226 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:58.414476 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 59/116] 10.222.0.72 () {56 vars in 1177 bytes} [Mon Sep 19 14:42:58 2022] GET /identity/v3/users/2d21d93228b342d49931ee559e5dfa9c => generated 275 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:58.415858 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e02a8-4034-417d-bac0-f92dc9117806 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:58.422768 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e02a8-4034-417d-bac0-f92dc9117806 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:58.422768 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e02a8-4034-417d-bac0-f92dc9117806 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:58.422768 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 60/117] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:42:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:42:58.422768 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47e02a8-4034-417d-bac0-f92dc9117806 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:58.439495 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b99ec3-5a5b-412d-992c-087ea90013cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:58.440248 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b99ec3-5a5b-412d-992c-087ea90013cc None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:58.440583 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b99ec3-5a5b-412d-992c-087ea90013cc None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:58.440866 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b99ec3-5a5b-412d-992c-087ea90013cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:58.512691 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b99ec3-5a5b-412d-992c-087ea90013cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:58.514451 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b99ec3-5a5b-412d-992c-087ea90013cc None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:58.536289 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47e02a8-4034-417d-bac0-f92dc9117806 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:58.569627 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:58.570248 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7a68c3-e14e-4e98-a276-3e253a6dc725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:58.570955 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7a68c3-e14e-4e98-a276-3e253a6dc725 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:58.571302 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7a68c3-e14e-4e98-a276-3e253a6dc725 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:58.571671 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7a68c3-e14e-4e98-a276-3e253a6dc725 None admin] PATH_INFO: `/v3/projects/f2d0f3b33b264908b42ee8c76c5527f3` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:58.572776 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7a68c3-e14e-4e98-a276-3e253a6dc725 None admin] RBAC: Authorizing `identity:get_project(project_id=f2d0f3b33b264908b42ee8c76c5527f3)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:58.575172 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7a68c3-e14e-4e98-a276-3e253a6dc725 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:58.576832 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 61/118] 10.222.0.72 () {56 vars in 1186 bytes} [Mon Sep 19 14:42:58 2022] GET /identity/v3/projects/f2d0f3b33b264908b42ee8c76c5527f3 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:58.576832 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7a68c3-e14e-4e98-a276-3e253a6dc725 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:58.622054 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 58/119] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Sep 19 14:42:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 14:42:58.623310 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba39d7b-cdc7-493b-b5c5-1658564d28b7 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:58.623600 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba39d7b-cdc7-493b-b5c5-1658564d28b7 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:58.623874 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba39d7b-cdc7-493b-b5c5-1658564d28b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:58.635529 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:58.642425 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-4ba39d7b-cdc7-493b-b5c5-1658564d28b7 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:42:58.643618 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-4ba39d7b-cdc7-493b-b5c5-1658564d28b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:42:58.684014 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7a68c3-e14e-4e98-a276-3e253a6dc725 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:58.709827 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 59/120] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:42:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:42:58.710678 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba39d7b-cdc7-493b-b5c5-1658564d28b7 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:58.724410 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9813e81-1c2d-4cad-93a6-4a2a3f992978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:58.725052 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9813e81-1c2d-4cad-93a6-4a2a3f992978 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:58.725337 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9813e81-1c2d-4cad-93a6-4a2a3f992978 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:58.725616 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9813e81-1c2d-4cad-93a6-4a2a3f992978 None admin] PATH_INFO: `/v3/projects/f2d0f3b33b264908b42ee8c76c5527f3` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:58.726736 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9813e81-1c2d-4cad-93a6-4a2a3f992978 None admin] RBAC: Authorizing `identity:get_project(project_id=f2d0f3b33b264908b42ee8c76c5527f3)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:58.728198 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9813e81-1c2d-4cad-93a6-4a2a3f992978 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:58.734478 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 62/121] 10.222.0.72 () {56 vars in 1186 bytes} [Mon Sep 19 14:42:58 2022] GET /identity/v3/projects/f2d0f3b33b264908b42ee8c76c5527f3 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:58.734478 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9813e81-1c2d-4cad-93a6-4a2a3f992978 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:58.805585 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:58.822943 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba39d7b-cdc7-493b-b5c5-1658564d28b7 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:58.829755 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9813e81-1c2d-4cad-93a6-4a2a3f992978 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:58.849624 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:58.860592 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdb2a2a-5cb2-446f-9ed0-ebab8ffe1ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:58.861227 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdb2a2a-5cb2-446f-9ed0-ebab8ffe1ed7 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:58.861568 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdb2a2a-5cb2-446f-9ed0-ebab8ffe1ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:58.861840 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdb2a2a-5cb2-446f-9ed0-ebab8ffe1ed7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:58.862981 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdb2a2a-5cb2-446f-9ed0-ebab8ffe1ed7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:58.864578 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdb2a2a-5cb2-446f-9ed0-ebab8ffe1ed7 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:58.864877 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862472e9-347a-4d52-af19-b07c94de7b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:58.865512 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862472e9-347a-4d52-af19-b07c94de7b74 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:58.865797 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862472e9-347a-4d52-af19-b07c94de7b74 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:58.866349 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862472e9-347a-4d52-af19-b07c94de7b74 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:58.866454 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 60/122] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:42:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:58.866872 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdb2a2a-5cb2-446f-9ed0-ebab8ffe1ed7 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:58.877847 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862472e9-347a-4d52-af19-b07c94de7b74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:42:58.882803 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-862472e9-347a-4d52-af19-b07c94de7b74 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:42:58.882803 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:58.882803 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:58.882803 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:58.882803 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:58.882803 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:58.882803 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:58.882803 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:58.882803 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:58.882803 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:58.882803 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:58.882803 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:58.882803 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:42:58.882803 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:42:58.882803 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:42:58.882803 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:42:58.883819 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:42:58.883819 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:42:58.883819 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:42:58.883819 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:42:58.883819 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:58.883819 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:58.883819 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:58.883819 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:58.883819 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:58.883819 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:58.883819 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:58.883819 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:58.883819 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:58.883819 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:58.883819 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:58.883819 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:58.884605 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:58.884605 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:58.884605 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:58.884605 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:58.884605 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:42:58.884605 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:42:58.884605 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:42:58.884605 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:42:58.884605 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:42:58.884605 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:42:58.884605 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:42:58.884605 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:42:58.884605 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 63/123] 10.222.0.72 () {56 vars in 1096 bytes} [Mon Sep 19 14:42:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:58.885218 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862472e9-347a-4d52-af19-b07c94de7b74 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:58.984962 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdb2a2a-5cb2-446f-9ed0-ebab8ffe1ed7 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:58.990110 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862472e9-347a-4d52-af19-b07c94de7b74 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:59.018156 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f27ac9a-472d-400d-9fa5-b8ba33b15ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:59.018806 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f27ac9a-472d-400d-9fa5-b8ba33b15ac7 None admin] REQUEST_METHOD: `PUT` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:59.019091 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f27ac9a-472d-400d-9fa5-b8ba33b15ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:59.019361 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f27ac9a-472d-400d-9fa5-b8ba33b15ac7 None admin] PATH_INFO: `/v3/projects/f2d0f3b33b264908b42ee8c76c5527f3/users/2d21d93228b342d49931ee559e5dfa9c/roles/962ee04d08ae41b08c1a5108c54c7469` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:59.021502 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f27ac9a-472d-400d-9fa5-b8ba33b15ac7 None admin] RBAC: Authorizing `identity:create_grant(project_id=f2d0f3b33b264908b42ee8c76c5527f3, user_id=2d21d93228b342d49931ee559e5dfa9c, role_id=962ee04d08ae41b08c1a5108c54c7469)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:59.022939 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f27ac9a-472d-400d-9fa5-b8ba33b15ac7 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:59.024629 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae3bb83-df15-4b59-b106-d9ffee500cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:59.025436 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae3bb83-df15-4b59-b106-d9ffee500cc5 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:59.026083 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae3bb83-df15-4b59-b106-d9ffee500cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:59.026376 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae3bb83-df15-4b59-b106-d9ffee500cc5 None admin] PATH_INFO: `/v3/projects/f2d0f3b33b264908b42ee8c76c5527f3` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:59.027727 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae3bb83-df15-4b59-b106-d9ffee500cc5 None admin] RBAC: Authorizing `identity:get_project(project_id=f2d0f3b33b264908b42ee8c76c5527f3)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:59.029394 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae3bb83-df15-4b59-b106-d9ffee500cc5 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:59.036048 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 64/124] 10.222.0.72 () {56 vars in 1186 bytes} [Mon Sep 19 14:42:58 2022] GET /identity/v3/projects/f2d0f3b33b264908b42ee8c76c5527f3 => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:59.036048 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae3bb83-df15-4b59-b106-d9ffee500cc5 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:59.036737 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 61/125] 10.222.0.72 () {58 vars in 1439 bytes} [Mon Sep 19 14:42:58 2022] PUT /identity/v3/projects/f2d0f3b33b264908b42ee8c76c5527f3/users/2d21d93228b342d49931ee559e5dfa9c/roles/962ee04d08ae41b08c1a5108c54c7469 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:42:59.037535 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f27ac9a-472d-400d-9fa5-b8ba33b15ac7 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:59.057067 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:59.090276 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:59.146602 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae3bb83-df15-4b59-b106-d9ffee500cc5 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:59.155576 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f27ac9a-472d-400d-9fa5-b8ba33b15ac7 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:59.185182 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83de834-1799-4c0d-a7d5-656291f6c53d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:59.185947 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83de834-1799-4c0d-a7d5-656291f6c53d None admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:59.186229 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83de834-1799-4c0d-a7d5-656291f6c53d None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:59.186506 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83de834-1799-4c0d-a7d5-656291f6c53d None admin] PATH_INFO: `/v3/projects/f2d0f3b33b264908b42ee8c76c5527f3/users/2d21d93228b342d49931ee559e5dfa9c/roles/efa0e5b3413748dc828a89b12d67df79` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:59.188798 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83de834-1799-4c0d-a7d5-656291f6c53d None admin] RBAC: Authorizing `identity:create_grant(project_id=f2d0f3b33b264908b42ee8c76c5527f3, user_id=2d21d93228b342d49931ee559e5dfa9c, role_id=efa0e5b3413748dc828a89b12d67df79)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:59.190270 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83de834-1799-4c0d-a7d5-656291f6c53d None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:59.198819 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268b5b02-6803-4c57-87fd-8235310b760b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:59.199518 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b5b02-6803-4c57-87fd-8235310b760b None admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:59.199806 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b5b02-6803-4c57-87fd-8235310b760b None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:59.200086 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b5b02-6803-4c57-87fd-8235310b760b None admin] PATH_INFO: `/v3/projects` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:59.200795 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268b5b02-6803-4c57-87fd-8235310b760b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:59.202261 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268b5b02-6803-4c57-87fd-8235310b760b None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:59.207886 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 65/126] 10.222.0.72 () {58 vars in 1439 bytes} [Mon Sep 19 14:42:59 2022] PUT /identity/v3/projects/f2d0f3b33b264908b42ee8c76c5527f3/users/2d21d93228b342d49931ee559e5dfa9c/roles/efa0e5b3413748dc828a89b12d67df79 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:42:59.209069 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83de834-1799-4c0d-a7d5-656291f6c53d None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:59.240196 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 62/127] 10.222.0.72 () {60 vars in 1141 bytes} [Mon Sep 19 14:42:59 2022] POST /identity/v3/projects => generated 302 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:42:59.241557 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268b5b02-6803-4c57-87fd-8235310b760b None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:59.377714 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:59.407478 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83de834-1799-4c0d-a7d5-656291f6c53d None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:59.413717 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268b5b02-6803-4c57-87fd-8235310b760b None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:59.433298 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:59.454224 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881f26b2-377e-4a22-9a15-17a365820358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:59.454882 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f26b2-377e-4a22-9a15-17a365820358 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:59.455167 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f26b2-377e-4a22-9a15-17a365820358 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:59.455445 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f26b2-377e-4a22-9a15-17a365820358 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:59.475088 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0133cd-9ee9-4d1e-83db-947e5302a6c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:59.475858 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0133cd-9ee9-4d1e-83db-947e5302a6c1 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:59.476296 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0133cd-9ee9-4d1e-83db-947e5302a6c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:59.476621 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0133cd-9ee9-4d1e-83db-947e5302a6c1 None admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:59.477307 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0133cd-9ee9-4d1e-83db-947e5302a6c1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:59.477623 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0133cd-9ee9-4d1e-83db-947e5302a6c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:59.477776 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881f26b2-377e-4a22-9a15-17a365820358 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:42:59.479040 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0133cd-9ee9-4d1e-83db-947e5302a6c1 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:59.483965 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-881f26b2-377e-4a22-9a15-17a365820358 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 14:42:59.483965 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:59.483965 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:59.483965 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:59.483965 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:59.483965 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:59.483965 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:59.483965 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:59.483965 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:59.483965 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:59.483965 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:59.483965 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:59.483965 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:42:59.483965 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:42:59.483965 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:42:59.483965 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:42:59.484891 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:42:59.484891 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:42:59.484891 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:42:59.484891 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:42:59.484891 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:59.484891 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:59.484891 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:59.484891 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:59.484891 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:59.484891 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:59.484891 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:59.484891 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:59.484891 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:59.484891 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:59.484891 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:59.484891 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:59.485633 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:59.485633 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:59.485633 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:59.485633 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:59.485633 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:42:59.485633 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:42:59.485633 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:42:59.485633 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:42:59.485633 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:42:59.485633 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:42:59.485633 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 14:42:59.485633 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:42:59.487379 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 63/128] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Sep 19 14:42:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:59.488209 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881f26b2-377e-4a22-9a15-17a365820358 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:59.489901 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 66/129] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Sep 19 14:42:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:59.494495 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0133cd-9ee9-4d1e-83db-947e5302a6c1 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:59.611618 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881f26b2-377e-4a22-9a15-17a365820358 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:59.629386 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0133cd-9ee9-4d1e-83db-947e5302a6c1 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:59.654476 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:59.666355 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59971d5-3222-4035-bf0f-b527c606e41a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:59.667426 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59971d5-3222-4035-bf0f-b527c606e41a None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:59.667725 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59971d5-3222-4035-bf0f-b527c606e41a None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:59.668359 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59971d5-3222-4035-bf0f-b527c606e41a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:59.669139 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59971d5-3222-4035-bf0f-b527c606e41a None admin] RBAC: Adding query filter params (role.id=dc1fc2b7f53a4f1084d0ecf5473f9dce, scope.project.id=f2d0f3b33b264908b42ee8c76c5527f3, user.id=db1fbe7fb6434d6581e75c1b73484d3e) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:59.669454 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59971d5-3222-4035-bf0f-b527c606e41a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:59.670925 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59971d5-3222-4035-bf0f-b527c606e41a None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:59.671841 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a548639d-f551-48af-a86a-30365308403e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:59.672486 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a548639d-f551-48af-a86a-30365308403e None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:59.672773 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a548639d-f551-48af-a86a-30365308403e None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:59.673046 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a548639d-f551-48af-a86a-30365308403e None admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:59.673710 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a548639d-f551-48af-a86a-30365308403e None admin] RBAC: Adding query filter params (name=member) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:59.674012 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a548639d-f551-48af-a86a-30365308403e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:59.675711 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a548639d-f551-48af-a86a-30365308403e None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:59.678724 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 64/130] 10.222.0.72 () {56 vars in 1374 bytes} [Mon Sep 19 14:42:59 2022] GET /identity/v3/role_assignments?user.id=db1fbe7fb6434d6581e75c1b73484d3e&scope.project.id=f2d0f3b33b264908b42ee8c76c5527f3&role.id=dc1fc2b7f53a4f1084d0ecf5473f9dce => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:59.680025 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59971d5-3222-4035-bf0f-b527c606e41a None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:59.688387 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 67/131] 10.222.0.72 () {56 vars in 1101 bytes} [Mon Sep 19 14:42:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:42:59.692623 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a548639d-f551-48af-a86a-30365308403e None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:59.748943 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:59.903011 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a548639d-f551-48af-a86a-30365308403e None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:59.972320 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59971d5-3222-4035-bf0f-b527c606e41a None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:59.985057 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeaa228-3868-424c-9cfa-55b38bc08d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:59.985717 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeaa228-3868-424c-9cfa-55b38bc08d1a None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:59.986007 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeaa228-3868-424c-9cfa-55b38bc08d1a None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:59.986286 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeaa228-3868-424c-9cfa-55b38bc08d1a None admin] PATH_INFO: `/v3/users/2d21d93228b342d49931ee559e5dfa9c` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:59.987488 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeaa228-3868-424c-9cfa-55b38bc08d1a None admin] RBAC: Authorizing `identity:get_user(user_id=2d21d93228b342d49931ee559e5dfa9c)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:59.988994 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeaa228-3868-424c-9cfa-55b38bc08d1a None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:59.990892 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 68/132] 10.222.0.72 () {56 vars in 1177 bytes} [Mon Sep 19 14:42:59 2022] GET /identity/v3/users/2d21d93228b342d49931ee559e5dfa9c => generated 275 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:42:59.996727 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeaa228-3868-424c-9cfa-55b38bc08d1a None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:00.030448 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a434b28-7424-4c1c-bdf3-ed5e5f668e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:00.031472 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a434b28-7424-4c1c-bdf3-ed5e5f668e5f None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:00.031958 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a434b28-7424-4c1c-bdf3-ed5e5f668e5f None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:00.032586 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a434b28-7424-4c1c-bdf3-ed5e5f668e5f None admin] PATH_INFO: `/v3/users/2f19d59289e4450ca5e67c69c2e3b80c` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:00.034096 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a434b28-7424-4c1c-bdf3-ed5e5f668e5f None admin] RBAC: Authorizing `identity:get_user(user_id=2f19d59289e4450ca5e67c69c2e3b80c)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:00.035752 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a434b28-7424-4c1c-bdf3-ed5e5f668e5f None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:00.037585 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 65/133] 10.222.0.72 () {56 vars in 1177 bytes} [Mon Sep 19 14:42:59 2022] GET /identity/v3/users/2f19d59289e4450ca5e67c69c2e3b80c => generated 247 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:00.043627 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a434b28-7424-4c1c-bdf3-ed5e5f668e5f None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:00.144702 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:00.222655 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:00.227373 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a434b28-7424-4c1c-bdf3-ed5e5f668e5f None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:00.234281 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeaa228-3868-424c-9cfa-55b38bc08d1a None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:00.299332 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1a45b7-4d6c-433b-8a5a-b3ed75bd39b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:00.300362 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1a45b7-4d6c-433b-8a5a-b3ed75bd39b8 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:00.300659 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1a45b7-4d6c-433b-8a5a-b3ed75bd39b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:00.300939 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1a45b7-4d6c-433b-8a5a-b3ed75bd39b8 None admin] PATH_INFO: `/v3/projects/f2d0f3b33b264908b42ee8c76c5527f3` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:00.302142 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1a45b7-4d6c-433b-8a5a-b3ed75bd39b8 None admin] RBAC: Authorizing `identity:get_project(project_id=f2d0f3b33b264908b42ee8c76c5527f3)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:00.303756 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1a45b7-4d6c-433b-8a5a-b3ed75bd39b8 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:00.306395 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 66/134] 10.222.0.72 () {56 vars in 1186 bytes} [Mon Sep 19 14:43:00 2022] GET /identity/v3/projects/f2d0f3b33b264908b42ee8c76c5527f3 => generated 298 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:00.312191 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1a45b7-4d6c-433b-8a5a-b3ed75bd39b8 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:00.333602 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a659c504-2cc8-4b36-837d-a4a98f4882ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:00.334601 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a659c504-2cc8-4b36-837d-a4a98f4882ae None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:00.335083 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a659c504-2cc8-4b36-837d-a4a98f4882ae None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:00.335581 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a659c504-2cc8-4b36-837d-a4a98f4882ae None admin] PATH_INFO: `/v3/projects/e5bc3f4c812143e2986c993cbccac024` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:00.341051 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a659c504-2cc8-4b36-837d-a4a98f4882ae None admin] RBAC: Authorizing `identity:get_project(project_id=e5bc3f4c812143e2986c993cbccac024)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:00.342735 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a659c504-2cc8-4b36-837d-a4a98f4882ae None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:00.344945 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 69/135] 10.222.0.72 () {56 vars in 1186 bytes} [Mon Sep 19 14:42:59 2022] GET /identity/v3/projects/e5bc3f4c812143e2986c993cbccac024 => generated 312 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:00.350479 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a659c504-2cc8-4b36-837d-a4a98f4882ae None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:00.526862 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1a45b7-4d6c-433b-8a5a-b3ed75bd39b8 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:00.569857 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a659c504-2cc8-4b36-837d-a4a98f4882ae None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:00.585853 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:00.600715 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecffef27-f68d-45b7-9efe-4862bd38b109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:00.601393 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecffef27-f68d-45b7-9efe-4862bd38b109 None admin] REQUEST_METHOD: `PUT` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:00.601677 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecffef27-f68d-45b7-9efe-4862bd38b109 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:00.601955 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecffef27-f68d-45b7-9efe-4862bd38b109 None admin] PATH_INFO: `/v3/projects/f2d0f3b33b264908b42ee8c76c5527f3/users/2f19d59289e4450ca5e67c69c2e3b80c/roles/ddb643577b2e4e478100ec370decfaeb` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:00.612445 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecffef27-f68d-45b7-9efe-4862bd38b109 None admin] RBAC: Authorizing `identity:create_grant(project_id=f2d0f3b33b264908b42ee8c76c5527f3, user_id=2f19d59289e4450ca5e67c69c2e3b80c, role_id=ddb643577b2e4e478100ec370decfaeb)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:00.613965 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecffef27-f68d-45b7-9efe-4862bd38b109 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:00.646397 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 67/136] 10.222.0.72 () {58 vars in 1439 bytes} [Mon Sep 19 14:43:00 2022] PUT /identity/v3/projects/f2d0f3b33b264908b42ee8c76c5527f3/users/2f19d59289e4450ca5e67c69c2e3b80c/roles/ddb643577b2e4e478100ec370decfaeb => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 14:43:00.661852 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fe0a89-b298-40fe-8c9b-7f53ef12c34b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:00.662626 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fe0a89-b298-40fe-8c9b-7f53ef12c34b None admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:00.662910 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fe0a89-b298-40fe-8c9b-7f53ef12c34b None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:00.663185 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fe0a89-b298-40fe-8c9b-7f53ef12c34b None admin] PATH_INFO: `/v3/projects/e5bc3f4c812143e2986c993cbccac024/users/2d21d93228b342d49931ee559e5dfa9c/roles/efa0e5b3413748dc828a89b12d67df79` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:00.665303 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fe0a89-b298-40fe-8c9b-7f53ef12c34b None admin] RBAC: Authorizing `identity:create_grant(project_id=e5bc3f4c812143e2986c993cbccac024, user_id=2d21d93228b342d49931ee559e5dfa9c, role_id=efa0e5b3413748dc828a89b12d67df79)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:00.666863 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fe0a89-b298-40fe-8c9b-7f53ef12c34b None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:00.684922 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 70/137] 10.222.0.72 () {58 vars in 1439 bytes} [Mon Sep 19 14:43:00 2022] PUT /identity/v3/projects/e5bc3f4c812143e2986c993cbccac024/users/2d21d93228b342d49931ee559e5dfa9c/roles/efa0e5b3413748dc828a89b12d67df79 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 14:43:01.885785 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd9f4a4-b79a-4fb4-930c-8ed567b4d6be None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:01.886930 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd9f4a4-b79a-4fb4-930c-8ed567b4d6be None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:01.886930 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd9f4a4-b79a-4fb4-930c-8ed567b4d6be None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:01.888530 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 68/138] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:43:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:43:01.894261 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f8c699-347c-4298-ae84-bd0593ae52da None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:01.894690 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f8c699-347c-4298-ae84-bd0593ae52da None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:01.894863 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f8c699-347c-4298-ae84-bd0593ae52da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:01.924616 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-80f8c699-347c-4298-ae84-bd0593ae52da None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:43:01.926121 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-80f8c699-347c-4298-ae84-bd0593ae52da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:43:01.959844 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:02.018722 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 71/139] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:43:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 14:43:02.434577 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b475d6-8b49-4696-a904-e1d6374f4ce8 None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:02.435306 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b475d6-8b49-4696-a904-e1d6374f4ce8 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:02.435794 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b475d6-8b49-4696-a904-e1d6374f4ce8 None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:02.437649 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 69/140] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:43:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:43:02.442622 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eaa7c3-bcd1-49f9-abe4-697deec1313b None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:02.443152 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eaa7c3-bcd1-49f9-abe4-697deec1313b None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:02.443635 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eaa7c3-bcd1-49f9-abe4-697deec1313b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:02.468543 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-37eaa7c3-bcd1-49f9-abe4-697deec1313b None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:43:02.470042 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-37eaa7c3-bcd1-49f9-abe4-697deec1313b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:43:02.498825 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96df7e1-2519-4825-8d63-0d636459da49 None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:02.499130 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96df7e1-2519-4825-8d63-0d636459da49 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:02.499393 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96df7e1-2519-4825-8d63-0d636459da49 None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:02.500757 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 70/141] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:43:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 14:43:02.505718 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903220ae-0492-46a8-bd01-98448bab6963 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:02.505986 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903220ae-0492-46a8-bd01-98448bab6963 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:02.506276 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903220ae-0492-46a8-bd01-98448bab6963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:02.526975 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-903220ae-0492-46a8-bd01-98448bab6963 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:43:02.528516 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-903220ae-0492-46a8-bd01-98448bab6963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:43:02.572395 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 72/142] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:43:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:43:02.572395 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eaa7c3-bcd1-49f9-abe4-697deec1313b None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:02.653835 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 71/143] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:43:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 14:43:02.720387 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:02.739577 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eaa7c3-bcd1-49f9-abe4-697deec1313b None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:02.781601 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8137fd63-7198-4661-a173-3812407e4916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:02.782502 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137fd63-7198-4661-a173-3812407e4916 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:02.782936 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137fd63-7198-4661-a173-3812407e4916 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:02.783352 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137fd63-7198-4661-a173-3812407e4916 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:02.798448 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8137fd63-7198-4661-a173-3812407e4916 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:43:02.803664 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-8137fd63-7198-4661-a173-3812407e4916 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 14:43:02.803664 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:02.803664 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:43:02.803664 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:43:02.803664 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:43:02.803664 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:43:02.803664 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:43:02.803664 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:43:02.803664 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:43:02.803664 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:43:02.803664 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:43:02.803664 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:43:02.803664 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:43:02.803664 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:43:02.803664 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:43:02.803664 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:43:02.805053 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:43:02.805053 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:43:02.805053 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:43:02.805053 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:43:02.805053 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:43:02.805053 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:43:02.805053 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:43:02.805053 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:43:02.805053 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:43:02.805053 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:43:02.805053 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:43:02.805053 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:43:02.805053 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:43:02.805053 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:43:02.805053 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:43:02.805053 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:43:02.806048 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:43:02.806048 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:43:02.806048 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:43:02.806048 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:43:02.806048 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:43:02.806048 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:43:02.806048 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:43:02.806048 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:43:02.806048 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:43:02.806048 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:43:02.806048 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 14:43:02.806048 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:43:02.808029 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 73/144] 10.222.0.72 () {56 vars in 1114 bytes} [Mon Sep 19 14:43:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:43:02.813950 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903220ae-0492-46a8-bd01-98448bab6963 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:02.947176 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903220ae-0492-46a8-bd01-98448bab6963 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:02.965782 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:02.993487 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b0d24d-c603-4919-8f95-7d0545679585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:02.994038 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b0d24d-c603-4919-8f95-7d0545679585 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:02.994326 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b0d24d-c603-4919-8f95-7d0545679585 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:02.994606 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b0d24d-c603-4919-8f95-7d0545679585 None admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:02.995290 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b0d24d-c603-4919-8f95-7d0545679585 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:02.995665 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b0d24d-c603-4919-8f95-7d0545679585 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:02.997613 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b0d24d-c603-4919-8f95-7d0545679585 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:03.006230 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 72/145] 10.222.0.72 () {56 vars in 1111 bytes} [Mon Sep 19 14:43:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:03.011966 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8137fd63-7198-4661-a173-3812407e4916 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:03.145563 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8137fd63-7198-4661-a173-3812407e4916 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:03.187963 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc05a2f-2735-4de5-8f62-1f81a6f3de1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:03.188626 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc05a2f-2735-4de5-8f62-1f81a6f3de1d None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:03.188911 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc05a2f-2735-4de5-8f62-1f81a6f3de1d None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:03.189188 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc05a2f-2735-4de5-8f62-1f81a6f3de1d None admin] PATH_INFO: `/v3/users/2d21d93228b342d49931ee559e5dfa9c` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:03.193022 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc05a2f-2735-4de5-8f62-1f81a6f3de1d None admin] RBAC: Authorizing `identity:get_user(user_id=2d21d93228b342d49931ee559e5dfa9c)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:03.194571 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc05a2f-2735-4de5-8f62-1f81a6f3de1d None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:03.196427 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 74/146] 10.222.0.72 () {56 vars in 1177 bytes} [Mon Sep 19 14:43:03 2022] GET /identity/v3/users/2d21d93228b342d49931ee559e5dfa9c => generated 275 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:03.198691 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378eb21e-5bf5-4efa-928f-34e78a9fe797 None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:03.199531 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378eb21e-5bf5-4efa-928f-34e78a9fe797 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:03.199916 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378eb21e-5bf5-4efa-928f-34e78a9fe797 None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:03.201283 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 73/147] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:43:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:43:03.206220 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc05a2f-2735-4de5-8f62-1f81a6f3de1d None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:03.226019 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3d0a00-22bb-4820-a4e4-427ed1cae905 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:03.226307 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3d0a00-22bb-4820-a4e4-427ed1cae905 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:03.226577 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3d0a00-22bb-4820-a4e4-427ed1cae905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:03.230920 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:03.257408 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-fd3d0a00-22bb-4820-a4e4-427ed1cae905 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:43:03.258525 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-fd3d0a00-22bb-4820-a4e4-427ed1cae905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:43:03.324888 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc05a2f-2735-4de5-8f62-1f81a6f3de1d None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:03.372452 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b837a6-7588-42ed-9535-b84464496b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:03.373185 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b837a6-7588-42ed-9535-b84464496b5d None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:03.373463 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b837a6-7588-42ed-9535-b84464496b5d None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:03.373734 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b837a6-7588-42ed-9535-b84464496b5d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:03.374157 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 74/148] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:43:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 14:43:03.374823 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3d0a00-22bb-4820-a4e4-427ed1cae905 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:03.460377 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b837a6-7588-42ed-9535-b84464496b5d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:03.462300 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b837a6-7588-42ed-9535-b84464496b5d None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:03.481563 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:03.582768 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 75/149] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Sep 19 14:43:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 14:43:03.584025 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b837a6-7588-42ed-9535-b84464496b5d None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:03.587401 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3d0a00-22bb-4820-a4e4-427ed1cae905 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:03.600110 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:03.633561 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4ce9c0-9f5a-4259-a1cc-8a41984941de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:03.634452 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4ce9c0-9f5a-4259-a1cc-8a41984941de None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:03.634590 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4ce9c0-9f5a-4259-a1cc-8a41984941de None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:03.634825 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4ce9c0-9f5a-4259-a1cc-8a41984941de None admin] PATH_INFO: `/v3/roles/member` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:03.647841 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4ce9c0-9f5a-4259-a1cc-8a41984941de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:43:03.654768 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-cb4ce9c0-9f5a-4259-a1cc-8a41984941de None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 14:43:03.654768 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:03.654768 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:43:03.654768 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:43:03.654768 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:43:03.654768 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:43:03.654768 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:43:03.654768 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:43:03.654768 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:43:03.654768 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:43:03.654768 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:43:03.654768 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:43:03.654768 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:43:03.654768 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:43:03.654768 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:43:03.654768 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:43:03.655604 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:43:03.655604 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:43:03.655604 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:43:03.655604 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:43:03.655604 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:43:03.655604 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:43:03.655604 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:43:03.655604 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:43:03.655604 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:43:03.655604 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:43:03.655604 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:43:03.655604 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:43:03.655604 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:43:03.655604 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:43:03.655604 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:43:03.655604 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:43:03.657014 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:43:03.657014 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:43:03.657014 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:43:03.657014 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:43:03.657014 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:43:03.657014 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:43:03.657014 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:43:03.657014 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:43:03.657014 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:43:03.657014 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:43:03.657014 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 14:43:03.657014 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:43:03.657014 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 75/150] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Sep 19 14:43:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:43:03.657678 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06628a10-91af-463c-b930-f8d4deed1944 None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:03.657678 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06628a10-91af-463c-b930-f8d4deed1944 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:03.657678 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06628a10-91af-463c-b930-f8d4deed1944 None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:03.663819 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 76/151] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:43:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:43:03.663819 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06628a10-91af-463c-b930-f8d4deed1944 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:03.700925 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b837a6-7588-42ed-9535-b84464496b5d None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:03.719581 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:03.738541 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5374d30-740b-4511-ad3a-1f3fb4105441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:03.739184 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5374d30-740b-4511-ad3a-1f3fb4105441 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:03.739466 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5374d30-740b-4511-ad3a-1f3fb4105441 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:03.739741 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5374d30-740b-4511-ad3a-1f3fb4105441 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:03.740912 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5374d30-740b-4511-ad3a-1f3fb4105441 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:03.742389 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5374d30-740b-4511-ad3a-1f3fb4105441 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:03.743957 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 76/152] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:43:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:03.744757 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5374d30-740b-4511-ad3a-1f3fb4105441 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:03.779131 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06628a10-91af-463c-b930-f8d4deed1944 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:03.814088 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ee9d4d-dd86-4b71-b4a4-9985faf38dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:03.814714 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ee9d4d-dd86-4b71-b4a4-9985faf38dd8 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:03.814998 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ee9d4d-dd86-4b71-b4a4-9985faf38dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:03.815263 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ee9d4d-dd86-4b71-b4a4-9985faf38dd8 None admin] PATH_INFO: `/v3/projects/f2d0f3b33b264908b42ee8c76c5527f3` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:03.816400 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ee9d4d-dd86-4b71-b4a4-9985faf38dd8 None admin] RBAC: Authorizing `identity:get_project(project_id=f2d0f3b33b264908b42ee8c76c5527f3)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:03.817868 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ee9d4d-dd86-4b71-b4a4-9985faf38dd8 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:03.819653 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 77/153] 10.222.0.72 () {56 vars in 1186 bytes} [Mon Sep 19 14:43:03 2022] GET /identity/v3/projects/f2d0f3b33b264908b42ee8c76c5527f3 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:03.821418 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fc3da2-cf80-480b-a33f-46fc739f3aab None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:03.821418 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fc3da2-cf80-480b-a33f-46fc739f3aab None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:03.821418 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fc3da2-cf80-480b-a33f-46fc739f3aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:03.842523 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-34fc3da2-cf80-480b-a33f-46fc739f3aab None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:43:03.843769 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-34fc3da2-cf80-480b-a33f-46fc739f3aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:43:03.856402 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5374d30-740b-4511-ad3a-1f3fb4105441 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:03.876480 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:03.902420 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1a3467-86d6-4bc3-9e44-3ab6aafdef92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:03.903035 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a3467-86d6-4bc3-9e44-3ab6aafdef92 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:03.903312 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a3467-86d6-4bc3-9e44-3ab6aafdef92 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:03.906464 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a3467-86d6-4bc3-9e44-3ab6aafdef92 None admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:03.906464 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1a3467-86d6-4bc3-9e44-3ab6aafdef92 None admin] RBAC: Adding query filter params (name=member) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:03.906464 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1a3467-86d6-4bc3-9e44-3ab6aafdef92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:03.906464 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1a3467-86d6-4bc3-9e44-3ab6aafdef92 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:03.914337 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 77/154] 10.222.0.72 () {56 vars in 1101 bytes} [Mon Sep 19 14:43:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:03.915162 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1a3467-86d6-4bc3-9e44-3ab6aafdef92 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:03.925938 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 78/155] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:43:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:43:03.926619 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fc3da2-cf80-480b-a33f-46fc739f3aab None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:03.974097 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:04.033478 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1a3467-86d6-4bc3-9e44-3ab6aafdef92 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:04.037910 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fc3da2-cf80-480b-a33f-46fc739f3aab None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:04.072498 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1f6c96-2c81-44fe-9da7-bf4ae06ebdb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:04.073110 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1f6c96-2c81-44fe-9da7-bf4ae06ebdb2 None admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:04.073393 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1f6c96-2c81-44fe-9da7-bf4ae06ebdb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:04.074321 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1f6c96-2c81-44fe-9da7-bf4ae06ebdb2 None admin] PATH_INFO: `/v3/users` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:04.075016 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1f6c96-2c81-44fe-9da7-bf4ae06ebdb2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:04.075277 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b99a2b-9d73-4d71-bd9e-15060d051efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:04.075899 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b99a2b-9d73-4d71-bd9e-15060d051efd None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:04.076176 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b99a2b-9d73-4d71-bd9e-15060d051efd None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:04.076486 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1f6c96-2c81-44fe-9da7-bf4ae06ebdb2 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:04.076578 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b99a2b-9d73-4d71-bd9e-15060d051efd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:04.086974 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b99a2b-9d73-4d71-bd9e-15060d051efd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:43:04.094040 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-42b99a2b-9d73-4d71-bd9e-15060d051efd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 14:43:04.094040 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:04.094040 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:43:04.094040 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:43:04.094040 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:43:04.094040 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:43:04.094040 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:43:04.094040 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:43:04.094040 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:43:04.094040 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:43:04.094040 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:43:04.094040 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:43:04.094040 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:43:04.094040 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:43:04.094040 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:43:04.094040 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:43:04.097086 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:43:04.097086 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:43:04.097086 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:43:04.097086 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:43:04.097086 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:43:04.097086 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:43:04.097086 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:43:04.097086 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:43:04.097086 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:43:04.097086 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:43:04.097086 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:43:04.097086 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:43:04.097086 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:43:04.097086 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:43:04.097086 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:43:04.097086 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:43:04.097942 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:43:04.097942 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:43:04.097942 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:43:04.097942 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:43:04.097942 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:43:04.097942 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:43:04.097942 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:43:04.097942 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:43:04.097942 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:43:04.097942 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:43:04.097942 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 14:43:04.097942 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:43:04.097942 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 78/156] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Sep 19 14:43:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:43:04.097942 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b99a2b-9d73-4d71-bd9e-15060d051efd None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:04.108957 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 79/157] 10.222.0.72 () {60 vars in 1132 bytes} [Mon Sep 19 14:43:03 2022] POST /identity/v3/users => generated 283 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:43:04.109990 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1f6c96-2c81-44fe-9da7-bf4ae06ebdb2 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:04.146213 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:04.225092 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b99a2b-9d73-4d71-bd9e-15060d051efd None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:04.233461 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:04.240418 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1f6c96-2c81-44fe-9da7-bf4ae06ebdb2 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:04.266338 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4044faee-7c92-453b-925d-34a893bb8a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:04.266961 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4044faee-7c92-453b-925d-34a893bb8a75 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:04.267239 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4044faee-7c92-453b-925d-34a893bb8a75 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:04.267507 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4044faee-7c92-453b-925d-34a893bb8a75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:04.268259 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4044faee-7c92-453b-925d-34a893bb8a75 None admin] RBAC: Adding query filter params (role.id=962ee04d08ae41b08c1a5108c54c7469, scope.project.id=f2d0f3b33b264908b42ee8c76c5527f3, user.id=2d21d93228b342d49931ee559e5dfa9c) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:04.268594 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4044faee-7c92-453b-925d-34a893bb8a75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:04.270088 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4044faee-7c92-453b-925d-34a893bb8a75 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:04.283517 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 79/158] 10.222.0.72 () {56 vars in 1374 bytes} [Mon Sep 19 14:43:04 2022] GET /identity/v3/role_assignments?user.id=2d21d93228b342d49931ee559e5dfa9c&scope.project.id=f2d0f3b33b264908b42ee8c76c5527f3&role.id=962ee04d08ae41b08c1a5108c54c7469 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:04.283517 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaed8e9-daf1-490c-820b-faf617f5937f None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:04.283517 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaed8e9-daf1-490c-820b-faf617f5937f None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:04.283517 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaed8e9-daf1-490c-820b-faf617f5937f None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:04.283517 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 80/159] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:43:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:43:04.283517 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaed8e9-daf1-490c-820b-faf617f5937f None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:04.288725 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd3bb56-f136-4f1e-aa30-db996ffc3b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:04.289395 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd3bb56-f136-4f1e-aa30-db996ffc3b8e None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:04.289677 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd3bb56-f136-4f1e-aa30-db996ffc3b8e None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:04.289954 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd3bb56-f136-4f1e-aa30-db996ffc3b8e None admin] PATH_INFO: `/v3/users/2d21d93228b342d49931ee559e5dfa9c` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:04.291200 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd3bb56-f136-4f1e-aa30-db996ffc3b8e None admin] RBAC: Authorizing `identity:get_user(user_id=2d21d93228b342d49931ee559e5dfa9c)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:04.293318 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd3bb56-f136-4f1e-aa30-db996ffc3b8e None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:04.295067 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 80/160] 10.222.0.72 () {56 vars in 1177 bytes} [Mon Sep 19 14:43:04 2022] GET /identity/v3/users/2d21d93228b342d49931ee559e5dfa9c => generated 275 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:04.295893 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd3bb56-f136-4f1e-aa30-db996ffc3b8e None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:04.415812 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:04.426081 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaed8e9-daf1-490c-820b-faf617f5937f None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:04.429289 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd3bb56-f136-4f1e-aa30-db996ffc3b8e None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:04.466609 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343b2286-489b-4cb5-b3b3-9cedbf31deb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:04.467535 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343b2286-489b-4cb5-b3b3-9cedbf31deb0 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:04.467982 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343b2286-489b-4cb5-b3b3-9cedbf31deb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:04.469257 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343b2286-489b-4cb5-b3b3-9cedbf31deb0 None admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:04.470309 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343b2286-489b-4cb5-b3b3-9cedbf31deb0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:04.470807 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343b2286-489b-4cb5-b3b3-9cedbf31deb0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:04.472190 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd93e3d4-3488-4e34-bb48-4aa991ced705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:04.472691 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343b2286-489b-4cb5-b3b3-9cedbf31deb0 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:04.472866 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd93e3d4-3488-4e34-bb48-4aa991ced705 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:04.473148 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd93e3d4-3488-4e34-bb48-4aa991ced705 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:04.473420 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd93e3d4-3488-4e34-bb48-4aa991ced705 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:04.486306 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 81/161] 10.222.0.72 () {56 vars in 1101 bytes} [Mon Sep 19 14:43:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:04.487566 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc982322-e8d7-41c9-b869-89cc634f95ab None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:04.487853 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc982322-e8d7-41c9-b869-89cc634f95ab None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:04.488153 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc982322-e8d7-41c9-b869-89cc634f95ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:04.490844 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd93e3d4-3488-4e34-bb48-4aa991ced705 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:43:04.497146 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-bd93e3d4-3488-4e34-bb48-4aa991ced705 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:43:04.497146 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:04.497146 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:43:04.497146 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:43:04.497146 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:43:04.497146 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:43:04.497146 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:43:04.497146 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:43:04.497146 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:43:04.497146 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:43:04.497146 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:43:04.497146 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:43:04.497146 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:43:04.497146 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:43:04.497146 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:43:04.497146 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:43:04.498019 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:43:04.498019 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:43:04.498019 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:43:04.498019 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:43:04.498019 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:43:04.498019 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:43:04.498019 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:43:04.498019 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:43:04.498019 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:43:04.498019 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:43:04.498019 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:43:04.498019 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:43:04.498019 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:43:04.498019 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:43:04.498019 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:43:04.498019 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:43:04.498779 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:43:04.498779 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:43:04.498779 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:43:04.498779 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:43:04.498779 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:43:04.498779 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:43:04.498779 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:43:04.498779 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:43:04.498779 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:43:04.498779 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:43:04.498779 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:43:04.498779 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:43:04.498779 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 81/162] 10.222.0.72 () {56 vars in 1096 bytes} [Mon Sep 19 14:43:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:43:04.499430 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd93e3d4-3488-4e34-bb48-4aa991ced705 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:04.513909 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-cc982322-e8d7-41c9-b869-89cc634f95ab None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:43:04.515124 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-cc982322-e8d7-41c9-b869-89cc634f95ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:43:04.546514 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:04.596432 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 82/163] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:43:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:43:04.597144 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc982322-e8d7-41c9-b869-89cc634f95ab None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:04.622290 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd93e3d4-3488-4e34-bb48-4aa991ced705 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:04.664716 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839271ff-4ea1-4108-bc6e-d96f6060aa23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:04.665330 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839271ff-4ea1-4108-bc6e-d96f6060aa23 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:04.665654 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839271ff-4ea1-4108-bc6e-d96f6060aa23 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:04.665978 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839271ff-4ea1-4108-bc6e-d96f6060aa23 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:04.688394 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:04.740812 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc982322-e8d7-41c9-b869-89cc634f95ab None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:04.749660 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839271ff-4ea1-4108-bc6e-d96f6060aa23 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:04.751270 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839271ff-4ea1-4108-bc6e-d96f6060aa23 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:04.782699 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ad999f-5736-49dd-b5ce-35a6e0b086a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:04.783783 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ad999f-5736-49dd-b5ce-35a6e0b086a0 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:04.784565 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ad999f-5736-49dd-b5ce-35a6e0b086a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:04.785104 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ad999f-5736-49dd-b5ce-35a6e0b086a0 None admin] PATH_INFO: `/v3/users/db1fbe7fb6434d6581e75c1b73484d3e` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:04.788311 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ad999f-5736-49dd-b5ce-35a6e0b086a0 None admin] RBAC: Authorizing `identity:get_user(user_id=db1fbe7fb6434d6581e75c1b73484d3e)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:04.790028 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ad999f-5736-49dd-b5ce-35a6e0b086a0 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:04.792509 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 83/164] 10.222.0.72 () {56 vars in 1177 bytes} [Mon Sep 19 14:43:04 2022] GET /identity/v3/users/db1fbe7fb6434d6581e75c1b73484d3e => generated 289 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:04.793997 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ad999f-5736-49dd-b5ce-35a6e0b086a0 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:04.829556 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:04.876983 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 82/165] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Sep 19 14:43:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 14:43:04.877849 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839271ff-4ea1-4108-bc6e-d96f6060aa23 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:04.914076 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ad999f-5736-49dd-b5ce-35a6e0b086a0 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:04.950533 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:04.959080 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc059956-76be-4cc2-a38e-a5c69f7d989c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:04.959906 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc059956-76be-4cc2-a38e-a5c69f7d989c None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:04.960387 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc059956-76be-4cc2-a38e-a5c69f7d989c None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:04.960658 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc059956-76be-4cc2-a38e-a5c69f7d989c None admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:04.961326 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc059956-76be-4cc2-a38e-a5c69f7d989c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:04.961625 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc059956-76be-4cc2-a38e-a5c69f7d989c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:04.962980 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc059956-76be-4cc2-a38e-a5c69f7d989c None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:04.972838 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 84/166] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Sep 19 14:43:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:04.974997 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc059956-76be-4cc2-a38e-a5c69f7d989c None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:05.009116 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839271ff-4ea1-4108-bc6e-d96f6060aa23 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:05.059868 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21489766-b7a3-406f-9f46-e8b98bf36b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:05.061132 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21489766-b7a3-406f-9f46-e8b98bf36b05 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:05.061132 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21489766-b7a3-406f-9f46-e8b98bf36b05 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:05.061328 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21489766-b7a3-406f-9f46-e8b98bf36b05 None admin] PATH_INFO: `/v3/projects/f2d0f3b33b264908b42ee8c76c5527f3` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:05.062396 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21489766-b7a3-406f-9f46-e8b98bf36b05 None admin] RBAC: Authorizing `identity:get_project(project_id=f2d0f3b33b264908b42ee8c76c5527f3)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:05.064261 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21489766-b7a3-406f-9f46-e8b98bf36b05 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:05.067159 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 83/167] 10.222.0.72 () {56 vars in 1186 bytes} [Mon Sep 19 14:43:04 2022] GET /identity/v3/projects/f2d0f3b33b264908b42ee8c76c5527f3 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:05.067728 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21489766-b7a3-406f-9f46-e8b98bf36b05 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:05.092158 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:05.103371 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc059956-76be-4cc2-a38e-a5c69f7d989c None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:05.149371 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77bcd1e-84a1-44ad-b5b6-08443a6c0c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:05.150178 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77bcd1e-84a1-44ad-b5b6-08443a6c0c6c None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:05.150570 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77bcd1e-84a1-44ad-b5b6-08443a6c0c6c None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:05.150853 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77bcd1e-84a1-44ad-b5b6-08443a6c0c6c None admin] PATH_INFO: `/v3/projects/f2d0f3b33b264908b42ee8c76c5527f3` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:05.152754 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77bcd1e-84a1-44ad-b5b6-08443a6c0c6c None admin] RBAC: Authorizing `identity:get_project(project_id=f2d0f3b33b264908b42ee8c76c5527f3)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:05.154411 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77bcd1e-84a1-44ad-b5b6-08443a6c0c6c None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:05.156936 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 85/168] 10.222.0.72 () {56 vars in 1186 bytes} [Mon Sep 19 14:43:04 2022] GET /identity/v3/projects/f2d0f3b33b264908b42ee8c76c5527f3 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:05.158012 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77bcd1e-84a1-44ad-b5b6-08443a6c0c6c None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:05.208713 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21489766-b7a3-406f-9f46-e8b98bf36b05 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:05.242909 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:05.279248 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d6c4af-febb-4824-9c00-c2e86cfcd15b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:05.279895 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d6c4af-febb-4824-9c00-c2e86cfcd15b None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:05.280172 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d6c4af-febb-4824-9c00-c2e86cfcd15b None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:05.280468 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d6c4af-febb-4824-9c00-c2e86cfcd15b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:05.303317 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d6c4af-febb-4824-9c00-c2e86cfcd15b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:43:05.308734 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-a6d6c4af-febb-4824-9c00-c2e86cfcd15b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 14:43:05.308734 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:05.308734 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:43:05.308734 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:43:05.308734 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:43:05.308734 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:43:05.308734 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:43:05.308734 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:43:05.308734 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:43:05.308734 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:43:05.308734 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:43:05.308734 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:43:05.308734 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:43:05.308734 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:43:05.308734 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:43:05.308734 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:43:05.309587 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:43:05.309587 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:43:05.309587 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:43:05.309587 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:43:05.309587 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:43:05.309587 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:43:05.309587 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:43:05.309587 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:43:05.309587 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:43:05.309587 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:43:05.309587 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:43:05.309587 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:43:05.309587 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:43:05.309587 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:43:05.309587 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:43:05.309587 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:43:05.310377 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:43:05.310377 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:43:05.310377 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:43:05.310377 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:43:05.310377 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:43:05.310377 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:43:05.310377 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:43:05.310377 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:43:05.310377 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:43:05.310377 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:43:05.310377 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 14:43:05.310377 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:43:05.310962 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 84/169] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Sep 19 14:43:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:43:05.311920 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d6c4af-febb-4824-9c00-c2e86cfcd15b None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:05.347120 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77bcd1e-84a1-44ad-b5b6-08443a6c0c6c None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:05.395588 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372ed306-2c4c-4801-aa5d-e08d19869e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:05.396523 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372ed306-2c4c-4801-aa5d-e08d19869e02 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:05.396810 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372ed306-2c4c-4801-aa5d-e08d19869e02 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:05.397083 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372ed306-2c4c-4801-aa5d-e08d19869e02 None admin] PATH_INFO: `/v3/users/2f19d59289e4450ca5e67c69c2e3b80c` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:05.398218 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372ed306-2c4c-4801-aa5d-e08d19869e02 None admin] RBAC: Authorizing `identity:get_user(user_id=2f19d59289e4450ca5e67c69c2e3b80c)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:05.399736 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372ed306-2c4c-4801-aa5d-e08d19869e02 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:05.401956 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 86/170] 10.222.0.72 () {56 vars in 1177 bytes} [Mon Sep 19 14:43:05 2022] GET /identity/v3/users/2f19d59289e4450ca5e67c69c2e3b80c => generated 247 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:05.403180 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372ed306-2c4c-4801-aa5d-e08d19869e02 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:05.457853 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:05.467508 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d6c4af-febb-4824-9c00-c2e86cfcd15b None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:05.539421 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77542387-4289-4bec-96fc-cde2e67114c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:05.540315 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77542387-4289-4bec-96fc-cde2e67114c2 None admin] REQUEST_METHOD: `PUT` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:05.540704 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77542387-4289-4bec-96fc-cde2e67114c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:05.541069 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77542387-4289-4bec-96fc-cde2e67114c2 None admin] PATH_INFO: `/v3/projects/f2d0f3b33b264908b42ee8c76c5527f3/users/db1fbe7fb6434d6581e75c1b73484d3e/roles/dc1fc2b7f53a4f1084d0ecf5473f9dce` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:05.545352 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77542387-4289-4bec-96fc-cde2e67114c2 None admin] RBAC: Authorizing `identity:create_grant(project_id=f2d0f3b33b264908b42ee8c76c5527f3, user_id=db1fbe7fb6434d6581e75c1b73484d3e, role_id=dc1fc2b7f53a4f1084d0ecf5473f9dce)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:05.547088 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77542387-4289-4bec-96fc-cde2e67114c2 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:05.556840 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372ed306-2c4c-4801-aa5d-e08d19869e02 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:05.571732 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 85/171] 10.222.0.72 () {58 vars in 1439 bytes} [Mon Sep 19 14:43:05 2022] PUT /identity/v3/projects/f2d0f3b33b264908b42ee8c76c5527f3/users/db1fbe7fb6434d6581e75c1b73484d3e/roles/dc1fc2b7f53a4f1084d0ecf5473f9dce => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:43:05.572598 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77542387-4289-4bec-96fc-cde2e67114c2 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:05.601482 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca15f2cd-ef33-4435-bb31-33e5e1b3903d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:05.602663 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca15f2cd-ef33-4435-bb31-33e5e1b3903d None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:05.602949 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca15f2cd-ef33-4435-bb31-33e5e1b3903d None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:05.603309 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca15f2cd-ef33-4435-bb31-33e5e1b3903d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:05.604239 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca15f2cd-ef33-4435-bb31-33e5e1b3903d None admin] RBAC: Adding query filter params (role.id=efa0e5b3413748dc828a89b12d67df79, scope.project.id=f2d0f3b33b264908b42ee8c76c5527f3, user.id=2d21d93228b342d49931ee559e5dfa9c) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:05.604700 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca15f2cd-ef33-4435-bb31-33e5e1b3903d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:05.607547 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca15f2cd-ef33-4435-bb31-33e5e1b3903d None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:05.615454 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 87/172] 10.222.0.72 () {56 vars in 1374 bytes} [Mon Sep 19 14:43:05 2022] GET /identity/v3/role_assignments?user.id=2d21d93228b342d49931ee559e5dfa9c&scope.project.id=f2d0f3b33b264908b42ee8c76c5527f3&role.id=efa0e5b3413748dc828a89b12d67df79 => generated 608 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:05.616140 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca15f2cd-ef33-4435-bb31-33e5e1b3903d None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:05.652766 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:05.751873 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:05.765653 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca15f2cd-ef33-4435-bb31-33e5e1b3903d None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:05.780539 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77542387-4289-4bec-96fc-cde2e67114c2 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:05.814187 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab40972-ee44-4645-81dc-1affe86a72c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:05.814915 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab40972-ee44-4645-81dc-1affe86a72c3 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:05.815262 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab40972-ee44-4645-81dc-1affe86a72c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:05.815600 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab40972-ee44-4645-81dc-1affe86a72c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:05.847434 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f910bd-112c-42d0-8cf4-1f7909708bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:05.848250 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f910bd-112c-42d0-8cf4-1f7909708bfc None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:05.848611 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f910bd-112c-42d0-8cf4-1f7909708bfc None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:05.848942 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f910bd-112c-42d0-8cf4-1f7909708bfc None admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:05.849758 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f910bd-112c-42d0-8cf4-1f7909708bfc None admin] RBAC: Adding query filter params (name=member) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:05.850121 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f910bd-112c-42d0-8cf4-1f7909708bfc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:05.851851 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f910bd-112c-42d0-8cf4-1f7909708bfc None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:05.870449 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 86/173] 10.222.0.72 () {56 vars in 1101 bytes} [Mon Sep 19 14:43:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:05.877912 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f910bd-112c-42d0-8cf4-1f7909708bfc None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:05.959272 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab40972-ee44-4645-81dc-1affe86a72c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:05.960816 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab40972-ee44-4645-81dc-1affe86a72c3 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:06.082859 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:06.088199 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f910bd-112c-42d0-8cf4-1f7909708bfc None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:06.139184 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:06.157174 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 88/174] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Sep 19 14:43:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 541 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 14:43:06.163804 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab40972-ee44-4645-81dc-1affe86a72c3 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:06.168118 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f4e12b-982b-4392-aacb-0218062eadf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:06.168811 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f4e12b-982b-4392-aacb-0218062eadf4 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:06.169093 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f4e12b-982b-4392-aacb-0218062eadf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:06.169360 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f4e12b-982b-4392-aacb-0218062eadf4 None admin] PATH_INFO: `/v3/users/2d21d93228b342d49931ee559e5dfa9c` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:06.174668 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f4e12b-982b-4392-aacb-0218062eadf4 None admin] RBAC: Authorizing `identity:get_user(user_id=2d21d93228b342d49931ee559e5dfa9c)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:06.178012 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f4e12b-982b-4392-aacb-0218062eadf4 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:06.182277 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 87/175] 10.222.0.72 () {56 vars in 1177 bytes} [Mon Sep 19 14:43:05 2022] GET /identity/v3/users/2d21d93228b342d49931ee559e5dfa9c => generated 275 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:06.185910 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f4e12b-982b-4392-aacb-0218062eadf4 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:06.324634 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab40972-ee44-4645-81dc-1affe86a72c3 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:06.371089 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fded4a9-0d21-4659-8d90-c36cde7e4186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:06.371689 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fded4a9-0d21-4659-8d90-c36cde7e4186 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:06.372030 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fded4a9-0d21-4659-8d90-c36cde7e4186 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:06.372359 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fded4a9-0d21-4659-8d90-c36cde7e4186 None admin] PATH_INFO: `/v3/projects/f2d0f3b33b264908b42ee8c76c5527f3` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:06.373964 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fded4a9-0d21-4659-8d90-c36cde7e4186 None admin] RBAC: Authorizing `identity:get_project(project_id=f2d0f3b33b264908b42ee8c76c5527f3)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:06.375661 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fded4a9-0d21-4659-8d90-c36cde7e4186 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:06.377804 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 89/176] 10.222.0.72 () {56 vars in 1186 bytes} [Mon Sep 19 14:43:06 2022] GET /identity/v3/projects/f2d0f3b33b264908b42ee8c76c5527f3 => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:43:06.384215 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fded4a9-0d21-4659-8d90-c36cde7e4186 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:06.418371 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f4e12b-982b-4392-aacb-0218062eadf4 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:06.453265 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:06.503622 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fded4a9-0d21-4659-8d90-c36cde7e4186 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:06.537059 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe209faf-2bd8-4281-a898-21976eca2420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:06.537833 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe209faf-2bd8-4281-a898-21976eca2420 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:06.538214 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe209faf-2bd8-4281-a898-21976eca2420 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:06.538584 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe209faf-2bd8-4281-a898-21976eca2420 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:06.541137 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a38aed-d42f-4076-8795-7e246dfa86cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:06.541962 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a38aed-d42f-4076-8795-7e246dfa86cb None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:06.542391 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a38aed-d42f-4076-8795-7e246dfa86cb None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:06.543350 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a38aed-d42f-4076-8795-7e246dfa86cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:06.544275 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a38aed-d42f-4076-8795-7e246dfa86cb None admin] RBAC: Adding query filter params (role.id=ddb643577b2e4e478100ec370decfaeb, scope.project.id=f2d0f3b33b264908b42ee8c76c5527f3, user.id=2f19d59289e4450ca5e67c69c2e3b80c) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:06.544936 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a38aed-d42f-4076-8795-7e246dfa86cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:06.547536 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a38aed-d42f-4076-8795-7e246dfa86cb None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:06.557694 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 90/177] 10.222.0.72 () {56 vars in 1374 bytes} [Mon Sep 19 14:43:06 2022] GET /identity/v3/role_assignments?user.id=2f19d59289e4450ca5e67c69c2e3b80c&scope.project.id=f2d0f3b33b264908b42ee8c76c5527f3&role.id=ddb643577b2e4e478100ec370decfaeb => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:06.625859 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:06.682554 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe209faf-2bd8-4281-a898-21976eca2420 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:06.685055 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe209faf-2bd8-4281-a898-21976eca2420 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:06.825171 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 88/178] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Sep 19 14:43:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 640 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 14:43:06.831075 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a38aed-d42f-4076-8795-7e246dfa86cb None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:06.958305 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a38aed-d42f-4076-8795-7e246dfa86cb None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:06.984189 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:06.997392 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6640714e-38d6-4ddf-9884-271b40bdb049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:06.998028 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6640714e-38d6-4ddf-9884-271b40bdb049 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:06.998309 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6640714e-38d6-4ddf-9884-271b40bdb049 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:06.998578 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6640714e-38d6-4ddf-9884-271b40bdb049 None admin] PATH_INFO: `/v3/projects/e5bc3f4c812143e2986c993cbccac024` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:06.999703 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6640714e-38d6-4ddf-9884-271b40bdb049 None admin] RBAC: Authorizing `identity:get_project(project_id=e5bc3f4c812143e2986c993cbccac024)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:07.001176 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6640714e-38d6-4ddf-9884-271b40bdb049 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:07.003030 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 91/179] 10.222.0.72 () {56 vars in 1186 bytes} [Mon Sep 19 14:43:06 2022] GET /identity/v3/projects/e5bc3f4c812143e2986c993cbccac024 => generated 312 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:07.009256 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe209faf-2bd8-4281-a898-21976eca2420 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:07.079571 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:07.114529 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe209faf-2bd8-4281-a898-21976eca2420 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:07.151405 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71d5436-501c-4306-a151-192f2a2f293e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:07.152232 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d5436-501c-4306-a151-192f2a2f293e None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:07.152633 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d5436-501c-4306-a151-192f2a2f293e None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:07.152909 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d5436-501c-4306-a151-192f2a2f293e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:07.153649 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71d5436-501c-4306-a151-192f2a2f293e None admin] RBAC: Adding query filter params (role.id=efa0e5b3413748dc828a89b12d67df79, scope.project.id=e5bc3f4c812143e2986c993cbccac024, user.id=2d21d93228b342d49931ee559e5dfa9c) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:07.153953 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71d5436-501c-4306-a151-192f2a2f293e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:07.155390 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71d5436-501c-4306-a151-192f2a2f293e None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:07.162641 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 89/180] 10.222.0.72 () {56 vars in 1374 bytes} [Mon Sep 19 14:43:07 2022] GET /identity/v3/role_assignments?user.id=2d21d93228b342d49931ee559e5dfa9c&scope.project.id=e5bc3f4c812143e2986c993cbccac024&role.id=efa0e5b3413748dc828a89b12d67df79 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:07.316616 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb0f8e6-9076-40a9-a599-c2378f6bb1d4 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:07.317141 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb0f8e6-9076-40a9-a599-c2378f6bb1d4 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:07.317407 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb0f8e6-9076-40a9-a599-c2378f6bb1d4 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:07.318893 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 92/181] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:43:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:43:07.325556 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0c6db6-a2a7-47e3-99bc-e35041e0fa27 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:07.325854 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0c6db6-a2a7-47e3-99bc-e35041e0fa27 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:07.326104 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0c6db6-a2a7-47e3-99bc-e35041e0fa27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:07.349783 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-4b0c6db6-a2a7-47e3-99bc-e35041e0fa27 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:43:07.351010 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-4b0c6db6-a2a7-47e3-99bc-e35041e0fa27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:43:07.426911 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 90/182] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:43:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:43:07.752068 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb0f8e6-9076-40a9-a599-c2378f6bb1d4 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:07.856005 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06901e7-320a-4e42-bbc8-173663a55097 None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:07.856301 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06901e7-320a-4e42-bbc8-173663a55097 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:07.856694 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06901e7-320a-4e42-bbc8-173663a55097 None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:07.858214 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 91/183] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:43:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 14:43:07.865566 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a8ef39-621a-4ad3-a88d-5bef58b49a75 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:07.865938 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a8ef39-621a-4ad3-a88d-5bef58b49a75 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:07.866285 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a8ef39-621a-4ad3-a88d-5bef58b49a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:07.870319 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb0f8e6-9076-40a9-a599-c2378f6bb1d4 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:07.893023 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-39a8ef39-621a-4ad3-a88d-5bef58b49a75 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:43:07.894532 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-39a8ef39-621a-4ad3-a88d-5bef58b49a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:43:07.924594 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c26cbf5-16cc-465d-a178-82314cf1f1ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:07.925622 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c26cbf5-16cc-465d-a178-82314cf1f1ed None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:07.926097 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c26cbf5-16cc-465d-a178-82314cf1f1ed None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:07.926547 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c26cbf5-16cc-465d-a178-82314cf1f1ed None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:07.939055 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c26cbf5-16cc-465d-a178-82314cf1f1ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:43:07.944426 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-3c26cbf5-16cc-465d-a178-82314cf1f1ed None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:43:07.944426 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:07.944426 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:43:07.944426 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:43:07.944426 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:43:07.944426 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:43:07.944426 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:43:07.944426 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:43:07.944426 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:43:07.944426 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:43:07.944426 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:43:07.944426 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:43:07.944426 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:43:07.944426 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:43:07.944426 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:43:07.944426 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:43:07.945311 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:43:07.945311 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:43:07.945311 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:43:07.945311 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:43:07.945311 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:43:07.945311 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:43:07.945311 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:43:07.945311 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:43:07.945311 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:43:07.945311 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:43:07.945311 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:43:07.945311 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:43:07.945311 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:43:07.945311 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:43:07.945311 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:43:07.945311 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:43:07.946075 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:43:07.946075 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:43:07.946075 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:43:07.946075 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:43:07.946075 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:43:07.946075 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:43:07.946075 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:43:07.946075 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:43:07.946075 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:43:07.946075 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:43:07.946075 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:43:07.946075 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:43:07.948719 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 93/184] 10.222.0.72 () {56 vars in 1096 bytes} [Mon Sep 19 14:43:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:43:07.954576 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c26cbf5-16cc-465d-a178-82314cf1f1ed None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:07.979465 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 92/185] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:43:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:43:07.980740 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:08.006986 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bfa39a-14df-471c-b3eb-24b7dbc62c92 None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:08.007248 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bfa39a-14df-471c-b3eb-24b7dbc62c92 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:08.007442 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bfa39a-14df-471c-b3eb-24b7dbc62c92 None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:08.008807 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 93/186] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:43:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 14:43:08.014435 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d63465-9435-4641-a661-d850c1f6f1d0 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:08.014870 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d63465-9435-4641-a661-d850c1f6f1d0 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:08.015148 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d63465-9435-4641-a661-d850c1f6f1d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:08.032751 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:08.036401 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-f2d63465-9435-4641-a661-d850c1f6f1d0 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:43:08.037945 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-f2d63465-9435-4641-a661-d850c1f6f1d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:43:08.072275 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c26cbf5-16cc-465d-a178-82314cf1f1ed None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:08.108247 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcca5211-e92f-4e92-86b2-5476a17840dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:08.109228 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcca5211-e92f-4e92-86b2-5476a17840dd None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:08.109722 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcca5211-e92f-4e92-86b2-5476a17840dd None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:08.110183 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcca5211-e92f-4e92-86b2-5476a17840dd None admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:08.111029 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcca5211-e92f-4e92-86b2-5476a17840dd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:08.111538 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcca5211-e92f-4e92-86b2-5476a17840dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:08.113164 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcca5211-e92f-4e92-86b2-5476a17840dd None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:08.120924 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 94/187] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:43:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 14:43:08.122868 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 94/188] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Sep 19 14:43:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:43:08.136730 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d63465-9435-4641-a661-d850c1f6f1d0 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:08.231529 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d63465-9435-4641-a661-d850c1f6f1d0 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:08.254588 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:08.267812 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98937a61-5b48-47da-9471-afdb48b77824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:08.268452 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98937a61-5b48-47da-9471-afdb48b77824 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:08.268744 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98937a61-5b48-47da-9471-afdb48b77824 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:08.269019 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98937a61-5b48-47da-9471-afdb48b77824 None admin] PATH_INFO: `/v3/users/da8d98977ba8478bb69666a438c332ce` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:08.275449 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcca5211-e92f-4e92-86b2-5476a17840dd None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:08.285636 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98937a61-5b48-47da-9471-afdb48b77824 None admin] RBAC: Authorizing `identity:get_user(user_id=da8d98977ba8478bb69666a438c332ce)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:08.287091 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98937a61-5b48-47da-9471-afdb48b77824 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:08.289126 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 95/189] 10.222.0.72 () {56 vars in 1177 bytes} [Mon Sep 19 14:43:08 2022] GET /identity/v3/users/da8d98977ba8478bb69666a438c332ce => generated 283 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:08.297470 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98937a61-5b48-47da-9471-afdb48b77824 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:08.405164 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcca5211-e92f-4e92-86b2-5476a17840dd None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:08.417095 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98937a61-5b48-47da-9471-afdb48b77824 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:08.424022 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:08.449438 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7c78fe-7c62-4078-8c9b-3b20e14541d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:08.450173 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c78fe-7c62-4078-8c9b-3b20e14541d5 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:08.450463 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c78fe-7c62-4078-8c9b-3b20e14541d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:08.450734 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c78fe-7c62-4078-8c9b-3b20e14541d5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:08.454621 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d845b5d-a533-48e2-9169-6fad6ba85cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:08.455225 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d845b5d-a533-48e2-9169-6fad6ba85cf0 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:08.455500 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d845b5d-a533-48e2-9169-6fad6ba85cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:08.455764 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d845b5d-a533-48e2-9169-6fad6ba85cf0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:08.461455 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7c78fe-7c62-4078-8c9b-3b20e14541d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:43:08.467399 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-0f7c78fe-7c62-4078-8c9b-3b20e14541d5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 14:43:08.467399 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:08.467399 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:43:08.467399 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:43:08.467399 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:43:08.467399 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:43:08.467399 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:43:08.467399 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:43:08.467399 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:43:08.467399 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:43:08.467399 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:43:08.467399 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:43:08.467399 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:43:08.467399 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:43:08.467399 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:43:08.467399 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:43:08.468263 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:43:08.468263 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:43:08.468263 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:43:08.468263 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:43:08.468263 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:43:08.468263 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:43:08.468263 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:43:08.468263 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:43:08.468263 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:43:08.468263 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:43:08.468263 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:43:08.468263 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:43:08.468263 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:43:08.468263 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:43:08.468263 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:43:08.468263 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:43:08.473654 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:43:08.473654 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:43:08.473654 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:43:08.473654 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:43:08.473654 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:43:08.473654 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:43:08.473654 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:43:08.473654 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:43:08.473654 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:43:08.473654 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:43:08.473654 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 14:43:08.473654 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:43:08.473654 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 95/190] 10.222.0.72 () {56 vars in 1114 bytes} [Mon Sep 19 14:43:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:43:08.473654 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7c78fe-7c62-4078-8c9b-3b20e14541d5 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:08.512534 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:08.536539 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d845b5d-a533-48e2-9169-6fad6ba85cf0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:08.538353 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d845b5d-a533-48e2-9169-6fad6ba85cf0 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:08.591898 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7c78fe-7c62-4078-8c9b-3b20e14541d5 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:08.632305 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44fc6b6-1210-44db-a07d-75c807bf4ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:08.633444 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44fc6b6-1210-44db-a07d-75c807bf4ec4 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:08.633958 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44fc6b6-1210-44db-a07d-75c807bf4ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:08.634464 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44fc6b6-1210-44db-a07d-75c807bf4ec4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:08.637036 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44fc6b6-1210-44db-a07d-75c807bf4ec4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:08.639820 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44fc6b6-1210-44db-a07d-75c807bf4ec4 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:08.642953 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 96/191] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:43:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:08.643599 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44fc6b6-1210-44db-a07d-75c807bf4ec4 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:08.662959 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 96/192] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Sep 19 14:43:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 19 14:43:08.664042 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d845b5d-a533-48e2-9169-6fad6ba85cf0 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:08.693028 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:08.751363 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:08.754054 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44fc6b6-1210-44db-a07d-75c807bf4ec4 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:08.771005 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d845b5d-a533-48e2-9169-6fad6ba85cf0 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:08.788243 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94f4b7b-e832-4fd8-bca4-529828bd3eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:08.788807 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94f4b7b-e832-4fd8-bca4-529828bd3eee None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:08.789085 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94f4b7b-e832-4fd8-bca4-529828bd3eee None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:08.789356 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94f4b7b-e832-4fd8-bca4-529828bd3eee None admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:08.790007 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94f4b7b-e832-4fd8-bca4-529828bd3eee None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:08.790307 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94f4b7b-e832-4fd8-bca4-529828bd3eee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:08.791686 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94f4b7b-e832-4fd8-bca4-529828bd3eee None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:08.799706 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 97/193] 10.222.0.72 () {56 vars in 1111 bytes} [Mon Sep 19 14:43:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:08.800515 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94f4b7b-e832-4fd8-bca4-529828bd3eee None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:08.808846 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66576bbc-e7a8-4f39-9de8-b56fa12539bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:08.809525 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66576bbc-e7a8-4f39-9de8-b56fa12539bb None admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:08.809806 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66576bbc-e7a8-4f39-9de8-b56fa12539bb None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:08.810080 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66576bbc-e7a8-4f39-9de8-b56fa12539bb None admin] PATH_INFO: `/v3/users` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:08.810737 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66576bbc-e7a8-4f39-9de8-b56fa12539bb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:08.812169 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66576bbc-e7a8-4f39-9de8-b56fa12539bb None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:08.835065 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 97/194] 10.222.0.72 () {60 vars in 1132 bytes} [Mon Sep 19 14:43:08 2022] POST /identity/v3/users => generated 297 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:43:08.836181 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a064a6-b063-43f4-8844-87c5bf70ef0c None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:08.836501 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a064a6-b063-43f4-8844-87c5bf70ef0c None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:08.836781 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a064a6-b063-43f4-8844-87c5bf70ef0c None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:08.838039 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 98/195] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:43:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:43:08.841208 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a064a6-b063-43f4-8844-87c5bf70ef0c None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:08.923796 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94f4b7b-e832-4fd8-bca4-529828bd3eee None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:08.927613 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:08.961077 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a064a6-b063-43f4-8844-87c5bf70ef0c None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:08.965458 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36a7524-0902-47c3-bb1a-18c2f5c08b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:08.966114 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36a7524-0902-47c3-bb1a-18c2f5c08b94 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:08.966395 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36a7524-0902-47c3-bb1a-18c2f5c08b94 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:08.966672 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36a7524-0902-47c3-bb1a-18c2f5c08b94 None admin] PATH_INFO: `/v3/projects/4a1ea1922c4946d79ba6bac82ade352e` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:08.967878 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36a7524-0902-47c3-bb1a-18c2f5c08b94 None admin] RBAC: Authorizing `identity:get_project(project_id=4a1ea1922c4946d79ba6bac82ade352e)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:08.969417 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36a7524-0902-47c3-bb1a-18c2f5c08b94 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:08.976404 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 98/196] 10.222.0.72 () {56 vars in 1186 bytes} [Mon Sep 19 14:43:08 2022] GET /identity/v3/projects/4a1ea1922c4946d79ba6bac82ade352e => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:08.976404 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3144771-a0ea-472f-8971-4c7210b3ecb9 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:08.976404 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3144771-a0ea-472f-8971-4c7210b3ecb9 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:08.976404 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3144771-a0ea-472f-8971-4c7210b3ecb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:08.993892 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-a3144771-a0ea-472f-8971-4c7210b3ecb9 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:43:08.995123 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-a3144771-a0ea-472f-8971-4c7210b3ecb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:43:09.003908 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09332e3-78e4-442b-90d8-1bdcacc0549a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:09.004572 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09332e3-78e4-442b-90d8-1bdcacc0549a None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:09.004849 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09332e3-78e4-442b-90d8-1bdcacc0549a None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:09.005166 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09332e3-78e4-442b-90d8-1bdcacc0549a None admin] PATH_INFO: `/v3/users/da8d98977ba8478bb69666a438c332ce` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:09.006303 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09332e3-78e4-442b-90d8-1bdcacc0549a None admin] RBAC: Authorizing `identity:get_user(user_id=da8d98977ba8478bb69666a438c332ce)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:09.007824 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09332e3-78e4-442b-90d8-1bdcacc0549a None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:09.010415 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 99/197] 10.222.0.72 () {56 vars in 1177 bytes} [Mon Sep 19 14:43:08 2022] GET /identity/v3/users/da8d98977ba8478bb69666a438c332ce => generated 283 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:09.010415 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09332e3-78e4-442b-90d8-1bdcacc0549a None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:09.019089 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:09.079503 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 99/198] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:43:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:43:09.080112 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3144771-a0ea-472f-8971-4c7210b3ecb9 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:09.145527 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09332e3-78e4-442b-90d8-1bdcacc0549a None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:09.187060 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c68ba11-9b6a-4dac-a18c-7355628f4e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:09.187679 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c68ba11-9b6a-4dac-a18c-7355628f4e85 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:09.187955 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c68ba11-9b6a-4dac-a18c-7355628f4e85 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:09.188225 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c68ba11-9b6a-4dac-a18c-7355628f4e85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:09.190376 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c68ba11-9b6a-4dac-a18c-7355628f4e85 None admin] RBAC: Adding query filter params (role.id=ddb643577b2e4e478100ec370decfaeb, scope.project.id=4a1ea1922c4946d79ba6bac82ade352e, user.id=da8d98977ba8478bb69666a438c332ce) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:09.190376 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c68ba11-9b6a-4dac-a18c-7355628f4e85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:09.191631 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c68ba11-9b6a-4dac-a18c-7355628f4e85 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:09.197842 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 100/199] 10.222.0.72 () {56 vars in 1374 bytes} [Mon Sep 19 14:43:09 2022] GET /identity/v3/role_assignments?user.id=da8d98977ba8478bb69666a438c332ce&scope.project.id=4a1ea1922c4946d79ba6bac82ade352e&role.id=ddb643577b2e4e478100ec370decfaeb => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:09.232495 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3144771-a0ea-472f-8971-4c7210b3ecb9 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:09.234509 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:09.275832 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a84a5f3-9eb2-4b36-a5a5-ab51b93b3133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:09.276496 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a84a5f3-9eb2-4b36-a5a5-ab51b93b3133 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:09.276778 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a84a5f3-9eb2-4b36-a5a5-ab51b93b3133 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:09.277086 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a84a5f3-9eb2-4b36-a5a5-ab51b93b3133 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:09.353782 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a84a5f3-9eb2-4b36-a5a5-ab51b93b3133 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:09.355319 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a84a5f3-9eb2-4b36-a5a5-ab51b93b3133 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:09.378682 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c68ba11-9b6a-4dac-a18c-7355628f4e85 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:09.464704 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:09.513163 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 100/200] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Sep 19 14:43:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 14:43:09.519521 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a84a5f3-9eb2-4b36-a5a5-ab51b93b3133 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:09.521518 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:09.534352 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c68ba11-9b6a-4dac-a18c-7355628f4e85 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:09.629163 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14506c2-a63d-4dae-911d-b3275a694352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:09.629747 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14506c2-a63d-4dae-911d-b3275a694352 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:09.630034 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14506c2-a63d-4dae-911d-b3275a694352 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:09.630310 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14506c2-a63d-4dae-911d-b3275a694352 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:09.631619 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a84a5f3-9eb2-4b36-a5a5-ab51b93b3133 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:09.660881 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14506c2-a63d-4dae-911d-b3275a694352 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:43:09.666432 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-e14506c2-a63d-4dae-911d-b3275a694352 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 14:43:09.666432 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:09.666432 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:43:09.666432 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:43:09.666432 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:43:09.666432 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:43:09.666432 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:43:09.666432 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:43:09.666432 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:43:09.666432 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:43:09.666432 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:43:09.666432 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:43:09.666432 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:43:09.666432 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:43:09.666432 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:43:09.666432 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:43:09.667310 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:43:09.667310 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:43:09.667310 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:43:09.667310 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:43:09.667310 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:43:09.667310 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:43:09.667310 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:43:09.667310 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:43:09.667310 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:43:09.667310 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:43:09.667310 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:43:09.667310 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:43:09.667310 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:43:09.667310 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:43:09.667310 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:43:09.667310 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:43:09.668310 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:43:09.668310 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:43:09.668310 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:43:09.668310 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:43:09.668310 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:43:09.668310 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:43:09.668310 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:43:09.668310 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:43:09.668310 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:43:09.668310 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:43:09.668310 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 14:43:09.668310 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:43:09.668310 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 101/201] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Sep 19 14:43:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:43:09.675629 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14506c2-a63d-4dae-911d-b3275a694352 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:09.676539 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa602b9d-296c-4c33-a63c-84875ab84884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:09.677284 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa602b9d-296c-4c33-a63c-84875ab84884 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:09.677565 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa602b9d-296c-4c33-a63c-84875ab84884 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:09.677835 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa602b9d-296c-4c33-a63c-84875ab84884 None admin] PATH_INFO: `/v3/projects/4a1ea1922c4946d79ba6bac82ade352e` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:09.678962 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa602b9d-296c-4c33-a63c-84875ab84884 None admin] RBAC: Authorizing `identity:get_project(project_id=4a1ea1922c4946d79ba6bac82ade352e)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:09.680804 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa602b9d-296c-4c33-a63c-84875ab84884 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:09.682975 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 101/202] 10.222.0.72 () {56 vars in 1186 bytes} [Mon Sep 19 14:43:09 2022] GET /identity/v3/projects/4a1ea1922c4946d79ba6bac82ade352e => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:09.691148 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa602b9d-296c-4c33-a63c-84875ab84884 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:09.799096 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14506c2-a63d-4dae-911d-b3275a694352 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:09.810049 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:09.830003 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:09.840012 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4720fc4f-e3f4-47c5-803f-51e53159fec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:09.840716 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4720fc4f-e3f4-47c5-803f-51e53159fec1 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:09.841055 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4720fc4f-e3f4-47c5-803f-51e53159fec1 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:09.841252 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4720fc4f-e3f4-47c5-803f-51e53159fec1 None admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:09.841919 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4720fc4f-e3f4-47c5-803f-51e53159fec1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:09.842215 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4720fc4f-e3f4-47c5-803f-51e53159fec1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:09.843750 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4720fc4f-e3f4-47c5-803f-51e53159fec1 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:09.852829 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 102/203] 10.222.0.72 () {56 vars in 1101 bytes} [Mon Sep 19 14:43:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:43:09.859412 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4720fc4f-e3f4-47c5-803f-51e53159fec1 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:09.870243 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa602b9d-296c-4c33-a63c-84875ab84884 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:09.961784 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66a255b-de52-40ad-a59b-f1181e347a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:09.962404 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66a255b-de52-40ad-a59b-f1181e347a56 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:09.962684 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66a255b-de52-40ad-a59b-f1181e347a56 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:09.962959 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66a255b-de52-40ad-a59b-f1181e347a56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:09.963708 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66a255b-de52-40ad-a59b-f1181e347a56 None admin] RBAC: Adding query filter params (role.id=962ee04d08ae41b08c1a5108c54c7469, scope.project.id=4a1ea1922c4946d79ba6bac82ade352e, user.id=da8d98977ba8478bb69666a438c332ce) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:09.964015 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66a255b-de52-40ad-a59b-f1181e347a56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:09.965543 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66a255b-de52-40ad-a59b-f1181e347a56 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:09.968055 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4720fc4f-e3f4-47c5-803f-51e53159fec1 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:09.979739 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 102/204] 10.222.0.72 () {56 vars in 1374 bytes} [Mon Sep 19 14:43:09 2022] GET /identity/v3/role_assignments?user.id=da8d98977ba8478bb69666a438c332ce&scope.project.id=4a1ea1922c4946d79ba6bac82ade352e&role.id=962ee04d08ae41b08c1a5108c54c7469 => generated 259 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:43:10.019861 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f40ebb7-572f-4699-a23a-5b078dd2f769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:10.020627 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f40ebb7-572f-4699-a23a-5b078dd2f769 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:10.020903 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f40ebb7-572f-4699-a23a-5b078dd2f769 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:10.021179 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f40ebb7-572f-4699-a23a-5b078dd2f769 None admin] PATH_INFO: `/v3/users/db1fbe7fb6434d6581e75c1b73484d3e` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:10.022310 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f40ebb7-572f-4699-a23a-5b078dd2f769 None admin] RBAC: Authorizing `identity:get_user(user_id=db1fbe7fb6434d6581e75c1b73484d3e)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:10.023740 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f40ebb7-572f-4699-a23a-5b078dd2f769 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:10.026766 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 103/205] 10.222.0.72 () {56 vars in 1177 bytes} [Mon Sep 19 14:43:09 2022] GET /identity/v3/users/db1fbe7fb6434d6581e75c1b73484d3e => generated 289 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:10.031571 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66a255b-de52-40ad-a59b-f1181e347a56 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:10.186099 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66a255b-de52-40ad-a59b-f1181e347a56 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:10.234194 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3537d0-f33c-4a3b-b137-babcca494fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:10.234812 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3537d0-f33c-4a3b-b137-babcca494fc5 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:10.235088 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3537d0-f33c-4a3b-b137-babcca494fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:10.235356 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3537d0-f33c-4a3b-b137-babcca494fc5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:10.238085 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:10.327795 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3537d0-f33c-4a3b-b137-babcca494fc5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:10.329849 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3537d0-f33c-4a3b-b137-babcca494fc5 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:10.479937 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 103/206] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Sep 19 14:43:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 14:43:10.485789 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f40ebb7-572f-4699-a23a-5b078dd2f769 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:10.594589 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:10.649566 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f40ebb7-572f-4699-a23a-5b078dd2f769 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:10.697048 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6605f8-d702-4a5e-809f-2e267c2c8baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:10.697684 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6605f8-d702-4a5e-809f-2e267c2c8baa None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:10.697965 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6605f8-d702-4a5e-809f-2e267c2c8baa None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:10.698235 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6605f8-d702-4a5e-809f-2e267c2c8baa None admin] PATH_INFO: `/v3/projects/f2d0f3b33b264908b42ee8c76c5527f3` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:10.705010 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6605f8-d702-4a5e-809f-2e267c2c8baa None admin] RBAC: Authorizing `identity:get_project(project_id=f2d0f3b33b264908b42ee8c76c5527f3)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:10.706501 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6605f8-d702-4a5e-809f-2e267c2c8baa None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:10.708497 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 104/207] 10.222.0.72 () {56 vars in 1186 bytes} [Mon Sep 19 14:43:10 2022] GET /identity/v3/projects/f2d0f3b33b264908b42ee8c76c5527f3 => generated 298 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:10.714278 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3537d0-f33c-4a3b-b137-babcca494fc5 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:10.759628 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:10.832355 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3537d0-f33c-4a3b-b137-babcca494fc5 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:10.870395 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4827897-9602-4837-bac5-a3911e82079f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:10.871294 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4827897-9602-4837-bac5-a3911e82079f None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:10.871712 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4827897-9602-4837-bac5-a3911e82079f None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:10.872056 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4827897-9602-4837-bac5-a3911e82079f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:10.872900 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4827897-9602-4837-bac5-a3911e82079f None admin] RBAC: Adding query filter params (role.id=dc1fc2b7f53a4f1084d0ecf5473f9dce, scope.project.id=f2d0f3b33b264908b42ee8c76c5527f3, user.id=db1fbe7fb6434d6581e75c1b73484d3e) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:10.873213 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4827897-9602-4837-bac5-a3911e82079f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:10.874673 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4827897-9602-4837-bac5-a3911e82079f None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:10.881494 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 104/208] 10.222.0.72 () {56 vars in 1374 bytes} [Mon Sep 19 14:43:10 2022] GET /identity/v3/role_assignments?user.id=db1fbe7fb6434d6581e75c1b73484d3e&scope.project.id=f2d0f3b33b264908b42ee8c76c5527f3&role.id=dc1fc2b7f53a4f1084d0ecf5473f9dce => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:11.492541 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c335998-87f2-4f6f-b0a7-57d7bfea1465 None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:11.493068 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c335998-87f2-4f6f-b0a7-57d7bfea1465 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:11.493068 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c335998-87f2-4f6f-b0a7-57d7bfea1465 None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:11.494420 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 105/209] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:43:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:43:11.500459 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf0d10-8299-463d-a57f-d1469aa38db4 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:11.500749 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf0d10-8299-463d-a57f-d1469aa38db4 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:11.501026 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf0d10-8299-463d-a57f-d1469aa38db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:11.524681 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-65cf0d10-8299-463d-a57f-d1469aa38db4 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:43:11.525884 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-65cf0d10-8299-463d-a57f-d1469aa38db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:43:11.607752 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 105/210] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:43:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:43:11.829537 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a212d2e9-1aef-4efa-8c3a-63840efff3e2 None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:11.829872 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a212d2e9-1aef-4efa-8c3a-63840efff3e2 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:11.830064 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a212d2e9-1aef-4efa-8c3a-63840efff3e2 None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:11.831615 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 106/211] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:43:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:43:11.836830 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257176a1-fbae-4469-97d9-fa731ecaaa3d None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:11.837655 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257176a1-fbae-4469-97d9-fa731ecaaa3d None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:11.838119 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257176a1-fbae-4469-97d9-fa731ecaaa3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:11.853375 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082028bc-7680-4554-942d-7034a3d08248 None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:11.853659 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082028bc-7680-4554-942d-7034a3d08248 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:11.854180 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082028bc-7680-4554-942d-7034a3d08248 None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:11.856486 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 107/212] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:43:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 14:43:11.858171 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-257176a1-fbae-4469-97d9-fa731ecaaa3d None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:43:11.859335 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-257176a1-fbae-4469-97d9-fa731ecaaa3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:43:11.862178 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495e7087-8a1e-4c98-acab-f9ff078770d0 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:11.862677 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495e7087-8a1e-4c98-acab-f9ff078770d0 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:11.863153 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495e7087-8a1e-4c98-acab-f9ff078770d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:11.881773 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-495e7087-8a1e-4c98-acab-f9ff078770d0 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:43:11.883287 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-495e7087-8a1e-4c98-acab-f9ff078770d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:43:11.888115 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:11.944729 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 106/213] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:43:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 14:43:11.945588 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257176a1-fbae-4469-97d9-fa731ecaaa3d None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:11.965241 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 108/214] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:43:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:43:12.057344 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257176a1-fbae-4469-97d9-fa731ecaaa3d None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:12.097393 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55d1c74-246b-4dd8-b216-9c4346bc7e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:12.098331 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d1c74-246b-4dd8-b216-9c4346bc7e4c None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:12.098829 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d1c74-246b-4dd8-b216-9c4346bc7e4c None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:12.099299 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d1c74-246b-4dd8-b216-9c4346bc7e4c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:12.100657 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55d1c74-246b-4dd8-b216-9c4346bc7e4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:12.102380 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55d1c74-246b-4dd8-b216-9c4346bc7e4c None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:12.104203 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 107/215] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:43:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:12.110286 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495e7087-8a1e-4c98-acab-f9ff078770d0 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:12.167623 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:12.213291 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495e7087-8a1e-4c98-acab-f9ff078770d0 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:12.229363 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55d1c74-246b-4dd8-b216-9c4346bc7e4c None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:12.261061 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629aa959-f376-4e3c-b832-2c20a95abd98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:12.262178 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629aa959-f376-4e3c-b832-2c20a95abd98 None admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:12.262762 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629aa959-f376-4e3c-b832-2c20a95abd98 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:12.263040 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629aa959-f376-4e3c-b832-2c20a95abd98 None admin] PATH_INFO: `/v3/users` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:12.263715 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629aa959-f376-4e3c-b832-2c20a95abd98 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:12.264113 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:12.265211 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629aa959-f376-4e3c-b832-2c20a95abd98 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:12.288165 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 109/216] 10.222.0.72 () {60 vars in 1132 bytes} [Mon Sep 19 14:43:12 2022] POST /identity/v3/users => generated 297 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:43:12.289216 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629aa959-f376-4e3c-b832-2c20a95abd98 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:12.388084 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55d1c74-246b-4dd8-b216-9c4346bc7e4c None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:12.411006 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629aa959-f376-4e3c-b832-2c20a95abd98 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:12.431648 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:12.444823 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56462826-6ad4-4758-aa10-bd49797ef3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:12.445851 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56462826-6ad4-4758-aa10-bd49797ef3d9 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:12.446362 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56462826-6ad4-4758-aa10-bd49797ef3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:12.446834 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56462826-6ad4-4758-aa10-bd49797ef3d9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:12.459249 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56462826-6ad4-4758-aa10-bd49797ef3d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:43:12.463370 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6db8a99-e085-414e-9e62-0558e9bafa26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:12.464026 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db8a99-e085-414e-9e62-0558e9bafa26 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:12.464308 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db8a99-e085-414e-9e62-0558e9bafa26 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:12.465149 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db8a99-e085-414e-9e62-0558e9bafa26 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:12.466111 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-56462826-6ad4-4758-aa10-bd49797ef3d9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 14:43:12.466111 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:12.466111 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:43:12.466111 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:43:12.466111 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:43:12.466111 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:43:12.466111 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:43:12.466111 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:43:12.466111 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:43:12.466111 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:43:12.466111 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:43:12.466111 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:43:12.466111 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:43:12.466111 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:43:12.466111 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:43:12.466111 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:43:12.466955 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:43:12.466955 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:43:12.466955 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:43:12.466955 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:43:12.466955 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:43:12.466955 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:43:12.466955 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:43:12.466955 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:43:12.466955 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:43:12.466955 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:43:12.466955 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:43:12.466955 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:43:12.466955 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:43:12.466955 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:43:12.466955 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:43:12.466955 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:43:12.467843 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:43:12.467843 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:43:12.467843 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:43:12.467843 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:43:12.467843 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:43:12.467843 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:43:12.467843 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:43:12.467843 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:43:12.467843 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:43:12.467843 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:43:12.467843 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 14:43:12.467843 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:43:12.470230 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 108/217] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Sep 19 14:43:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:43:12.476268 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56462826-6ad4-4758-aa10-bd49797ef3d9 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:12.477219 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6db8a99-e085-414e-9e62-0558e9bafa26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:43:12.484078 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-b6db8a99-e085-414e-9e62-0558e9bafa26 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:43:12.484078 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:12.484078 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:43:12.484078 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:43:12.484078 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:43:12.484078 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:43:12.484078 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:43:12.484078 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:43:12.484078 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:43:12.484078 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:43:12.484078 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:43:12.484078 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:43:12.484078 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:43:12.484078 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:43:12.484078 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:43:12.484078 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:43:12.485022 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:43:12.485022 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:43:12.485022 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:43:12.485022 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:43:12.485022 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:43:12.485022 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:43:12.485022 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:43:12.485022 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:43:12.485022 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:43:12.485022 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:43:12.485022 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:43:12.485022 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:43:12.485022 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:43:12.485022 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:43:12.485022 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:43:12.485022 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:43:12.485812 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:43:12.485812 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:43:12.485812 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:43:12.485812 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:43:12.485812 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:43:12.485812 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:43:12.485812 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:43:12.485812 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:43:12.485812 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:43:12.485812 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:43:12.485812 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:43:12.485812 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:43:12.486420 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 110/218] 10.222.0.72 () {56 vars in 1096 bytes} [Mon Sep 19 14:43:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:43:12.492246 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6db8a99-e085-414e-9e62-0558e9bafa26 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:12.593358 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:12.613067 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56462826-6ad4-4758-aa10-bd49797ef3d9 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:12.617254 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6db8a99-e085-414e-9e62-0558e9bafa26 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:12.659300 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49f46d3-4841-4d0e-869d-e8c43df79ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:12.660447 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f46d3-4841-4d0e-869d-e8c43df79ee8 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:12.660743 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f46d3-4841-4d0e-869d-e8c43df79ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:12.660931 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f46d3-4841-4d0e-869d-e8c43df79ee8 None admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:12.661606 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49f46d3-4841-4d0e-869d-e8c43df79ee8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:12.661980 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49f46d3-4841-4d0e-869d-e8c43df79ee8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:12.662588 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31748b4-eadf-4d02-ab6f-95d726c2e0dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:12.663189 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31748b4-eadf-4d02-ab6f-95d726c2e0dd None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:12.663285 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49f46d3-4841-4d0e-869d-e8c43df79ee8 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:12.663467 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31748b4-eadf-4d02-ab6f-95d726c2e0dd None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:12.663737 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31748b4-eadf-4d02-ab6f-95d726c2e0dd None admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:12.664430 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31748b4-eadf-4d02-ab6f-95d726c2e0dd None admin] RBAC: Adding query filter params (name=member) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:12.664914 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31748b4-eadf-4d02-ab6f-95d726c2e0dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:12.666297 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31748b4-eadf-4d02-ab6f-95d726c2e0dd None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:12.674448 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 111/219] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Sep 19 14:43:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:43:12.675709 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db596000-e3dc-4fb2-b039-f75ba724bc2d None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:12.675998 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db596000-e3dc-4fb2-b039-f75ba724bc2d None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:12.676275 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db596000-e3dc-4fb2-b039-f75ba724bc2d None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:12.677230 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 109/220] 10.222.0.72 () {56 vars in 1101 bytes} [Mon Sep 19 14:43:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:43:12.681908 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 112/221] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:43:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:43:12.682048 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31748b4-eadf-4d02-ab6f-95d726c2e0dd None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:12.685115 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db596000-e3dc-4fb2-b039-f75ba724bc2d None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:12.726735 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:12.805859 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31748b4-eadf-4d02-ab6f-95d726c2e0dd None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:12.828543 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db596000-e3dc-4fb2-b039-f75ba724bc2d None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:12.853259 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50b1a41-2825-4537-a8d1-9c188388d33f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:12.853895 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50b1a41-2825-4537-a8d1-9c188388d33f None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:12.854181 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50b1a41-2825-4537-a8d1-9c188388d33f None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:12.854461 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50b1a41-2825-4537-a8d1-9c188388d33f None admin] PATH_INFO: `/v3/users/da8d98977ba8478bb69666a438c332ce` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:12.856571 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50b1a41-2825-4537-a8d1-9c188388d33f None admin] RBAC: Authorizing `identity:get_user(user_id=da8d98977ba8478bb69666a438c332ce)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:12.858652 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50b1a41-2825-4537-a8d1-9c188388d33f None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:12.861008 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 110/222] 10.222.0.72 () {56 vars in 1177 bytes} [Mon Sep 19 14:43:12 2022] GET /identity/v3/users/da8d98977ba8478bb69666a438c332ce => generated 283 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:43:12.862483 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9779109d-1c22-4ea2-91c9-74aa41b06781 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:12.863351 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9779109d-1c22-4ea2-91c9-74aa41b06781 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:12.863639 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9779109d-1c22-4ea2-91c9-74aa41b06781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:12.868423 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19955fc1-8d12-4d0f-a609-ae72bdd98c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:12.869406 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19955fc1-8d12-4d0f-a609-ae72bdd98c3d None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:12.869903 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19955fc1-8d12-4d0f-a609-ae72bdd98c3d None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:12.870369 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19955fc1-8d12-4d0f-a609-ae72bdd98c3d None admin] PATH_INFO: `/v3/users/255e7aed5b7a42e49ba97be1a3aebe82` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:12.889474 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-9779109d-1c22-4ea2-91c9-74aa41b06781 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:43:12.889474 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-9779109d-1c22-4ea2-91c9-74aa41b06781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:43:12.896625 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19955fc1-8d12-4d0f-a609-ae72bdd98c3d None admin] RBAC: Authorizing `identity:get_user(user_id=255e7aed5b7a42e49ba97be1a3aebe82)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:12.898567 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19955fc1-8d12-4d0f-a609-ae72bdd98c3d None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:12.900903 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:12.901125 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 113/223] 10.222.0.72 () {56 vars in 1177 bytes} [Mon Sep 19 14:43:12 2022] GET /identity/v3/users/255e7aed5b7a42e49ba97be1a3aebe82 => generated 297 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:12.902199 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19955fc1-8d12-4d0f-a609-ae72bdd98c3d None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:12.981721 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 111/224] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:43:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:43:12.988789 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9779109d-1c22-4ea2-91c9-74aa41b06781 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:13.004761 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:13.011702 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19955fc1-8d12-4d0f-a609-ae72bdd98c3d None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:13.067230 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abc663b-e086-4ff4-9d55-e614c466a803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:13.068226 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abc663b-e086-4ff4-9d55-e614c466a803 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:13.068989 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abc663b-e086-4ff4-9d55-e614c466a803 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:13.070499 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abc663b-e086-4ff4-9d55-e614c466a803 None admin] PATH_INFO: `/v3/projects/4a1ea1922c4946d79ba6bac82ade352e` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:13.071901 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abc663b-e086-4ff4-9d55-e614c466a803 None admin] RBAC: Authorizing `identity:get_project(project_id=4a1ea1922c4946d79ba6bac82ade352e)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:13.074894 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abc663b-e086-4ff4-9d55-e614c466a803 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:13.079253 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 114/225] 10.222.0.72 () {56 vars in 1186 bytes} [Mon Sep 19 14:43:12 2022] GET /identity/v3/projects/4a1ea1922c4946d79ba6bac82ade352e => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:13.085033 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abc663b-e086-4ff4-9d55-e614c466a803 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:13.154293 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9779109d-1c22-4ea2-91c9-74aa41b06781 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:13.195864 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef2a8f1-6b7a-4ca9-9e39-3d06e4e098d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:13.197101 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef2a8f1-6b7a-4ca9-9e39-3d06e4e098d8 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:13.197820 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef2a8f1-6b7a-4ca9-9e39-3d06e4e098d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:13.198321 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef2a8f1-6b7a-4ca9-9e39-3d06e4e098d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:13.217797 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:13.295315 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abc663b-e086-4ff4-9d55-e614c466a803 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:13.307212 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef2a8f1-6b7a-4ca9-9e39-3d06e4e098d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:13.308796 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef2a8f1-6b7a-4ca9-9e39-3d06e4e098d8 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:13.346369 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bbb9ab-a425-4060-bcee-338de7b3d6f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:13.347061 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bbb9ab-a425-4060-bcee-338de7b3d6f3 None admin] REQUEST_METHOD: `PUT` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:13.347346 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bbb9ab-a425-4060-bcee-338de7b3d6f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:13.347668 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bbb9ab-a425-4060-bcee-338de7b3d6f3 None admin] PATH_INFO: `/v3/projects/4a1ea1922c4946d79ba6bac82ade352e/users/da8d98977ba8478bb69666a438c332ce/roles/ddb643577b2e4e478100ec370decfaeb` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:13.350424 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bbb9ab-a425-4060-bcee-338de7b3d6f3 None admin] RBAC: Authorizing `identity:create_grant(project_id=4a1ea1922c4946d79ba6bac82ade352e, user_id=da8d98977ba8478bb69666a438c332ce, role_id=ddb643577b2e4e478100ec370decfaeb)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:13.352554 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bbb9ab-a425-4060-bcee-338de7b3d6f3 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:13.371112 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 115/226] 10.222.0.72 () {58 vars in 1439 bytes} [Mon Sep 19 14:43:13 2022] PUT /identity/v3/projects/4a1ea1922c4946d79ba6bac82ade352e/users/da8d98977ba8478bb69666a438c332ce/roles/ddb643577b2e4e478100ec370decfaeb => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:43:13.372367 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bbb9ab-a425-4060-bcee-338de7b3d6f3 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:13.397608 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:13.457899 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 112/227] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Sep 19 14:43:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 14:43:13.467150 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef2a8f1-6b7a-4ca9-9e39-3d06e4e098d8 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:13.537292 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:13.543205 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bbb9ab-a425-4060-bcee-338de7b3d6f3 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:13.619588 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6646b2f-5414-4ea0-a633-cc4f7b608a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:13.621155 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6646b2f-5414-4ea0-a633-cc4f7b608a5a None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:13.621583 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6646b2f-5414-4ea0-a633-cc4f7b608a5a None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:13.622023 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6646b2f-5414-4ea0-a633-cc4f7b608a5a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:13.625981 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef2a8f1-6b7a-4ca9-9e39-3d06e4e098d8 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:13.636506 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6646b2f-5414-4ea0-a633-cc4f7b608a5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:43:13.642335 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-c6646b2f-5414-4ea0-a633-cc4f7b608a5a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 14:43:13.642335 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:13.642335 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:43:13.642335 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:43:13.642335 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:43:13.642335 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:43:13.642335 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:43:13.642335 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:43:13.642335 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:43:13.642335 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:43:13.642335 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:43:13.642335 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:43:13.642335 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:43:13.642335 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:43:13.642335 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:43:13.642335 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:43:13.643407 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:43:13.643407 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:43:13.643407 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:43:13.643407 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:43:13.643407 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:43:13.643407 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:43:13.643407 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:43:13.643407 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:43:13.643407 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:43:13.643407 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:43:13.643407 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:43:13.643407 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:43:13.643407 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:43:13.643407 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:43:13.643407 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:43:13.643407 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:43:13.644392 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:43:13.644392 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:43:13.644392 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:43:13.644392 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:43:13.644392 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:43:13.644392 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:43:13.644392 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:43:13.644392 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:43:13.644392 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:43:13.644392 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:43:13.644392 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 14:43:13.644392 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:43:13.646401 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 116/228] 10.222.0.72 () {56 vars in 1114 bytes} [Mon Sep 19 14:43:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:43:13.653454 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6646b2f-5414-4ea0-a633-cc4f7b608a5a None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:13.685757 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1836b08-a7ad-462f-9683-b065d5880ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:13.686636 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1836b08-a7ad-462f-9683-b065d5880ba7 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:13.687061 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1836b08-a7ad-462f-9683-b065d5880ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:13.687502 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1836b08-a7ad-462f-9683-b065d5880ba7 None admin] PATH_INFO: `/v3/projects/4a1ea1922c4946d79ba6bac82ade352e` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:13.690214 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1836b08-a7ad-462f-9683-b065d5880ba7 None admin] RBAC: Authorizing `identity:get_project(project_id=4a1ea1922c4946d79ba6bac82ade352e)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:13.691809 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1836b08-a7ad-462f-9683-b065d5880ba7 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:13.695539 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 113/229] 10.222.0.72 () {56 vars in 1186 bytes} [Mon Sep 19 14:43:13 2022] GET /identity/v3/projects/4a1ea1922c4946d79ba6bac82ade352e => generated 302 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:13.702334 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1836b08-a7ad-462f-9683-b065d5880ba7 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:13.764527 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:13.788381 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6646b2f-5414-4ea0-a633-cc4f7b608a5a None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:13.837612 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26f965b-d15b-4100-b91f-1a050c563254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:13.838475 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26f965b-d15b-4100-b91f-1a050c563254 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:13.838922 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26f965b-d15b-4100-b91f-1a050c563254 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:13.839945 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26f965b-d15b-4100-b91f-1a050c563254 None admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:13.840790 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26f965b-d15b-4100-b91f-1a050c563254 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:13.841272 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26f965b-d15b-4100-b91f-1a050c563254 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:13.842792 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26f965b-d15b-4100-b91f-1a050c563254 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:13.852057 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 117/230] 10.222.0.72 () {56 vars in 1111 bytes} [Mon Sep 19 14:43:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:13.857520 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26f965b-d15b-4100-b91f-1a050c563254 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:13.875110 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1836b08-a7ad-462f-9683-b065d5880ba7 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:13.906552 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:13.953114 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb473838-923c-4552-ac2c-fb2c80c87c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:13.953788 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb473838-923c-4552-ac2c-fb2c80c87c6c None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:13.954077 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb473838-923c-4552-ac2c-fb2c80c87c6c None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:13.954353 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb473838-923c-4552-ac2c-fb2c80c87c6c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:13.955094 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb473838-923c-4552-ac2c-fb2c80c87c6c None admin] RBAC: Adding query filter params (role.id=efa0e5b3413748dc828a89b12d67df79, scope.project.id=4a1ea1922c4946d79ba6bac82ade352e, user.id=255e7aed5b7a42e49ba97be1a3aebe82) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:13.955401 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb473838-923c-4552-ac2c-fb2c80c87c6c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:13.956891 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb473838-923c-4552-ac2c-fb2c80c87c6c None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:13.969549 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 114/231] 10.222.0.72 () {56 vars in 1374 bytes} [Mon Sep 19 14:43:13 2022] GET /identity/v3/role_assignments?user.id=255e7aed5b7a42e49ba97be1a3aebe82&scope.project.id=4a1ea1922c4946d79ba6bac82ade352e&role.id=efa0e5b3413748dc828a89b12d67df79 => generated 259 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:14.014828 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26f965b-d15b-4100-b91f-1a050c563254 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:14.075705 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d46eea-4cad-4da5-a553-538343503f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:14.076374 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d46eea-4cad-4da5-a553-538343503f8d None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:14.076662 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d46eea-4cad-4da5-a553-538343503f8d None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:14.076933 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d46eea-4cad-4da5-a553-538343503f8d None admin] PATH_INFO: `/v3/users/da8d98977ba8478bb69666a438c332ce` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:14.081142 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d46eea-4cad-4da5-a553-538343503f8d None admin] RBAC: Authorizing `identity:get_user(user_id=da8d98977ba8478bb69666a438c332ce)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:14.082688 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d46eea-4cad-4da5-a553-538343503f8d None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:14.084759 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 118/232] 10.222.0.72 () {56 vars in 1177 bytes} [Mon Sep 19 14:43:13 2022] GET /identity/v3/users/da8d98977ba8478bb69666a438c332ce => generated 283 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:14.090871 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb473838-923c-4552-ac2c-fb2c80c87c6c None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:14.231244 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb473838-923c-4552-ac2c-fb2c80c87c6c None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:14.266847 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4466d2ae-2595-4395-b6ea-b2dd666eb26c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:14.267409 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4466d2ae-2595-4395-b6ea-b2dd666eb26c None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:14.267692 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4466d2ae-2595-4395-b6ea-b2dd666eb26c None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:14.267969 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4466d2ae-2595-4395-b6ea-b2dd666eb26c None admin] PATH_INFO: `/v3/projects/4a1ea1922c4946d79ba6bac82ade352e` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:14.269128 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4466d2ae-2595-4395-b6ea-b2dd666eb26c None admin] RBAC: Authorizing `identity:get_project(project_id=4a1ea1922c4946d79ba6bac82ade352e)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:14.270583 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4466d2ae-2595-4395-b6ea-b2dd666eb26c None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:14.272292 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 115/233] 10.222.0.72 () {56 vars in 1186 bytes} [Mon Sep 19 14:43:14 2022] GET /identity/v3/projects/4a1ea1922c4946d79ba6bac82ade352e => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:14.278569 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d46eea-4cad-4da5-a553-538343503f8d None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:14.291932 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:14.386739 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d46eea-4cad-4da5-a553-538343503f8d None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:14.422045 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8e00b4-2c7e-4df6-94dc-9d0d00a89cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:14.422765 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8e00b4-2c7e-4df6-94dc-9d0d00a89cef None admin] REQUEST_METHOD: `PUT` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:14.423048 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8e00b4-2c7e-4df6-94dc-9d0d00a89cef None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:14.423321 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8e00b4-2c7e-4df6-94dc-9d0d00a89cef None admin] PATH_INFO: `/v3/projects/4a1ea1922c4946d79ba6bac82ade352e/users/da8d98977ba8478bb69666a438c332ce/roles/962ee04d08ae41b08c1a5108c54c7469` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:14.429687 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8e00b4-2c7e-4df6-94dc-9d0d00a89cef None admin] RBAC: Authorizing `identity:create_grant(project_id=4a1ea1922c4946d79ba6bac82ade352e, user_id=da8d98977ba8478bb69666a438c332ce, role_id=962ee04d08ae41b08c1a5108c54c7469)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:14.431400 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8e00b4-2c7e-4df6-94dc-9d0d00a89cef None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:14.454292 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 119/234] 10.222.0.72 () {58 vars in 1439 bytes} [Mon Sep 19 14:43:14 2022] PUT /identity/v3/projects/4a1ea1922c4946d79ba6bac82ade352e/users/da8d98977ba8478bb69666a438c332ce/roles/962ee04d08ae41b08c1a5108c54c7469 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:43:15.055272 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc4ddde-a334-4aa8-b236-6cd574e209b3 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:15.056044 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc4ddde-a334-4aa8-b236-6cd574e209b3 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:15.056044 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc4ddde-a334-4aa8-b236-6cd574e209b3 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:15.057659 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 116/235] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:43:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:43:15.067811 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab6e079-58e7-4fc1-a388-4c170b627ed9 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:15.068259 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab6e079-58e7-4fc1-a388-4c170b627ed9 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:15.068376 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab6e079-58e7-4fc1-a388-4c170b627ed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:15.091373 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92965b0a-c265-4d20-888f-195f167f3f11 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:15.091697 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92965b0a-c265-4d20-888f-195f167f3f11 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:15.091922 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92965b0a-c265-4d20-888f-195f167f3f11 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:15.093482 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-aab6e079-58e7-4fc1-a388-4c170b627ed9 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:43:15.093643 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 117/236] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:43:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:43:15.094669 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-aab6e079-58e7-4fc1-a388-4c170b627ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:43:15.099032 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3de147-9a0e-4ad6-bac1-36b4e3d73b3f None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:15.099361 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3de147-9a0e-4ad6-bac1-36b4e3d73b3f None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:15.099704 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3de147-9a0e-4ad6-bac1-36b4e3d73b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:15.139546 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-4d3de147-9a0e-4ad6-bac1-36b4e3d73b3f None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:43:15.142011 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-4d3de147-9a0e-4ad6-bac1-36b4e3d73b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:43:15.219291 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 120/237] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:43:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:43:15.219964 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:15.235640 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:15.269071 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 118/238] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:43:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 14:43:15.622451 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab6e079-58e7-4fc1-a388-4c170b627ed9 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:15.659727 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3de147-9a0e-4ad6-bac1-36b4e3d73b3f None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:15.799345 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab6e079-58e7-4fc1-a388-4c170b627ed9 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:15.847224 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3de147-9a0e-4ad6-bac1-36b4e3d73b3f None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:15.864675 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3ac8ea-4e93-4d9b-ab23-73e627409620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:15.865316 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3ac8ea-4e93-4d9b-ab23-73e627409620 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:15.865597 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3ac8ea-4e93-4d9b-ab23-73e627409620 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:15.865870 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3ac8ea-4e93-4d9b-ab23-73e627409620 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:15.868142 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3ac8ea-4e93-4d9b-ab23-73e627409620 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:15.869617 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3ac8ea-4e93-4d9b-ab23-73e627409620 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:15.873012 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 121/239] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:43:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:15.881218 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3ac8ea-4e93-4d9b-ab23-73e627409620 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:15.914406 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8e1a65-5ea9-48dd-a76c-1626195b66f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:15.915305 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e1a65-5ea9-48dd-a76c-1626195b66f1 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:15.915800 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e1a65-5ea9-48dd-a76c-1626195b66f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:15.916257 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e1a65-5ea9-48dd-a76c-1626195b66f1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:15.938182 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8e1a65-5ea9-48dd-a76c-1626195b66f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:43:15.944760 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-3c8e1a65-5ea9-48dd-a76c-1626195b66f1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 14:43:15.944760 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:15.944760 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:43:15.944760 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:43:15.944760 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:43:15.944760 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:43:15.944760 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:43:15.944760 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:43:15.944760 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:43:15.944760 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:43:15.944760 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:43:15.944760 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:43:15.944760 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:43:15.944760 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:43:15.944760 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:43:15.944760 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:43:15.945697 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:43:15.945697 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:43:15.945697 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:43:15.945697 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:43:15.945697 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:43:15.945697 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:43:15.945697 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:43:15.945697 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:43:15.945697 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:43:15.945697 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:43:15.945697 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:43:15.945697 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:43:15.945697 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:43:15.945697 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:43:15.945697 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:43:15.945697 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:43:15.946469 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:43:15.946469 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:43:15.946469 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:43:15.946469 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:43:15.946469 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:43:15.946469 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:43:15.946469 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:43:15.946469 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:43:15.946469 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:43:15.946469 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:43:15.946469 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 14:43:15.946469 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:43:15.952079 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 119/240] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Sep 19 14:43:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:43:15.959379 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8e1a65-5ea9-48dd-a76c-1626195b66f1 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:16.021490 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:16.028683 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:16.081610 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3ac8ea-4e93-4d9b-ab23-73e627409620 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:16.114429 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8e1a65-5ea9-48dd-a76c-1626195b66f1 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:16.122742 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6fd8e1-24c2-4a73-b852-b7297832606f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:16.124078 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6fd8e1-24c2-4a73-b852-b7297832606f None admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:16.124554 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6fd8e1-24c2-4a73-b852-b7297832606f None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:16.124967 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6fd8e1-24c2-4a73-b852-b7297832606f None admin] PATH_INFO: `/v3/users` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:16.125760 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6fd8e1-24c2-4a73-b852-b7297832606f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:16.128303 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6fd8e1-24c2-4a73-b852-b7297832606f None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:16.154351 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 122/241] 10.222.0.72 () {60 vars in 1132 bytes} [Mon Sep 19 14:43:15 2022] POST /identity/v3/users => generated 293 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:43:16.155889 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1901bfb-f82e-4ee1-937d-9d86eeeb8c64 None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:16.156301 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1901bfb-f82e-4ee1-937d-9d86eeeb8c64 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:16.156784 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1901bfb-f82e-4ee1-937d-9d86eeeb8c64 None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:16.162581 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 123/242] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:43:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:43:16.163622 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66221c3d-6ba9-4517-923c-17cde7c92dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:16.164371 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f172a8-cdcc-4af8-8a86-7127baae9112 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:16.164485 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66221c3d-6ba9-4517-923c-17cde7c92dc6 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:16.164850 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66221c3d-6ba9-4517-923c-17cde7c92dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:16.165043 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f172a8-cdcc-4af8-8a86-7127baae9112 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:16.165293 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66221c3d-6ba9-4517-923c-17cde7c92dc6 None admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:16.165590 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f172a8-cdcc-4af8-8a86-7127baae9112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:16.166146 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66221c3d-6ba9-4517-923c-17cde7c92dc6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:16.166536 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66221c3d-6ba9-4517-923c-17cde7c92dc6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:16.172952 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66221c3d-6ba9-4517-923c-17cde7c92dc6 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:16.186682 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 120/243] 10.222.0.72 () {56 vars in 1101 bytes} [Mon Sep 19 14:43:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:16.189934 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-27f172a8-cdcc-4af8-8a86-7127baae9112 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:43:16.191446 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-27f172a8-cdcc-4af8-8a86-7127baae9112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:43:16.192627 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66221c3d-6ba9-4517-923c-17cde7c92dc6 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:16.268958 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 124/244] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:43:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:43:16.379588 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:16.383533 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66221c3d-6ba9-4517-923c-17cde7c92dc6 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:16.434097 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b602e45b-fa74-4197-96a1-0aad9178efe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:16.434827 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b602e45b-fa74-4197-96a1-0aad9178efe3 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:16.435109 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b602e45b-fa74-4197-96a1-0aad9178efe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:16.435456 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b602e45b-fa74-4197-96a1-0aad9178efe3 None admin] PATH_INFO: `/v3/users/38fa0076fdca498ab2fcc3de27d965af` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:16.455355 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b602e45b-fa74-4197-96a1-0aad9178efe3 None admin] RBAC: Authorizing `identity:get_user(user_id=38fa0076fdca498ab2fcc3de27d965af)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:16.456961 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b602e45b-fa74-4197-96a1-0aad9178efe3 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:16.459704 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 121/245] 10.222.0.72 () {56 vars in 1177 bytes} [Mon Sep 19 14:43:16 2022] GET /identity/v3/users/38fa0076fdca498ab2fcc3de27d965af => generated 297 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:16.464631 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f172a8-cdcc-4af8-8a86-7127baae9112 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:16.539676 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:16.561761 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcf8b91-2b51-4b47-b1d0-a35263c1eba0 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:16.562152 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcf8b91-2b51-4b47-b1d0-a35263c1eba0 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:16.562430 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcf8b91-2b51-4b47-b1d0-a35263c1eba0 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:16.563899 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 122/246] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:43:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:43:16.569070 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9366bd98-b521-4795-a4aa-95716efb20c8 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:16.569605 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9366bd98-b521-4795-a4aa-95716efb20c8 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:16.570098 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9366bd98-b521-4795-a4aa-95716efb20c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:16.590492 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f172a8-cdcc-4af8-8a86-7127baae9112 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:16.591705 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-9366bd98-b521-4795-a4aa-95716efb20c8 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:43:16.593188 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-9366bd98-b521-4795-a4aa-95716efb20c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:43:16.634715 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60f227a-b796-41fc-a0bb-f3897f0fecc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:16.635253 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60f227a-b796-41fc-a0bb-f3897f0fecc9 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:16.635530 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60f227a-b796-41fc-a0bb-f3897f0fecc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:16.635804 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60f227a-b796-41fc-a0bb-f3897f0fecc9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:16.678444 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 123/247] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:43:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 14:43:16.681518 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9366bd98-b521-4795-a4aa-95716efb20c8 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:16.725675 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60f227a-b796-41fc-a0bb-f3897f0fecc9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:16.727239 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60f227a-b796-41fc-a0bb-f3897f0fecc9 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:16.779268 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:16.795263 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:16.798068 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9366bd98-b521-4795-a4aa-95716efb20c8 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:16.838512 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0062d9bb-1a93-4603-84b2-246793c3eaed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:16.839214 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0062d9bb-1a93-4603-84b2-246793c3eaed None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:16.840080 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0062d9bb-1a93-4603-84b2-246793c3eaed None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:16.840384 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0062d9bb-1a93-4603-84b2-246793c3eaed None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:16.850468 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 125/248] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Sep 19 14:43:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 14:43:16.855801 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60f227a-b796-41fc-a0bb-f3897f0fecc9 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:16.857163 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0062d9bb-1a93-4603-84b2-246793c3eaed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:43:16.862377 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-0062d9bb-1a93-4603-84b2-246793c3eaed None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:43:16.862377 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:16.862377 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:43:16.862377 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:43:16.862377 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:43:16.862377 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:43:16.862377 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:43:16.862377 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:43:16.862377 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:43:16.862377 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:43:16.862377 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:43:16.862377 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:43:16.862377 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:43:16.862377 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:43:16.862377 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:43:16.862377 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:43:16.863260 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:43:16.863260 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:43:16.863260 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:43:16.863260 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:43:16.863260 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:43:16.863260 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:43:16.863260 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:43:16.863260 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:43:16.863260 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:43:16.863260 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:43:16.863260 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:43:16.863260 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:43:16.863260 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:43:16.863260 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:43:16.863260 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:43:16.863260 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:43:16.864525 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:43:16.864525 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:43:16.864525 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:43:16.864525 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:43:16.864525 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:43:16.864525 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:43:16.864525 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:43:16.864525 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:43:16.864525 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:43:16.864525 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:43:16.864525 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:43:16.864525 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:43:16.864525 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 124/249] 10.222.0.72 () {56 vars in 1096 bytes} [Mon Sep 19 14:43:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:43:16.875874 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0062d9bb-1a93-4603-84b2-246793c3eaed None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:16.968816 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60f227a-b796-41fc-a0bb-f3897f0fecc9 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:17.009698 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614f7139-d5aa-40e6-ada6-3c54e3d9b63b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:17.009924 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0062d9bb-1a93-4603-84b2-246793c3eaed None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:17.010854 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614f7139-d5aa-40e6-ada6-3c54e3d9b63b None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:17.011482 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614f7139-d5aa-40e6-ada6-3c54e3d9b63b None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:17.011951 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614f7139-d5aa-40e6-ada6-3c54e3d9b63b None admin] PATH_INFO: `/v3/projects/4a1ea1922c4946d79ba6bac82ade352e` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:17.013551 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614f7139-d5aa-40e6-ada6-3c54e3d9b63b None admin] RBAC: Authorizing `identity:get_project(project_id=4a1ea1922c4946d79ba6bac82ade352e)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:17.015363 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614f7139-d5aa-40e6-ada6-3c54e3d9b63b None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:17.017787 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 126/250] 10.222.0.72 () {56 vars in 1186 bytes} [Mon Sep 19 14:43:16 2022] GET /identity/v3/projects/4a1ea1922c4946d79ba6bac82ade352e => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:17.019006 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614f7139-d5aa-40e6-ada6-3c54e3d9b63b None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:17.046963 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:17.060367 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43fc5d2-cd8a-417b-a318-61d4b39860a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:17.060367 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43fc5d2-cd8a-417b-a318-61d4b39860a4 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:17.060367 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43fc5d2-cd8a-417b-a318-61d4b39860a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:17.060367 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43fc5d2-cd8a-417b-a318-61d4b39860a4 None admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:17.060891 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43fc5d2-cd8a-417b-a318-61d4b39860a4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:17.061220 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43fc5d2-cd8a-417b-a318-61d4b39860a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:17.062570 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43fc5d2-cd8a-417b-a318-61d4b39860a4 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:17.071875 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 125/251] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Sep 19 14:43:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:17.075217 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43fc5d2-cd8a-417b-a318-61d4b39860a4 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:17.084806 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:17.154569 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614f7139-d5aa-40e6-ada6-3c54e3d9b63b None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:17.200603 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9566a8ed-f030-4695-8b80-75006acaa271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:17.201303 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9566a8ed-f030-4695-8b80-75006acaa271 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:17.201676 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9566a8ed-f030-4695-8b80-75006acaa271 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:17.202041 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9566a8ed-f030-4695-8b80-75006acaa271 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:17.202279 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43fc5d2-cd8a-417b-a318-61d4b39860a4 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:17.214744 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9566a8ed-f030-4695-8b80-75006acaa271 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:43:17.220284 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-9566a8ed-f030-4695-8b80-75006acaa271 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 14:43:17.220284 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:17.220284 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:43:17.220284 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:43:17.220284 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:43:17.220284 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:43:17.220284 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:43:17.220284 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:43:17.220284 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:43:17.220284 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:43:17.220284 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:43:17.220284 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:43:17.220284 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:43:17.220284 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:43:17.220284 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:43:17.220284 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:43:17.221192 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:43:17.221192 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:43:17.221192 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:43:17.221192 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:43:17.221192 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:43:17.221192 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:43:17.221192 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:43:17.221192 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:43:17.221192 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:43:17.221192 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:43:17.221192 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:43:17.221192 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:43:17.221192 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:43:17.221192 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:43:17.221192 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:43:17.221192 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:43:17.221966 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:43:17.221966 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:43:17.221966 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:43:17.221966 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:43:17.221966 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:43:17.221966 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:43:17.221966 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:43:17.221966 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:43:17.221966 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:43:17.221966 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:43:17.221966 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 14:43:17.221966 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:43:17.224263 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 127/252] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Sep 19 14:43:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:43:17.225268 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9566a8ed-f030-4695-8b80-75006acaa271 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:17.246711 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cef847c-88bb-4a96-9425-aba39b26c65c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:17.247350 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef847c-88bb-4a96-9425-aba39b26c65c None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:17.247771 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef847c-88bb-4a96-9425-aba39b26c65c None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:17.248056 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef847c-88bb-4a96-9425-aba39b26c65c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:17.248807 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cef847c-88bb-4a96-9425-aba39b26c65c None admin] RBAC: Adding query filter params (role.id=dc1fc2b7f53a4f1084d0ecf5473f9dce, scope.project.id=4a1ea1922c4946d79ba6bac82ade352e, user.id=38fa0076fdca498ab2fcc3de27d965af) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:17.249501 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cef847c-88bb-4a96-9425-aba39b26c65c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:17.251269 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cef847c-88bb-4a96-9425-aba39b26c65c None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:17.258149 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 126/253] 10.222.0.72 () {56 vars in 1374 bytes} [Mon Sep 19 14:43:17 2022] GET /identity/v3/role_assignments?user.id=38fa0076fdca498ab2fcc3de27d965af&scope.project.id=4a1ea1922c4946d79ba6bac82ade352e&role.id=dc1fc2b7f53a4f1084d0ecf5473f9dce => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:17.266683 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47b2bc3-eadc-4609-a2b0-87852ef0ee85 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:17.267578 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47b2bc3-eadc-4609-a2b0-87852ef0ee85 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:17.268837 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47b2bc3-eadc-4609-a2b0-87852ef0ee85 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:17.270647 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 127/254] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:43:17 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:43:17.273273 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47b2bc3-eadc-4609-a2b0-87852ef0ee85 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:17.371638 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:17.394585 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9566a8ed-f030-4695-8b80-75006acaa271 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:17.437149 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0735ec91-ee67-4fad-bab3-96579f4788a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:17.439168 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0735ec91-ee67-4fad-bab3-96579f4788a8 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:17.439726 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0735ec91-ee67-4fad-bab3-96579f4788a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:17.440437 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0735ec91-ee67-4fad-bab3-96579f4788a8 None admin] PATH_INFO: `/v3/users/da8d98977ba8478bb69666a438c332ce` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:17.443334 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0735ec91-ee67-4fad-bab3-96579f4788a8 None admin] RBAC: Authorizing `identity:get_user(user_id=da8d98977ba8478bb69666a438c332ce)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:17.447115 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0735ec91-ee67-4fad-bab3-96579f4788a8 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:17.451260 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 128/255] 10.222.0.72 () {56 vars in 1177 bytes} [Mon Sep 19 14:43:17 2022] GET /identity/v3/users/da8d98977ba8478bb69666a438c332ce => generated 283 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:17.453325 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:17.454978 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0406886d-f324-4ef5-8f9a-0baf26b7b5b9 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:17.459495 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0406886d-f324-4ef5-8f9a-0baf26b7b5b9 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:17.460042 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0406886d-f324-4ef5-8f9a-0baf26b7b5b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:17.488568 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-0406886d-f324-4ef5-8f9a-0baf26b7b5b9 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:43:17.489751 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-0406886d-f324-4ef5-8f9a-0baf26b7b5b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:43:17.541027 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47b2bc3-eadc-4609-a2b0-87852ef0ee85 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:17.574922 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 129/256] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:43:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:43:17.576950 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0406886d-f324-4ef5-8f9a-0baf26b7b5b9 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:17.621138 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceac102-e886-49d1-8ec0-9d7bda518df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:17.621774 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceac102-e886-49d1-8ec0-9d7bda518df6 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:17.622059 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceac102-e886-49d1-8ec0-9d7bda518df6 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:17.622335 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceac102-e886-49d1-8ec0-9d7bda518df6 None admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:17.623114 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceac102-e886-49d1-8ec0-9d7bda518df6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:17.623313 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceac102-e886-49d1-8ec0-9d7bda518df6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:17.624746 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceac102-e886-49d1-8ec0-9d7bda518df6 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:17.654336 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 128/257] 10.222.0.72 () {56 vars in 1101 bytes} [Mon Sep 19 14:43:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:17.663589 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceac102-e886-49d1-8ec0-9d7bda518df6 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:17.709002 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:17.733047 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0406886d-f324-4ef5-8f9a-0baf26b7b5b9 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:17.787031 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6768a930-0bc6-4f99-931b-1ce8c9c5ee05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:17.787873 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6768a930-0bc6-4f99-931b-1ce8c9c5ee05 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:17.788253 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6768a930-0bc6-4f99-931b-1ce8c9c5ee05 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:17.788648 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6768a930-0bc6-4f99-931b-1ce8c9c5ee05 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:17.900441 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6768a930-0bc6-4f99-931b-1ce8c9c5ee05 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:17.902694 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6768a930-0bc6-4f99-931b-1ce8c9c5ee05 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:17.951156 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceac102-e886-49d1-8ec0-9d7bda518df6 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:18.053315 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:18.066342 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 130/258] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Sep 19 14:43:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 14:43:18.071632 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df39b79d-7b0f-479b-b34c-f128a93a367e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:18.072085 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6768a930-0bc6-4f99-931b-1ce8c9c5ee05 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:18.072276 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df39b79d-7b0f-479b-b34c-f128a93a367e None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:18.072577 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df39b79d-7b0f-479b-b34c-f128a93a367e None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:18.072844 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df39b79d-7b0f-479b-b34c-f128a93a367e None admin] PATH_INFO: `/v3/users/255e7aed5b7a42e49ba97be1a3aebe82` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:18.074059 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df39b79d-7b0f-479b-b34c-f128a93a367e None admin] RBAC: Authorizing `identity:get_user(user_id=255e7aed5b7a42e49ba97be1a3aebe82)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:18.075604 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df39b79d-7b0f-479b-b34c-f128a93a367e None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:18.077343 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 129/259] 10.222.0.72 () {56 vars in 1177 bytes} [Mon Sep 19 14:43:17 2022] GET /identity/v3/users/255e7aed5b7a42e49ba97be1a3aebe82 => generated 297 bytes in 414 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:18.084918 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df39b79d-7b0f-479b-b34c-f128a93a367e None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:18.094411 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:18.214301 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6768a930-0bc6-4f99-931b-1ce8c9c5ee05 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:18.256836 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df39b79d-7b0f-479b-b34c-f128a93a367e None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:18.298018 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9117e7d-2521-420a-8e71-9a7237f06351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:18.298652 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9117e7d-2521-420a-8e71-9a7237f06351 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:18.298929 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9117e7d-2521-420a-8e71-9a7237f06351 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:18.299199 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9117e7d-2521-420a-8e71-9a7237f06351 None admin] PATH_INFO: `/v3/projects/4a1ea1922c4946d79ba6bac82ade352e` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:18.300414 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9117e7d-2521-420a-8e71-9a7237f06351 None admin] RBAC: Authorizing `identity:get_project(project_id=4a1ea1922c4946d79ba6bac82ade352e)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:18.302566 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9117e7d-2521-420a-8e71-9a7237f06351 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:18.304266 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 130/260] 10.222.0.72 () {56 vars in 1186 bytes} [Mon Sep 19 14:43:18 2022] GET /identity/v3/projects/4a1ea1922c4946d79ba6bac82ade352e => generated 302 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:18.305146 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9117e7d-2521-420a-8e71-9a7237f06351 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:18.321177 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a342547e-c8bb-42d3-add3-f5e76ffe5c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:18.321833 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a342547e-c8bb-42d3-add3-f5e76ffe5c12 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:18.322121 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a342547e-c8bb-42d3-add3-f5e76ffe5c12 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:18.322399 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a342547e-c8bb-42d3-add3-f5e76ffe5c12 None admin] PATH_INFO: `/v3/projects/4a1ea1922c4946d79ba6bac82ade352e` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:18.323580 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a342547e-c8bb-42d3-add3-f5e76ffe5c12 None admin] RBAC: Authorizing `identity:get_project(project_id=4a1ea1922c4946d79ba6bac82ade352e)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:18.325195 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a342547e-c8bb-42d3-add3-f5e76ffe5c12 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:18.327007 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 131/261] 10.222.0.72 () {56 vars in 1186 bytes} [Mon Sep 19 14:43:18 2022] GET /identity/v3/projects/4a1ea1922c4946d79ba6bac82ade352e => generated 302 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:43:18.327582 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a342547e-c8bb-42d3-add3-f5e76ffe5c12 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:18.390867 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:18.443784 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:18.451915 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9117e7d-2521-420a-8e71-9a7237f06351 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:18.526238 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a342547e-c8bb-42d3-add3-f5e76ffe5c12 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:18.533607 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e612e5f-13e2-4821-ae00-f20f8e1caef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:18.534259 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e612e5f-13e2-4821-ae00-f20f8e1caef4 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:18.534542 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e612e5f-13e2-4821-ae00-f20f8e1caef4 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:18.534817 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e612e5f-13e2-4821-ae00-f20f8e1caef4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:18.554048 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e612e5f-13e2-4821-ae00-f20f8e1caef4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:43:18.559930 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-0e612e5f-13e2-4821-ae00-f20f8e1caef4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 14:43:18.559930 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:18.559930 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:43:18.559930 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:43:18.559930 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:43:18.559930 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:43:18.559930 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:43:18.559930 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:43:18.559930 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:43:18.559930 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:43:18.559930 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:43:18.559930 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:43:18.559930 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:43:18.559930 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:43:18.559930 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:43:18.559930 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:43:18.560805 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:43:18.560805 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:43:18.560805 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:43:18.560805 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:43:18.560805 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:43:18.560805 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:43:18.560805 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:43:18.560805 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:43:18.560805 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:43:18.560805 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:43:18.560805 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:43:18.560805 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:43:18.560805 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:43:18.560805 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:43:18.560805 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:43:18.560805 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:43:18.561588 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:43:18.561588 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:43:18.561588 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:43:18.561588 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:43:18.561588 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:43:18.561588 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:43:18.561588 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:43:18.561588 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:43:18.561588 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:43:18.561588 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:43:18.561588 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 14:43:18.561588 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:43:18.561588 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 131/262] 10.222.0.72 () {56 vars in 1114 bytes} [Mon Sep 19 14:43:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:43:18.562228 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e612e5f-13e2-4821-ae00-f20f8e1caef4 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:18.569772 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8b8526-a8c0-46e7-b414-cfecb78fb3fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:18.571302 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8b8526-a8c0-46e7-b414-cfecb78fb3fe None admin] REQUEST_METHOD: `PUT` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:18.571582 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8b8526-a8c0-46e7-b414-cfecb78fb3fe None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:18.571852 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8b8526-a8c0-46e7-b414-cfecb78fb3fe None admin] PATH_INFO: `/v3/projects/4a1ea1922c4946d79ba6bac82ade352e/users/255e7aed5b7a42e49ba97be1a3aebe82/roles/efa0e5b3413748dc828a89b12d67df79` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:18.573894 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8b8526-a8c0-46e7-b414-cfecb78fb3fe None admin] RBAC: Authorizing `identity:create_grant(project_id=4a1ea1922c4946d79ba6bac82ade352e, user_id=255e7aed5b7a42e49ba97be1a3aebe82, role_id=efa0e5b3413748dc828a89b12d67df79)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:18.575532 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8b8526-a8c0-46e7-b414-cfecb78fb3fe None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:18.590924 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 132/263] 10.222.0.72 () {58 vars in 1439 bytes} [Mon Sep 19 14:43:18 2022] PUT /identity/v3/projects/4a1ea1922c4946d79ba6bac82ade352e/users/255e7aed5b7a42e49ba97be1a3aebe82/roles/efa0e5b3413748dc828a89b12d67df79 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:43:18.592060 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8b8526-a8c0-46e7-b414-cfecb78fb3fe None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:18.709100 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8b8526-a8c0-46e7-b414-cfecb78fb3fe None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:18.720718 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:18.749987 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c229639e-37a6-4643-90b3-beae4c5377b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:18.750694 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c229639e-37a6-4643-90b3-beae4c5377b3 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:18.751142 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c229639e-37a6-4643-90b3-beae4c5377b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:18.751498 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c229639e-37a6-4643-90b3-beae4c5377b3 None admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:18.752175 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c229639e-37a6-4643-90b3-beae4c5377b3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:18.752510 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c229639e-37a6-4643-90b3-beae4c5377b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:18.754164 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c229639e-37a6-4643-90b3-beae4c5377b3 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:18.764018 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 133/264] 10.222.0.72 () {56 vars in 1111 bytes} [Mon Sep 19 14:43:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:18.770069 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c229639e-37a6-4643-90b3-beae4c5377b3 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:18.811163 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e612e5f-13e2-4821-ae00-f20f8e1caef4 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:18.891529 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:18.920196 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab70302f-571e-426e-827d-0a800cb51bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:18.920855 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab70302f-571e-426e-827d-0a800cb51bfb None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:18.921135 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab70302f-571e-426e-827d-0a800cb51bfb None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:18.921409 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab70302f-571e-426e-827d-0a800cb51bfb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:18.922148 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab70302f-571e-426e-827d-0a800cb51bfb None admin] RBAC: Adding query filter params (role.id=ddb643577b2e4e478100ec370decfaeb, scope.project.id=4a1ea1922c4946d79ba6bac82ade352e, user.id=da8d98977ba8478bb69666a438c332ce) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:18.922455 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab70302f-571e-426e-827d-0a800cb51bfb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:18.923918 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab70302f-571e-426e-827d-0a800cb51bfb None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:18.930361 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 132/265] 10.222.0.72 () {56 vars in 1374 bytes} [Mon Sep 19 14:43:18 2022] GET /identity/v3/role_assignments?user.id=da8d98977ba8478bb69666a438c332ce&scope.project.id=4a1ea1922c4946d79ba6bac82ade352e&role.id=ddb643577b2e4e478100ec370decfaeb => generated 608 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:18.940109 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c229639e-37a6-4643-90b3-beae4c5377b3 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:18.978659 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4bec65-d32f-4fcc-afab-3f5f96174762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:18.979318 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4bec65-d32f-4fcc-afab-3f5f96174762 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:18.979602 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4bec65-d32f-4fcc-afab-3f5f96174762 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:18.979877 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4bec65-d32f-4fcc-afab-3f5f96174762 None admin] PATH_INFO: `/v3/users/da8d98977ba8478bb69666a438c332ce` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:18.981829 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4bec65-d32f-4fcc-afab-3f5f96174762 None admin] RBAC: Authorizing `identity:get_user(user_id=da8d98977ba8478bb69666a438c332ce)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:18.983280 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4bec65-d32f-4fcc-afab-3f5f96174762 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:18.985249 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 134/266] 10.222.0.72 () {56 vars in 1177 bytes} [Mon Sep 19 14:43:18 2022] GET /identity/v3/users/da8d98977ba8478bb69666a438c332ce => generated 283 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:43:18.993485 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab70302f-571e-426e-827d-0a800cb51bfb None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:19.158979 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab70302f-571e-426e-827d-0a800cb51bfb None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:19.205248 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4166a658-7ba5-46ed-8187-2f321174337b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:19.205863 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4166a658-7ba5-46ed-8187-2f321174337b None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:19.206140 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4166a658-7ba5-46ed-8187-2f321174337b None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:19.206410 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4166a658-7ba5-46ed-8187-2f321174337b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:19.271492 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:19.283968 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4166a658-7ba5-46ed-8187-2f321174337b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:19.285478 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4166a658-7ba5-46ed-8187-2f321174337b None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:19.407373 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 133/267] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Sep 19 14:43:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 14:43:19.412766 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4bec65-d32f-4fcc-afab-3f5f96174762 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:19.477178 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:19.564133 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4bec65-d32f-4fcc-afab-3f5f96174762 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:19.603024 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c57486a-6356-4105-8eb9-90896fe7f3df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:19.603958 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c57486a-6356-4105-8eb9-90896fe7f3df None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:19.604408 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c57486a-6356-4105-8eb9-90896fe7f3df None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:19.604825 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c57486a-6356-4105-8eb9-90896fe7f3df None admin] PATH_INFO: `/v3/projects/4a1ea1922c4946d79ba6bac82ade352e` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:19.606842 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c57486a-6356-4105-8eb9-90896fe7f3df None admin] RBAC: Authorizing `identity:get_project(project_id=4a1ea1922c4946d79ba6bac82ade352e)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:19.608493 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c57486a-6356-4105-8eb9-90896fe7f3df None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:19.610798 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 135/268] 10.222.0.72 () {56 vars in 1186 bytes} [Mon Sep 19 14:43:19 2022] GET /identity/v3/projects/4a1ea1922c4946d79ba6bac82ade352e => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:43:19.616790 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4166a658-7ba5-46ed-8187-2f321174337b None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:19.772122 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:19.776780 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f814ba-1ac3-4c1f-9ab3-8058121a5612 None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:19.777158 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f814ba-1ac3-4c1f-9ab3-8058121a5612 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:19.777432 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f814ba-1ac3-4c1f-9ab3-8058121a5612 None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:19.780626 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 136/269] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:43:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:43:19.785513 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4166a658-7ba5-46ed-8187-2f321174337b None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:19.800548 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831ef855-ef43-4f27-9998-da091678494c None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:19.801178 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831ef855-ef43-4f27-9998-da091678494c None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:19.801650 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831ef855-ef43-4f27-9998-da091678494c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:19.821636 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-831ef855-ef43-4f27-9998-da091678494c None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:43:19.823168 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-831ef855-ef43-4f27-9998-da091678494c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:43:19.841040 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb1dfc9-763b-48eb-99aa-c0dd1cf69ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:19.841690 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb1dfc9-763b-48eb-99aa-c0dd1cf69ea8 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:19.841930 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb1dfc9-763b-48eb-99aa-c0dd1cf69ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:19.842198 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb1dfc9-763b-48eb-99aa-c0dd1cf69ea8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:19.842926 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb1dfc9-763b-48eb-99aa-c0dd1cf69ea8 None admin] RBAC: Adding query filter params (role.id=962ee04d08ae41b08c1a5108c54c7469, scope.project.id=4a1ea1922c4946d79ba6bac82ade352e, user.id=da8d98977ba8478bb69666a438c332ce) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:19.843229 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb1dfc9-763b-48eb-99aa-c0dd1cf69ea8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:19.844689 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb1dfc9-763b-48eb-99aa-c0dd1cf69ea8 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:19.853708 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 134/270] 10.222.0.72 () {56 vars in 1374 bytes} [Mon Sep 19 14:43:19 2022] GET /identity/v3/role_assignments?user.id=da8d98977ba8478bb69666a438c332ce&scope.project.id=4a1ea1922c4946d79ba6bac82ade352e&role.id=962ee04d08ae41b08c1a5108c54c7469 => generated 608 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:19.854997 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c5033c-3300-421d-8f4d-f339f076276e None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:19.855314 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c5033c-3300-421d-8f4d-f339f076276e None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:19.855584 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c5033c-3300-421d-8f4d-f339f076276e None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:19.857095 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 135/271] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:43:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:43:19.859221 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1900b898-5b82-4ec1-a09e-6619fe858392 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:19.859502 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1900b898-5b82-4ec1-a09e-6619fe858392 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:19.864598 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1900b898-5b82-4ec1-a09e-6619fe858392 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:19.866185 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 136/272] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:43:19 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:43:19.867351 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f8fc6-9869-4bce-9ee1-f6cd936d3500 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:19.867640 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f8fc6-9869-4bce-9ee1-f6cd936d3500 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:19.867909 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f8fc6-9869-4bce-9ee1-f6cd936d3500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:19.905117 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-471f8fc6-9869-4bce-9ee1-f6cd936d3500 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:43:19.906647 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 137/273] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:43:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:43:19.906887 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-471f8fc6-9869-4bce-9ee1-f6cd936d3500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:43:19.907918 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f8d8eb-90d0-43b7-9873-ab9e0157063a None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:19.908202 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f8d8eb-90d0-43b7-9873-ab9e0157063a None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:19.908508 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f8d8eb-90d0-43b7-9873-ab9e0157063a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:19.945007 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-23f8d8eb-90d0-43b7-9873-ab9e0157063a None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:43:19.946231 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-23f8d8eb-90d0-43b7-9873-ab9e0157063a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:43:20.018893 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:20.050211 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 137/274] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:43:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:43:20.085495 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 138/275] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:43:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:43:20.217704 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471f8fc6-9869-4bce-9ee1-f6cd936d3500 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:20.319279 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:20.334120 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471f8fc6-9869-4bce-9ee1-f6cd936d3500 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:20.373915 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f8d8eb-90d0-43b7-9873-ab9e0157063a None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:20.376597 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bb7ee3-51c2-46e0-b3a1-db4791e596a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:20.377297 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb7ee3-51c2-46e0-b3a1-db4791e596a3 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:20.377579 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb7ee3-51c2-46e0-b3a1-db4791e596a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:20.377852 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb7ee3-51c2-46e0-b3a1-db4791e596a3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:20.378950 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bb7ee3-51c2-46e0-b3a1-db4791e596a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:20.380448 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bb7ee3-51c2-46e0-b3a1-db4791e596a3 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:20.382287 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 138/276] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:43:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:20.383102 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bb7ee3-51c2-46e0-b3a1-db4791e596a3 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:20.479945 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f8d8eb-90d0-43b7-9873-ab9e0157063a None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:20.484949 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bb7ee3-51c2-46e0-b3a1-db4791e596a3 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:20.519189 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917b3726-d89a-480c-9baf-f6a7d7c9bd2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:20.519396 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8c90b0-8826-413e-9238-b92c504bab7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:20.519871 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917b3726-d89a-480c-9baf-f6a7d7c9bd2e None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:20.519974 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8c90b0-8826-413e-9238-b92c504bab7d None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:20.520148 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917b3726-d89a-480c-9baf-f6a7d7c9bd2e None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:20.520250 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8c90b0-8826-413e-9238-b92c504bab7d None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:20.520489 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8c90b0-8826-413e-9238-b92c504bab7d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:20.520584 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917b3726-d89a-480c-9baf-f6a7d7c9bd2e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:20.531375 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917b3726-d89a-480c-9baf-f6a7d7c9bd2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:43:20.531797 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8c90b0-8826-413e-9238-b92c504bab7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:43:20.536199 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-917b3726-d89a-480c-9baf-f6a7d7c9bd2e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 14:43:20.536199 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:20.536199 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:43:20.536199 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:43:20.536199 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:43:20.536199 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:43:20.536199 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:43:20.536199 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:43:20.536199 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:43:20.536199 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:43:20.536199 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:43:20.536199 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:43:20.536199 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:43:20.536199 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:43:20.536199 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:43:20.536199 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:43:20.537105 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:43:20.537105 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:43:20.537105 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:43:20.537105 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:43:20.537105 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:43:20.537105 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:43:20.537105 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:43:20.537105 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:43:20.537105 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:43:20.537105 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:43:20.537105 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:43:20.537105 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:43:20.537105 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:43:20.537105 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:43:20.537105 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:43:20.537105 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:43:20.537883 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:43:20.537883 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:43:20.537883 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:43:20.537883 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:43:20.537883 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:43:20.537883 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:43:20.537883 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:43:20.537883 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:43:20.537883 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:43:20.537883 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:43:20.537883 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 14:43:20.537883 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:43:20.543707 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-2d8c90b0-8826-413e-9238-b92c504bab7d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 14:43:20.543707 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:20.543707 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:43:20.543707 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:43:20.543707 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:43:20.543707 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:43:20.543707 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:43:20.543707 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:43:20.543707 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:43:20.543707 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:43:20.543707 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:43:20.543707 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:43:20.543707 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:43:20.543707 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:43:20.543707 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:43:20.543707 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:43:20.544574 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:43:20.544574 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:43:20.544574 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:43:20.544574 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:43:20.544574 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:43:20.544574 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:43:20.544574 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:43:20.544574 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:43:20.544574 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:43:20.544574 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:43:20.544574 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:43:20.544574 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:43:20.544574 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:43:20.544574 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:43:20.544574 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:43:20.544574 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:43:20.545349 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:43:20.545349 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:43:20.545349 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:43:20.545349 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:43:20.545349 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:43:20.545349 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:43:20.545349 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:43:20.545349 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:43:20.545349 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:43:20.545349 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:43:20.545349 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 14:43:20.545349 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:43:20.545349 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 139/277] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Sep 19 14:43:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:43:20.545349 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8c90b0-8826-413e-9238-b92c504bab7d None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:20.546042 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 139/278] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Sep 19 14:43:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:43:20.546042 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917b3726-d89a-480c-9baf-f6a7d7c9bd2e None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:20.564136 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:20.575628 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:20.653730 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917b3726-d89a-480c-9baf-f6a7d7c9bd2e None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:20.654780 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8c90b0-8826-413e-9238-b92c504bab7d None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:20.689836 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd338b71-5745-49eb-ab27-5611a465e693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:20.690436 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd338b71-5745-49eb-ab27-5611a465e693 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:20.690707 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd338b71-5745-49eb-ab27-5611a465e693 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:20.690974 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd338b71-5745-49eb-ab27-5611a465e693 None admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:20.691625 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd338b71-5745-49eb-ab27-5611a465e693 None admin] RBAC: Adding query filter params (name=member) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:20.691923 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd338b71-5745-49eb-ab27-5611a465e693 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:20.692758 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31b86a5-171c-44e6-a4f1-aedaf49afc65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:20.693328 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd338b71-5745-49eb-ab27-5611a465e693 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:20.693437 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31b86a5-171c-44e6-a4f1-aedaf49afc65 None admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:20.693639 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31b86a5-171c-44e6-a4f1-aedaf49afc65 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:20.693912 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31b86a5-171c-44e6-a4f1-aedaf49afc65 None admin] PATH_INFO: `/v3/users` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:20.694566 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31b86a5-171c-44e6-a4f1-aedaf49afc65 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:20.696027 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31b86a5-171c-44e6-a4f1-aedaf49afc65 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:20.702454 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 140/279] 10.222.0.72 () {56 vars in 1101 bytes} [Mon Sep 19 14:43:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:20.705354 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd338b71-5745-49eb-ab27-5611a465e693 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:20.732362 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 140/280] 10.222.0.72 () {60 vars in 1132 bytes} [Mon Sep 19 14:43:20 2022] POST /identity/v3/users => generated 293 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:43:20.732362 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31b86a5-171c-44e6-a4f1-aedaf49afc65 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:20.809650 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:20.840680 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:20.841069 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd338b71-5745-49eb-ab27-5611a465e693 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:20.871535 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31b86a5-171c-44e6-a4f1-aedaf49afc65 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:20.904114 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e6f1a4-57fc-4eb8-9c16-3e79bb3cf209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:20.905145 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e6f1a4-57fc-4eb8-9c16-3e79bb3cf209 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:20.905630 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e6f1a4-57fc-4eb8-9c16-3e79bb3cf209 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:20.906130 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e6f1a4-57fc-4eb8-9c16-3e79bb3cf209 None admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:20.907019 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e6f1a4-57fc-4eb8-9c16-3e79bb3cf209 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:20.907541 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e6f1a4-57fc-4eb8-9c16-3e79bb3cf209 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:20.909873 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e6f1a4-57fc-4eb8-9c16-3e79bb3cf209 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:20.926781 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6edcb9-3f60-46b6-ba4c-eadca1b4c16d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:20.927430 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6edcb9-3f60-46b6-ba4c-eadca1b4c16d None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:20.927710 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6edcb9-3f60-46b6-ba4c-eadca1b4c16d None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:20.927987 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6edcb9-3f60-46b6-ba4c-eadca1b4c16d None admin] PATH_INFO: `/v3/users/a84df62fea8547c7a1cc2fe4fdbe6643` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:20.931647 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 141/281] 10.222.0.72 () {56 vars in 1101 bytes} [Mon Sep 19 14:43:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:20.937864 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e6f1a4-57fc-4eb8-9c16-3e79bb3cf209 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:20.948472 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6edcb9-3f60-46b6-ba4c-eadca1b4c16d None admin] RBAC: Authorizing `identity:get_user(user_id=a84df62fea8547c7a1cc2fe4fdbe6643)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:20.950027 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6edcb9-3f60-46b6-ba4c-eadca1b4c16d None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:20.951853 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 141/282] 10.222.0.72 () {56 vars in 1177 bytes} [Mon Sep 19 14:43:20 2022] GET /identity/v3/users/a84df62fea8547c7a1cc2fe4fdbe6643 => generated 293 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:20.958944 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6edcb9-3f60-46b6-ba4c-eadca1b4c16d None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:21.071206 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e6f1a4-57fc-4eb8-9c16-3e79bb3cf209 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:21.088225 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6edcb9-3f60-46b6-ba4c-eadca1b4c16d None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:21.115197 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8586495b-4df2-45ea-98df-39a6d8c14483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:21.116072 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8586495b-4df2-45ea-98df-39a6d8c14483 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:21.116376 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8586495b-4df2-45ea-98df-39a6d8c14483 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:21.116652 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8586495b-4df2-45ea-98df-39a6d8c14483 None admin] PATH_INFO: `/v3/users/38fa0076fdca498ab2fcc3de27d965af` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:21.118282 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8586495b-4df2-45ea-98df-39a6d8c14483 None admin] RBAC: Authorizing `identity:get_user(user_id=38fa0076fdca498ab2fcc3de27d965af)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:21.119728 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8586495b-4df2-45ea-98df-39a6d8c14483 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:21.122048 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 142/283] 10.222.0.72 () {56 vars in 1177 bytes} [Mon Sep 19 14:43:20 2022] GET /identity/v3/users/38fa0076fdca498ab2fcc3de27d965af => generated 297 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:21.127594 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8586495b-4df2-45ea-98df-39a6d8c14483 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:21.131211 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c91d6e-b89b-4c2b-beb0-317095facea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:21.131829 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c91d6e-b89b-4c2b-beb0-317095facea3 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:21.132110 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c91d6e-b89b-4c2b-beb0-317095facea3 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:21.132435 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c91d6e-b89b-4c2b-beb0-317095facea3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:21.133177 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c91d6e-b89b-4c2b-beb0-317095facea3 None admin] RBAC: Adding query filter params (role.id=efa0e5b3413748dc828a89b12d67df79, user.id=a84df62fea8547c7a1cc2fe4fdbe6643, scope.system=all) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:21.133489 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c91d6e-b89b-4c2b-beb0-317095facea3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:21.134932 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c91d6e-b89b-4c2b-beb0-317095facea3 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:21.144352 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 142/284] 10.222.0.72 () {56 vars in 1308 bytes} [Mon Sep 19 14:43:20 2022] GET /identity/v3/role_assignments?user.id=a84df62fea8547c7a1cc2fe4fdbe6643&scope.system=all&role.id=efa0e5b3413748dc828a89b12d67df79 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:43:21.146960 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:21.276843 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8586495b-4df2-45ea-98df-39a6d8c14483 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:21.337964 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234b54dd-87ce-43c8-8c52-9514bf56ffc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:21.339360 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b54dd-87ce-43c8-8c52-9514bf56ffc6 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:21.339868 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b54dd-87ce-43c8-8c52-9514bf56ffc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:21.340371 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b54dd-87ce-43c8-8c52-9514bf56ffc6 None admin] PATH_INFO: `/v3/projects/4a1ea1922c4946d79ba6bac82ade352e` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:21.341699 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234b54dd-87ce-43c8-8c52-9514bf56ffc6 None admin] RBAC: Authorizing `identity:get_project(project_id=4a1ea1922c4946d79ba6bac82ade352e)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:21.343365 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234b54dd-87ce-43c8-8c52-9514bf56ffc6 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:21.346475 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 143/285] 10.222.0.72 () {56 vars in 1186 bytes} [Mon Sep 19 14:43:21 2022] GET /identity/v3/projects/4a1ea1922c4946d79ba6bac82ade352e => generated 302 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:43:21.351545 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c91d6e-b89b-4c2b-beb0-317095facea3 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:21.361444 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:21.409626 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f539cfc7-6c84-415a-ad33-1ed6eaf3d44a None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:21.409922 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f539cfc7-6c84-415a-ad33-1ed6eaf3d44a None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:21.410102 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f539cfc7-6c84-415a-ad33-1ed6eaf3d44a None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:21.411542 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 144/286] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:43:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:43:21.416757 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941d6926-4204-4b20-b661-621b87444fa1 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:21.417009 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941d6926-4204-4b20-b661-621b87444fa1 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:21.417437 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941d6926-4204-4b20-b661-621b87444fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:21.447552 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-941d6926-4204-4b20-b661-621b87444fa1 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:43:21.450435 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-941d6926-4204-4b20-b661-621b87444fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:43:21.524026 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c91d6e-b89b-4c2b-beb0-317095facea3 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:21.561566 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 145/287] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:43:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 14:43:21.573535 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9162046-8ac7-49ef-8721-db12fb8de8e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:21.574978 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9162046-8ac7-49ef-8721-db12fb8de8e0 None admin] REQUEST_METHOD: `PUT` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:21.575399 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9162046-8ac7-49ef-8721-db12fb8de8e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:21.575807 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9162046-8ac7-49ef-8721-db12fb8de8e0 None admin] PATH_INFO: `/v3/projects/4a1ea1922c4946d79ba6bac82ade352e/users/38fa0076fdca498ab2fcc3de27d965af/roles/dc1fc2b7f53a4f1084d0ecf5473f9dce` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:21.577892 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9162046-8ac7-49ef-8721-db12fb8de8e0 None admin] RBAC: Authorizing `identity:create_grant(project_id=4a1ea1922c4946d79ba6bac82ade352e, user_id=38fa0076fdca498ab2fcc3de27d965af, role_id=dc1fc2b7f53a4f1084d0ecf5473f9dce)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:21.579478 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9162046-8ac7-49ef-8721-db12fb8de8e0 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:21.596110 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 143/288] 10.222.0.72 () {58 vars in 1439 bytes} [Mon Sep 19 14:43:21 2022] PUT /identity/v3/projects/4a1ea1922c4946d79ba6bac82ade352e/users/38fa0076fdca498ab2fcc3de27d965af/roles/dc1fc2b7f53a4f1084d0ecf5473f9dce => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:43:21.981120 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941d6926-4204-4b20-b661-621b87444fa1 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:21.989882 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:22.126437 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941d6926-4204-4b20-b661-621b87444fa1 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:22.182472 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4152c942-fa34-43b6-89a4-214dc7aa4da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:22.183647 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4152c942-fa34-43b6-89a4-214dc7aa4da0 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:22.184251 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4152c942-fa34-43b6-89a4-214dc7aa4da0 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:22.184736 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4152c942-fa34-43b6-89a4-214dc7aa4da0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:22.198872 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4152c942-fa34-43b6-89a4-214dc7aa4da0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:43:22.204286 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-4152c942-fa34-43b6-89a4-214dc7aa4da0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 14:43:22.204286 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:22.204286 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:43:22.204286 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:43:22.204286 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:43:22.204286 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:43:22.204286 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:43:22.204286 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:43:22.204286 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:43:22.204286 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:43:22.204286 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:43:22.204286 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:43:22.204286 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:43:22.204286 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:43:22.204286 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:43:22.204286 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:43:22.205158 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:43:22.205158 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:43:22.205158 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:43:22.205158 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:43:22.205158 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:43:22.205158 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:43:22.205158 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:43:22.205158 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:43:22.205158 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:43:22.205158 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:43:22.205158 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:43:22.205158 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:43:22.205158 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:43:22.205158 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:43:22.205158 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:43:22.205158 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:43:22.206010 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:43:22.206010 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:43:22.206010 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:43:22.206010 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:43:22.206010 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:43:22.206010 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:43:22.206010 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:43:22.206010 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:43:22.206010 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:43:22.206010 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:43:22.206010 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 14:43:22.206010 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:43:22.208166 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 146/289] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Sep 19 14:43:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:43:22.214175 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9162046-8ac7-49ef-8721-db12fb8de8e0 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:22.298093 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:22.349499 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9162046-8ac7-49ef-8721-db12fb8de8e0 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:22.385359 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834b7860-2b14-49e6-bf2d-6218ae1b9dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:22.386833 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834b7860-2b14-49e6-bf2d-6218ae1b9dbb None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:22.387538 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834b7860-2b14-49e6-bf2d-6218ae1b9dbb None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:22.388058 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834b7860-2b14-49e6-bf2d-6218ae1b9dbb None admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:22.388963 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834b7860-2b14-49e6-bf2d-6218ae1b9dbb None admin] RBAC: Adding query filter params (name=member) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:22.389456 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834b7860-2b14-49e6-bf2d-6218ae1b9dbb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:22.391058 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834b7860-2b14-49e6-bf2d-6218ae1b9dbb None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:22.404431 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 144/290] 10.222.0.72 () {56 vars in 1101 bytes} [Mon Sep 19 14:43:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:22.406917 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4152c942-fa34-43b6-89a4-214dc7aa4da0 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:22.523849 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:22.576858 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4152c942-fa34-43b6-89a4-214dc7aa4da0 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:22.641085 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3367b0-d0a9-4809-ac2a-db48cd632363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:22.641734 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3367b0-d0a9-4809-ac2a-db48cd632363 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:22.642022 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3367b0-d0a9-4809-ac2a-db48cd632363 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:22.642298 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3367b0-d0a9-4809-ac2a-db48cd632363 None admin] PATH_INFO: `/v3/users/255e7aed5b7a42e49ba97be1a3aebe82` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:22.643503 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3367b0-d0a9-4809-ac2a-db48cd632363 None admin] RBAC: Authorizing `identity:get_user(user_id=255e7aed5b7a42e49ba97be1a3aebe82)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:22.644982 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3367b0-d0a9-4809-ac2a-db48cd632363 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:22.646569 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 147/291] 10.222.0.72 () {56 vars in 1177 bytes} [Mon Sep 19 14:43:22 2022] GET /identity/v3/users/255e7aed5b7a42e49ba97be1a3aebe82 => generated 297 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:22.653264 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834b7860-2b14-49e6-bf2d-6218ae1b9dbb None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:22.805257 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834b7860-2b14-49e6-bf2d-6218ae1b9dbb None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:22.837789 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:22.850349 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6469f2c1-ea7e-4b66-82a0-d8f7d1b54162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:22.850974 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6469f2c1-ea7e-4b66-82a0-d8f7d1b54162 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:22.851259 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6469f2c1-ea7e-4b66-82a0-d8f7d1b54162 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:22.851535 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6469f2c1-ea7e-4b66-82a0-d8f7d1b54162 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:22.954048 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6469f2c1-ea7e-4b66-82a0-d8f7d1b54162 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:22.955504 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6469f2c1-ea7e-4b66-82a0-d8f7d1b54162 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:23.088069 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 145/292] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Sep 19 14:43:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 14:43:23.094393 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3367b0-d0a9-4809-ac2a-db48cd632363 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:23.250190 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3367b0-d0a9-4809-ac2a-db48cd632363 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:23.295647 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b816733c-4131-41d0-8f85-f1eab99a944d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:23.296286 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b816733c-4131-41d0-8f85-f1eab99a944d None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:23.296596 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b816733c-4131-41d0-8f85-f1eab99a944d None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:23.296870 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b816733c-4131-41d0-8f85-f1eab99a944d None admin] PATH_INFO: `/v3/projects/4a1ea1922c4946d79ba6bac82ade352e` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:23.298055 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b816733c-4131-41d0-8f85-f1eab99a944d None admin] RBAC: Authorizing `identity:get_project(project_id=4a1ea1922c4946d79ba6bac82ade352e)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:23.299514 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b816733c-4131-41d0-8f85-f1eab99a944d None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:23.301377 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 148/293] 10.222.0.72 () {56 vars in 1186 bytes} [Mon Sep 19 14:43:23 2022] GET /identity/v3/projects/4a1ea1922c4946d79ba6bac82ade352e => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:23.307688 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6469f2c1-ea7e-4b66-82a0-d8f7d1b54162 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:23.351716 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:23.449938 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6469f2c1-ea7e-4b66-82a0-d8f7d1b54162 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:23.494436 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bca7a12-67da-42a4-ab35-524eff5e2f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:23.495112 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca7a12-67da-42a4-ab35-524eff5e2f62 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:23.495397 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca7a12-67da-42a4-ab35-524eff5e2f62 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:23.496458 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca7a12-67da-42a4-ab35-524eff5e2f62 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:23.497006 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bca7a12-67da-42a4-ab35-524eff5e2f62 None admin] RBAC: Adding query filter params (role.id=efa0e5b3413748dc828a89b12d67df79, scope.project.id=4a1ea1922c4946d79ba6bac82ade352e, user.id=255e7aed5b7a42e49ba97be1a3aebe82) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:23.497426 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bca7a12-67da-42a4-ab35-524eff5e2f62 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:23.498866 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bca7a12-67da-42a4-ab35-524eff5e2f62 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:23.509282 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 146/294] 10.222.0.72 () {56 vars in 1374 bytes} [Mon Sep 19 14:43:23 2022] GET /identity/v3/role_assignments?user.id=255e7aed5b7a42e49ba97be1a3aebe82&scope.project.id=4a1ea1922c4946d79ba6bac82ade352e&role.id=efa0e5b3413748dc828a89b12d67df79 => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:23.656455 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14f130b-ab5e-465b-b715-aa9d7f41894c None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:23.656455 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14f130b-ab5e-465b-b715-aa9d7f41894c None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:23.656455 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14f130b-ab5e-465b-b715-aa9d7f41894c None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:23.658533 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 149/295] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:43:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:43:23.663786 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c58f58-fb85-4e54-8d4f-78801a621508 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:23.664262 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c58f58-fb85-4e54-8d4f-78801a621508 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:23.664381 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c58f58-fb85-4e54-8d4f-78801a621508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:23.694461 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-b6c58f58-fb85-4e54-8d4f-78801a621508 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:43:23.695682 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-b6c58f58-fb85-4e54-8d4f-78801a621508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:43:23.762612 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05f499a-f2f7-474a-be22-ee831bf39e5d None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:23.763234 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05f499a-f2f7-474a-be22-ee831bf39e5d None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:23.763711 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05f499a-f2f7-474a-be22-ee831bf39e5d None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:23.765293 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 150/296] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:43:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:43:23.770800 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b8cf21-78a7-4faf-a985-db5d16fe492d None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:23.771115 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b8cf21-78a7-4faf-a985-db5d16fe492d None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:23.771347 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b8cf21-78a7-4faf-a985-db5d16fe492d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:23.771819 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 147/297] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:43:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:43:23.787001 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:23.809648 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-e9b8cf21-78a7-4faf-a985-db5d16fe492d None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:43:23.811125 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-e9b8cf21-78a7-4faf-a985-db5d16fe492d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:43:23.884315 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 151/298] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:43:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:43:23.919825 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db6b906-03ca-4dcc-ad57-63baa4e9a884 None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:23.920109 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db6b906-03ca-4dcc-ad57-63baa4e9a884 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:23.920393 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db6b906-03ca-4dcc-ad57-63baa4e9a884 None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:23.922480 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 148/299] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:43:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:43:23.928031 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db50a6-a814-40fd-a09a-0865dd1273a7 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:23.928320 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db50a6-a814-40fd-a09a-0865dd1273a7 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:23.928619 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db50a6-a814-40fd-a09a-0865dd1273a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:23.949683 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-37db50a6-a814-40fd-a09a-0865dd1273a7 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:43:23.950834 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-37db50a6-a814-40fd-a09a-0865dd1273a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:43:24.030187 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 152/300] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:43:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:43:24.075205 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db6b906-03ca-4dcc-ad57-63baa4e9a884 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:24.099640 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:24.185857 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db6b906-03ca-4dcc-ad57-63baa4e9a884 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:24.216969 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37db50a6-a814-40fd-a09a-0865dd1273a7 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:24.225209 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3d4d99-4dd6-4676-a613-22092fc29d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:24.225957 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3d4d99-4dd6-4676-a613-22092fc29d17 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:24.226236 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3d4d99-4dd6-4676-a613-22092fc29d17 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:24.226498 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3d4d99-4dd6-4676-a613-22092fc29d17 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:24.238463 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3d4d99-4dd6-4676-a613-22092fc29d17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:43:24.243684 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-ab3d4d99-4dd6-4676-a613-22092fc29d17 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 14:43:24.243684 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:24.243684 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:43:24.243684 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:43:24.243684 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:43:24.243684 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:43:24.243684 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:43:24.243684 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:43:24.243684 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:43:24.243684 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:43:24.243684 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:43:24.243684 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:43:24.243684 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:43:24.243684 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:43:24.243684 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:43:24.243684 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:43:24.244579 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:43:24.244579 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:43:24.244579 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:43:24.244579 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:43:24.244579 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:43:24.244579 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:43:24.244579 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:43:24.244579 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:43:24.244579 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:43:24.244579 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:43:24.244579 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:43:24.244579 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:43:24.244579 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:43:24.244579 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:43:24.244579 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:43:24.244579 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:43:24.249164 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:43:24.249164 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:43:24.249164 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:43:24.249164 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:43:24.249164 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:43:24.249164 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:43:24.249164 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:43:24.249164 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:43:24.249164 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:43:24.249164 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:43:24.249164 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 14:43:24.249164 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:43:24.249164 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 149/301] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Sep 19 14:43:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:43:24.252311 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3d4d99-4dd6-4676-a613-22092fc29d17 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:24.294858 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:24.335767 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37db50a6-a814-40fd-a09a-0865dd1273a7 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:24.343491 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:24.365310 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3d4d99-4dd6-4676-a613-22092fc29d17 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:24.379163 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551c2e5f-e3f2-41ef-85dd-29c178001379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:24.380169 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c2e5f-e3f2-41ef-85dd-29c178001379 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:24.380613 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c2e5f-e3f2-41ef-85dd-29c178001379 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:24.380777 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c2e5f-e3f2-41ef-85dd-29c178001379 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:24.381959 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551c2e5f-e3f2-41ef-85dd-29c178001379 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:24.383435 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551c2e5f-e3f2-41ef-85dd-29c178001379 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:24.390244 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 153/302] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:43:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:24.391198 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551c2e5f-e3f2-41ef-85dd-29c178001379 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:24.409064 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68350868-f2cd-4a18-b9de-aba5ebb12136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:24.409680 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68350868-f2cd-4a18-b9de-aba5ebb12136 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:24.409961 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68350868-f2cd-4a18-b9de-aba5ebb12136 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:24.410232 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68350868-f2cd-4a18-b9de-aba5ebb12136 None admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:24.410900 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68350868-f2cd-4a18-b9de-aba5ebb12136 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:24.411209 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68350868-f2cd-4a18-b9de-aba5ebb12136 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:24.413098 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68350868-f2cd-4a18-b9de-aba5ebb12136 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:24.422385 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 150/303] 10.222.0.72 () {56 vars in 1101 bytes} [Mon Sep 19 14:43:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:24.425499 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68350868-f2cd-4a18-b9de-aba5ebb12136 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:24.500649 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551c2e5f-e3f2-41ef-85dd-29c178001379 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:24.530219 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:24.536041 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68350868-f2cd-4a18-b9de-aba5ebb12136 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:24.536176 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fae9ee5-a718-4f89-8ffc-afe3038ee564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:24.536808 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fae9ee5-a718-4f89-8ffc-afe3038ee564 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:24.537086 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fae9ee5-a718-4f89-8ffc-afe3038ee564 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:24.537354 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fae9ee5-a718-4f89-8ffc-afe3038ee564 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:24.547414 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fae9ee5-a718-4f89-8ffc-afe3038ee564 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:43:24.552345 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-3fae9ee5-a718-4f89-8ffc-afe3038ee564 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 14:43:24.552345 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:24.552345 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:43:24.552345 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:43:24.552345 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:43:24.552345 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:43:24.552345 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:43:24.552345 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:43:24.552345 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:43:24.552345 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:43:24.552345 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:43:24.552345 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:43:24.552345 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:43:24.552345 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:43:24.552345 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:43:24.552345 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:43:24.553313 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:43:24.553313 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:43:24.553313 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:43:24.553313 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:43:24.553313 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:43:24.553313 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:43:24.553313 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:43:24.553313 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:43:24.553313 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:43:24.553313 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:43:24.553313 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:43:24.553313 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:43:24.553313 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:43:24.553313 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:43:24.553313 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:43:24.553313 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:43:24.554170 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:43:24.554170 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:43:24.554170 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:43:24.554170 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:43:24.554170 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:43:24.554170 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:43:24.554170 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:43:24.554170 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:43:24.554170 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:43:24.554170 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:43:24.554170 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 14:43:24.554170 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:43:24.554170 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 154/304] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Sep 19 14:43:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:43:24.554170 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fae9ee5-a718-4f89-8ffc-afe3038ee564 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:24.571582 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773f4630-a813-45ed-b5d1-ea35c1bad934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:24.572278 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773f4630-a813-45ed-b5d1-ea35c1bad934 None admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:24.572585 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773f4630-a813-45ed-b5d1-ea35c1bad934 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:24.572853 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773f4630-a813-45ed-b5d1-ea35c1bad934 None admin] PATH_INFO: `/v3/groups` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:24.573465 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773f4630-a813-45ed-b5d1-ea35c1bad934 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:24.575632 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773f4630-a813-45ed-b5d1-ea35c1bad934 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:24.591431 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 151/305] 10.222.0.72 () {60 vars in 1134 bytes} [Mon Sep 19 14:43:24 2022] POST /identity/v3/groups => generated 229 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:43:24.592716 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f8f2b2-b3ab-4b22-9cc1-8746d23cba7e None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:24.593005 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f8f2b2-b3ab-4b22-9cc1-8746d23cba7e None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:24.593275 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f8f2b2-b3ab-4b22-9cc1-8746d23cba7e None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:24.594636 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 152/306] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:43:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:43:24.595252 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f8f2b2-b3ab-4b22-9cc1-8746d23cba7e None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:24.605946 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:24.671272 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fae9ee5-a718-4f89-8ffc-afe3038ee564 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:24.710896 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667ec798-8e5d-4981-a6c5-18454f53b8cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:24.711534 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667ec798-8e5d-4981-a6c5-18454f53b8cc None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:24.711815 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667ec798-8e5d-4981-a6c5-18454f53b8cc None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:24.712084 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667ec798-8e5d-4981-a6c5-18454f53b8cc None admin] PATH_INFO: `/v3/users/3f4aeed0227d4f46a5318cd7d7c1e986` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:24.717366 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f8f2b2-b3ab-4b22-9cc1-8746d23cba7e None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:24.729623 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667ec798-8e5d-4981-a6c5-18454f53b8cc None admin] RBAC: Authorizing `identity:get_user(user_id=3f4aeed0227d4f46a5318cd7d7c1e986)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:24.731182 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667ec798-8e5d-4981-a6c5-18454f53b8cc None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:24.738024 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 155/307] 10.222.0.72 () {56 vars in 1177 bytes} [Mon Sep 19 14:43:24 2022] GET /identity/v3/users/3f4aeed0227d4f46a5318cd7d7c1e986 => generated 293 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:24.739233 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b6e802-91e2-438f-868c-327ae72c8785 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:24.739514 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b6e802-91e2-438f-868c-327ae72c8785 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:24.739790 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b6e802-91e2-438f-868c-327ae72c8785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:24.757476 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefc39ff-7876-4be3-8885-d64d0ec83729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:24.758001 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc39ff-7876-4be3-8885-d64d0ec83729 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:24.758193 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-d8b6e802-91e2-438f-868c-327ae72c8785 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:43:24.758290 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc39ff-7876-4be3-8885-d64d0ec83729 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:24.758525 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc39ff-7876-4be3-8885-d64d0ec83729 None admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:24.759182 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefc39ff-7876-4be3-8885-d64d0ec83729 None admin] RBAC: Adding query filter params (name=member) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:24.759353 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-d8b6e802-91e2-438f-868c-327ae72c8785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:43:24.759516 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefc39ff-7876-4be3-8885-d64d0ec83729 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:24.760886 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefc39ff-7876-4be3-8885-d64d0ec83729 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:24.772944 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 153/308] 10.222.0.72 () {56 vars in 1101 bytes} [Mon Sep 19 14:43:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:24.774682 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefc39ff-7876-4be3-8885-d64d0ec83729 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:24.812592 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:24.843390 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 156/309] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:43:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:43:24.844038 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b6e802-91e2-438f-868c-327ae72c8785 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:24.853310 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:24.900799 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefc39ff-7876-4be3-8885-d64d0ec83729 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:24.945383 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624ccf45-9872-4fac-b286-2212eb7ad24d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:24.945990 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ccf45-9872-4fac-b286-2212eb7ad24d None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:24.946273 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ccf45-9872-4fac-b286-2212eb7ad24d None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:24.946542 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ccf45-9872-4fac-b286-2212eb7ad24d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:24.947329 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624ccf45-9872-4fac-b286-2212eb7ad24d None admin] RBAC: Adding query filter params (role.id=dc1fc2b7f53a4f1084d0ecf5473f9dce, user.id=3f4aeed0227d4f46a5318cd7d7c1e986, scope.system=all) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:24.947638 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624ccf45-9872-4fac-b286-2212eb7ad24d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:24.949949 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624ccf45-9872-4fac-b286-2212eb7ad24d None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:24.955971 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 154/310] 10.222.0.72 () {56 vars in 1308 bytes} [Mon Sep 19 14:43:24 2022] GET /identity/v3/role_assignments?user.id=3f4aeed0227d4f46a5318cd7d7c1e986&scope.system=all&role.id=dc1fc2b7f53a4f1084d0ecf5473f9dce => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:24.973021 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b6e802-91e2-438f-868c-327ae72c8785 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:25.014324 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d178161-38b5-428c-b68b-ba43faea1046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:25.015227 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d178161-38b5-428c-b68b-ba43faea1046 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:25.015678 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d178161-38b5-428c-b68b-ba43faea1046 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:25.016084 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d178161-38b5-428c-b68b-ba43faea1046 None admin] PATH_INFO: `/v3/users/a84df62fea8547c7a1cc2fe4fdbe6643` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:25.017605 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d178161-38b5-428c-b68b-ba43faea1046 None admin] RBAC: Authorizing `identity:get_user(user_id=a84df62fea8547c7a1cc2fe4fdbe6643)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:25.019386 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d178161-38b5-428c-b68b-ba43faea1046 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:25.021755 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 157/311] 10.222.0.72 () {56 vars in 1177 bytes} [Mon Sep 19 14:43:24 2022] GET /identity/v3/users/a84df62fea8547c7a1cc2fe4fdbe6643 => generated 293 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:25.031095 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624ccf45-9872-4fac-b286-2212eb7ad24d None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:25.119583 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d178161-38b5-428c-b68b-ba43faea1046 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:25.142473 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624ccf45-9872-4fac-b286-2212eb7ad24d None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:25.180571 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:25.191742 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:25.191905 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492e44dc-6218-47c3-9218-3a5641df726f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:25.193018 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e44dc-6218-47c3-9218-3a5641df726f None admin] REQUEST_METHOD: `PUT` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:25.193304 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e44dc-6218-47c3-9218-3a5641df726f None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:25.193578 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e44dc-6218-47c3-9218-3a5641df726f None admin] PATH_INFO: `/v3/system/users/a84df62fea8547c7a1cc2fe4fdbe6643/roles/efa0e5b3413748dc828a89b12d67df79` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:25.195024 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492e44dc-6218-47c3-9218-3a5641df726f None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=a84df62fea8547c7a1cc2fe4fdbe6643, role_id=efa0e5b3413748dc828a89b12d67df79)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:25.197657 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492e44dc-6218-47c3-9218-3a5641df726f None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:25.209922 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 155/312] 10.222.0.72 () {58 vars in 1334 bytes} [Mon Sep 19 14:43:25 2022] PUT /identity/v3/system/users/a84df62fea8547c7a1cc2fe4fdbe6643/roles/efa0e5b3413748dc828a89b12d67df79 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:43:25.263865 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d178161-38b5-428c-b68b-ba43faea1046 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:25.306981 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d303a27-1e98-4e55-a535-49bad524f0e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:25.308101 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d303a27-1e98-4e55-a535-49bad524f0e1 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:25.309350 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d303a27-1e98-4e55-a535-49bad524f0e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:25.309844 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d303a27-1e98-4e55-a535-49bad524f0e1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:25.322718 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d303a27-1e98-4e55-a535-49bad524f0e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:43:25.328854 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-2d303a27-1e98-4e55-a535-49bad524f0e1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 14:43:25.328854 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:25.328854 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:43:25.328854 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:43:25.328854 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:43:25.328854 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:43:25.328854 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:43:25.328854 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:43:25.328854 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:43:25.328854 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:43:25.328854 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:43:25.328854 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:43:25.328854 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:43:25.328854 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:43:25.328854 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:43:25.328854 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:43:25.329837 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:43:25.329837 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:43:25.329837 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:43:25.329837 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:43:25.329837 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:43:25.329837 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:43:25.329837 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:43:25.329837 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:43:25.329837 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:43:25.329837 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:43:25.329837 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:43:25.329837 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:43:25.329837 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:43:25.329837 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:43:25.329837 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:43:25.329837 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:43:25.330643 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:43:25.330643 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:43:25.330643 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:43:25.330643 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:43:25.330643 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:43:25.330643 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:43:25.330643 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:43:25.330643 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:43:25.330643 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:43:25.330643 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:43:25.330643 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 14:43:25.330643 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:43:25.333495 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 158/313] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Sep 19 14:43:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:43:25.341130 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492e44dc-6218-47c3-9218-3a5641df726f None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:25.453228 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492e44dc-6218-47c3-9218-3a5641df726f None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:25.489758 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f7b66b-7d67-4377-9f86-8766cdcd6b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:25.490383 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f7b66b-7d67-4377-9f86-8766cdcd6b24 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:25.490668 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f7b66b-7d67-4377-9f86-8766cdcd6b24 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:25.490952 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f7b66b-7d67-4377-9f86-8766cdcd6b24 None admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:25.491616 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f7b66b-7d67-4377-9f86-8766cdcd6b24 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:25.491922 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f7b66b-7d67-4377-9f86-8766cdcd6b24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:25.493363 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f7b66b-7d67-4377-9f86-8766cdcd6b24 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:25.502666 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 156/314] 10.222.0.72 () {56 vars in 1101 bytes} [Mon Sep 19 14:43:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:25.508306 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d303a27-1e98-4e55-a535-49bad524f0e1 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:25.618411 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d303a27-1e98-4e55-a535-49bad524f0e1 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:25.627240 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:25.657322 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddab679-0926-47cc-b33f-c70954deef8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:25.657957 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddab679-0926-47cc-b33f-c70954deef8f None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:25.658233 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddab679-0926-47cc-b33f-c70954deef8f None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:25.658502 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddab679-0926-47cc-b33f-c70954deef8f None admin] PATH_INFO: `/v3/users/38fa0076fdca498ab2fcc3de27d965af` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:25.661025 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddab679-0926-47cc-b33f-c70954deef8f None admin] RBAC: Authorizing `identity:get_user(user_id=38fa0076fdca498ab2fcc3de27d965af)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:25.662779 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddab679-0926-47cc-b33f-c70954deef8f None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:25.664704 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 159/315] 10.222.0.72 () {56 vars in 1177 bytes} [Mon Sep 19 14:43:25 2022] GET /identity/v3/users/38fa0076fdca498ab2fcc3de27d965af => generated 297 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:25.671183 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f7b66b-7d67-4377-9f86-8766cdcd6b24 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:25.734267 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:25.781016 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f7b66b-7d67-4377-9f86-8766cdcd6b24 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:25.816174 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992d602c-a77e-446b-86f7-c5c99c7bc658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:25.816814 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992d602c-a77e-446b-86f7-c5c99c7bc658 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:25.817092 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992d602c-a77e-446b-86f7-c5c99c7bc658 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:25.817361 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992d602c-a77e-446b-86f7-c5c99c7bc658 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:25.888025 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992d602c-a77e-446b-86f7-c5c99c7bc658 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:25.889613 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992d602c-a77e-446b-86f7-c5c99c7bc658 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:25.966483 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:25.992872 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 157/316] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Sep 19 14:43:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 14:43:25.998751 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddab679-0926-47cc-b33f-c70954deef8f None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:26.106578 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddab679-0926-47cc-b33f-c70954deef8f None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:26.142633 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26184797-d491-4bb0-a5f6-cf09998555be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:26.143187 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26184797-d491-4bb0-a5f6-cf09998555be None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:26.143470 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26184797-d491-4bb0-a5f6-cf09998555be None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:26.143742 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26184797-d491-4bb0-a5f6-cf09998555be None admin] PATH_INFO: `/v3/projects/4a1ea1922c4946d79ba6bac82ade352e` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:26.144888 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26184797-d491-4bb0-a5f6-cf09998555be None admin] RBAC: Authorizing `identity:get_project(project_id=4a1ea1922c4946d79ba6bac82ade352e)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:26.146328 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26184797-d491-4bb0-a5f6-cf09998555be None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:26.147965 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 160/317] 10.222.0.72 () {56 vars in 1186 bytes} [Mon Sep 19 14:43:25 2022] GET /identity/v3/projects/4a1ea1922c4946d79ba6bac82ade352e => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:26.154070 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992d602c-a77e-446b-86f7-c5c99c7bc658 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:26.260253 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992d602c-a77e-446b-86f7-c5c99c7bc658 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:26.295530 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe13743e-4745-4791-8690-9d9dea895c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:26.296134 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe13743e-4745-4791-8690-9d9dea895c28 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:26.296437 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe13743e-4745-4791-8690-9d9dea895c28 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:26.296730 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe13743e-4745-4791-8690-9d9dea895c28 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:26.297447 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe13743e-4745-4791-8690-9d9dea895c28 None admin] RBAC: Adding query filter params (role.id=dc1fc2b7f53a4f1084d0ecf5473f9dce, scope.project.id=4a1ea1922c4946d79ba6bac82ade352e, user.id=38fa0076fdca498ab2fcc3de27d965af) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:26.297751 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe13743e-4745-4791-8690-9d9dea895c28 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:26.299166 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe13743e-4745-4791-8690-9d9dea895c28 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:26.305372 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 158/318] 10.222.0.72 () {56 vars in 1374 bytes} [Mon Sep 19 14:43:26 2022] GET /identity/v3/role_assignments?user.id=38fa0076fdca498ab2fcc3de27d965af&scope.project.id=4a1ea1922c4946d79ba6bac82ade352e&role.id=dc1fc2b7f53a4f1084d0ecf5473f9dce => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:26.938085 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58934191-7fd5-44c2-860b-c7b84119ceab None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:26.938390 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58934191-7fd5-44c2-860b-c7b84119ceab None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:26.938630 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58934191-7fd5-44c2-860b-c7b84119ceab None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:26.939994 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 161/319] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:43:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:43:26.945080 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63513fe-1dd7-47d7-a517-41a74b01303e None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:26.945501 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63513fe-1dd7-47d7-a517-41a74b01303e None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:26.945671 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63513fe-1dd7-47d7-a517-41a74b01303e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:26.963390 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-d63513fe-1dd7-47d7-a517-41a74b01303e None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:43:26.964610 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-d63513fe-1dd7-47d7-a517-41a74b01303e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:43:26.978145 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:27.044233 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 159/320] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:43:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:43:27.204987 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e34e40-c999-44f5-b901-936f4f338110 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:27.205471 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e34e40-c999-44f5-b901-936f4f338110 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:27.205471 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e34e40-c999-44f5-b901-936f4f338110 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:27.206901 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 162/321] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:43:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:43:27.211859 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5016cd-80c0-4237-9aa9-4c07b7baed76 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:27.212152 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5016cd-80c0-4237-9aa9-4c07b7baed76 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:27.212463 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5016cd-80c0-4237-9aa9-4c07b7baed76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:27.231706 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-fd5016cd-80c0-4237-9aa9-4c07b7baed76 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:43:27.232907 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-fd5016cd-80c0-4237-9aa9-4c07b7baed76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:43:27.301155 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 160/322] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:43:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:43:27.315995 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e34e40-c999-44f5-b901-936f4f338110 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:27.366755 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:27.426996 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e34e40-c999-44f5-b901-936f4f338110 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:27.452951 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca11b4c0-fcd7-40ca-81bd-c4c9361585e9 None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:27.453293 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca11b4c0-fcd7-40ca-81bd-c4c9361585e9 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:27.453507 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca11b4c0-fcd7-40ca-81bd-c4c9361585e9 None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:27.454850 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 161/323] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:43:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 14:43:27.459766 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f984e1-0564-4b25-b2bb-c9509db1ea35 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:27.460051 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f984e1-0564-4b25-b2bb-c9509db1ea35 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:27.460343 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f984e1-0564-4b25-b2bb-c9509db1ea35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:27.461696 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ed8781-a141-47c0-bd17-6ad37c1eeb48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:27.462321 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ed8781-a141-47c0-bd17-6ad37c1eeb48 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:27.462593 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ed8781-a141-47c0-bd17-6ad37c1eeb48 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:27.462915 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ed8781-a141-47c0-bd17-6ad37c1eeb48 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:27.463962 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ed8781-a141-47c0-bd17-6ad37c1eeb48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:27.466062 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ed8781-a141-47c0-bd17-6ad37c1eeb48 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:27.467862 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 163/324] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:43:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:27.472917 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ed8781-a141-47c0-bd17-6ad37c1eeb48 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:27.478806 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-74f984e1-0564-4b25-b2bb-c9509db1ea35 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:43:27.479969 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-74f984e1-0564-4b25-b2bb-c9509db1ea35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:43:27.552838 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 162/325] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:43:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 14:43:27.574681 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f984e1-0564-4b25-b2bb-c9509db1ea35 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:27.581452 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ed8781-a141-47c0-bd17-6ad37c1eeb48 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:27.585292 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:27.594078 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:27.618641 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eadc56-f4b2-4020-b153-69c4c81ecbee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:27.619248 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eadc56-f4b2-4020-b153-69c4c81ecbee None admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:27.619526 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eadc56-f4b2-4020-b153-69c4c81ecbee None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:27.619803 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eadc56-f4b2-4020-b153-69c4c81ecbee None admin] PATH_INFO: `/v3/groups` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:27.620458 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eadc56-f4b2-4020-b153-69c4c81ecbee None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:27.622038 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eadc56-f4b2-4020-b153-69c4c81ecbee None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:27.640115 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 164/326] 10.222.0.72 () {60 vars in 1134 bytes} [Mon Sep 19 14:43:27 2022] POST /identity/v3/groups => generated 226 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 14:43:27.687883 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f984e1-0564-4b25-b2bb-c9509db1ea35 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:27.725807 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69915715-bc25-47ae-92d7-61ea5e50ddec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:27.726371 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69915715-bc25-47ae-92d7-61ea5e50ddec None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:27.726645 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69915715-bc25-47ae-92d7-61ea5e50ddec None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:27.726913 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69915715-bc25-47ae-92d7-61ea5e50ddec None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:27.738983 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69915715-bc25-47ae-92d7-61ea5e50ddec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:43:27.744016 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-69915715-bc25-47ae-92d7-61ea5e50ddec None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 14:43:27.744016 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:27.744016 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:43:27.744016 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:43:27.744016 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:43:27.744016 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:43:27.744016 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:43:27.744016 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:43:27.744016 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:43:27.744016 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:43:27.744016 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:43:27.744016 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:43:27.744016 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:43:27.744016 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:43:27.744016 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:43:27.744016 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:43:27.745108 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:43:27.745108 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:43:27.745108 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:43:27.745108 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:43:27.745108 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:43:27.745108 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:43:27.745108 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:43:27.745108 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:43:27.745108 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:43:27.745108 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:43:27.745108 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:43:27.745108 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:43:27.745108 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:43:27.745108 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:43:27.745108 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:43:27.745108 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:43:27.749252 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:43:27.749252 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:43:27.749252 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:43:27.749252 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:43:27.749252 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:43:27.749252 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:43:27.749252 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:43:27.749252 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:43:27.749252 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:43:27.749252 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:43:27.749252 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 14:43:27.749252 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:43:27.749252 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 163/327] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Sep 19 14:43:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:43:27.751461 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eadc56-f4b2-4020-b153-69c4c81ecbee None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:27.825262 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69915715-bc25-47ae-92d7-61ea5e50ddec None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:27.865040 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eadc56-f4b2-4020-b153-69c4c81ecbee None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:27.899006 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:27.900794 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1542d7-8d7d-46d5-95d7-36eda5c8166f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:27.901432 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1542d7-8d7d-46d5-95d7-36eda5c8166f None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:27.902635 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1542d7-8d7d-46d5-95d7-36eda5c8166f None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:27.902915 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1542d7-8d7d-46d5-95d7-36eda5c8166f None admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:27.906145 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1542d7-8d7d-46d5-95d7-36eda5c8166f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:27.906145 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1542d7-8d7d-46d5-95d7-36eda5c8166f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:27.906145 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1542d7-8d7d-46d5-95d7-36eda5c8166f None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:27.917983 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 165/328] 10.222.0.72 () {56 vars in 1101 bytes} [Mon Sep 19 14:43:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:43:27.923661 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1542d7-8d7d-46d5-95d7-36eda5c8166f None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:27.942741 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69915715-bc25-47ae-92d7-61ea5e50ddec None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:27.961895 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:27.988197 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6b99b6-0d00-4223-b5db-616618d07fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:27.989067 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b99b6-0d00-4223-b5db-616618d07fb5 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:27.989665 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b99b6-0d00-4223-b5db-616618d07fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:27.989938 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b99b6-0d00-4223-b5db-616618d07fb5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:28.007224 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6b99b6-0d00-4223-b5db-616618d07fb5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:43:28.013539 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-fe6b99b6-0d00-4223-b5db-616618d07fb5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 14:43:28.013539 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:28.013539 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:43:28.013539 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:43:28.013539 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:43:28.013539 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:43:28.013539 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:43:28.013539 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:43:28.013539 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:43:28.013539 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:43:28.013539 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:43:28.013539 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:43:28.013539 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:43:28.013539 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:43:28.013539 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:43:28.013539 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:43:28.014420 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:43:28.014420 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:43:28.014420 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:43:28.014420 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:43:28.014420 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:43:28.014420 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:43:28.014420 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:43:28.014420 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:43:28.014420 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:43:28.014420 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:43:28.014420 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:43:28.014420 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:43:28.014420 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:43:28.014420 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:43:28.014420 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:43:28.014420 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:43:28.015198 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:43:28.015198 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:43:28.015198 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:43:28.015198 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:43:28.015198 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:43:28.015198 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:43:28.015198 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:43:28.015198 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:43:28.015198 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:43:28.015198 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:43:28.015198 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 14:43:28.015198 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:43:28.015198 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 164/329] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Sep 19 14:43:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:43:28.020527 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6b99b6-0d00-4223-b5db-616618d07fb5 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:28.057529 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1542d7-8d7d-46d5-95d7-36eda5c8166f None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:28.099519 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aecf9df-2691-4055-927f-b575ba372b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:28.100302 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aecf9df-2691-4055-927f-b575ba372b9a None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:28.101056 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aecf9df-2691-4055-927f-b575ba372b9a None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:28.101449 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aecf9df-2691-4055-927f-b575ba372b9a None admin] PATH_INFO: `/v3/users/3f4aeed0227d4f46a5318cd7d7c1e986` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:28.102874 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aecf9df-2691-4055-927f-b575ba372b9a None admin] RBAC: Authorizing `identity:get_user(user_id=3f4aeed0227d4f46a5318cd7d7c1e986)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:28.104317 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aecf9df-2691-4055-927f-b575ba372b9a None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:28.106650 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 166/330] 10.222.0.72 () {56 vars in 1177 bytes} [Mon Sep 19 14:43:27 2022] GET /identity/v3/users/3f4aeed0227d4f46a5318cd7d7c1e986 => generated 293 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:43:28.112234 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aecf9df-2691-4055-927f-b575ba372b9a None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:28.146793 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6b99b6-0d00-4223-b5db-616618d07fb5 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:28.184368 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:28.192762 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83102aef-5e08-4868-a459-125feba79078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:28.193529 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83102aef-5e08-4868-a459-125feba79078 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:28.193809 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83102aef-5e08-4868-a459-125feba79078 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:28.194082 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83102aef-5e08-4868-a459-125feba79078 None admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:28.194748 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83102aef-5e08-4868-a459-125feba79078 None admin] RBAC: Adding query filter params (name=member) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:28.195049 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83102aef-5e08-4868-a459-125feba79078 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:28.197295 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83102aef-5e08-4868-a459-125feba79078 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:28.213154 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 165/331] 10.222.0.72 () {56 vars in 1101 bytes} [Mon Sep 19 14:43:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:28.216275 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83102aef-5e08-4868-a459-125feba79078 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:28.245160 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:28.251240 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aecf9df-2691-4055-927f-b575ba372b9a None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:28.301335 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256dd028-e96b-426e-a66a-ff049a7cf61e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:28.302228 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256dd028-e96b-426e-a66a-ff049a7cf61e None admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:28.302648 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256dd028-e96b-426e-a66a-ff049a7cf61e None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:28.303061 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256dd028-e96b-426e-a66a-ff049a7cf61e None admin] PATH_INFO: `/v3/system/users/3f4aeed0227d4f46a5318cd7d7c1e986/roles/dc1fc2b7f53a4f1084d0ecf5473f9dce` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:28.304684 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256dd028-e96b-426e-a66a-ff049a7cf61e None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=3f4aeed0227d4f46a5318cd7d7c1e986, role_id=dc1fc2b7f53a4f1084d0ecf5473f9dce)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:28.306992 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256dd028-e96b-426e-a66a-ff049a7cf61e None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:28.318481 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 167/332] 10.222.0.72 () {58 vars in 1334 bytes} [Mon Sep 19 14:43:28 2022] PUT /identity/v3/system/users/3f4aeed0227d4f46a5318cd7d7c1e986/roles/dc1fc2b7f53a4f1084d0ecf5473f9dce => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 14:43:28.344149 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83102aef-5e08-4868-a459-125feba79078 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:28.386955 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f8ec52-9f4c-4073-8878-3faa40bf7914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:28.387701 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f8ec52-9f4c-4073-8878-3faa40bf7914 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:28.387985 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f8ec52-9f4c-4073-8878-3faa40bf7914 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:28.388309 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f8ec52-9f4c-4073-8878-3faa40bf7914 None admin] PATH_INFO: `/v3/users/a84df62fea8547c7a1cc2fe4fdbe6643` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:28.389755 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f8ec52-9f4c-4073-8878-3faa40bf7914 None admin] RBAC: Authorizing `identity:get_user(user_id=a84df62fea8547c7a1cc2fe4fdbe6643)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:28.391354 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f8ec52-9f4c-4073-8878-3faa40bf7914 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:28.393266 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 166/333] 10.222.0.72 () {56 vars in 1177 bytes} [Mon Sep 19 14:43:28 2022] GET /identity/v3/users/a84df62fea8547c7a1cc2fe4fdbe6643 => generated 293 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:43:28.399607 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256dd028-e96b-426e-a66a-ff049a7cf61e None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:28.520899 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256dd028-e96b-426e-a66a-ff049a7cf61e None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:28.559014 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0c31b7-3eac-4147-8e6c-304eb0f768df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:28.559603 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0c31b7-3eac-4147-8e6c-304eb0f768df None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:28.559884 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0c31b7-3eac-4147-8e6c-304eb0f768df None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:28.560155 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0c31b7-3eac-4147-8e6c-304eb0f768df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:28.560919 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0c31b7-3eac-4147-8e6c-304eb0f768df None admin] RBAC: Adding query filter params (role.id=efa0e5b3413748dc828a89b12d67df79, user.id=a84df62fea8547c7a1cc2fe4fdbe6643, scope.system=all) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:28.561229 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0c31b7-3eac-4147-8e6c-304eb0f768df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:28.562759 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0c31b7-3eac-4147-8e6c-304eb0f768df None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:28.578295 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 168/334] 10.222.0.72 () {56 vars in 1308 bytes} [Mon Sep 19 14:43:28 2022] GET /identity/v3/role_assignments?user.id=a84df62fea8547c7a1cc2fe4fdbe6643&scope.system=all&role.id=efa0e5b3413748dc828a89b12d67df79 => generated 510 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:30.100575 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc08c19-3038-47dd-a32c-2093521936a4 None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:30.101075 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc08c19-3038-47dd-a32c-2093521936a4 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:30.101177 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc08c19-3038-47dd-a32c-2093521936a4 None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:30.102459 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 167/335] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:43:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:43:30.108172 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac0edd3-6988-4896-9205-017f55df8c6b None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:30.108625 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac0edd3-6988-4896-9205-017f55df8c6b None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:30.108799 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac0edd3-6988-4896-9205-017f55df8c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:30.133410 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-4ac0edd3-6988-4896-9205-017f55df8c6b None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:43:30.134621 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-4ac0edd3-6988-4896-9205-017f55df8c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:43:30.156206 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:30.225186 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 169/336] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:43:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 14:43:30.794903 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e430c7-7c3c-4795-8ac1-d0a0f9e943da None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:30.795223 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e430c7-7c3c-4795-8ac1-d0a0f9e943da None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:30.795457 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e430c7-7c3c-4795-8ac1-d0a0f9e943da None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:30.796977 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 168/337] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:43:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:43:30.798105 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac0edd3-6988-4896-9205-017f55df8c6b None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:30.802288 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc0be1-5e11-483c-8a9a-e4d87bc455a9 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:30.802575 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc0be1-5e11-483c-8a9a-e4d87bc455a9 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:30.802851 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc0be1-5e11-483c-8a9a-e4d87bc455a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:30.833364 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-81bc0be1-5e11-483c-8a9a-e4d87bc455a9 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:43:30.834586 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-81bc0be1-5e11-483c-8a9a-e4d87bc455a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:43:30.962157 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac0edd3-6988-4896-9205-017f55df8c6b None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:30.967935 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:31.003939 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 169/338] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:43:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 14:43:31.030960 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2c3ac3-7b11-473d-8b31-e56c29924a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:31.031605 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2c3ac3-7b11-473d-8b31-e56c29924a7a None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:31.031885 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2c3ac3-7b11-473d-8b31-e56c29924a7a None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:31.032155 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2c3ac3-7b11-473d-8b31-e56c29924a7a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:31.045900 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2c3ac3-7b11-473d-8b31-e56c29924a7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:43:31.050943 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-9e2c3ac3-7b11-473d-8b31-e56c29924a7a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 14:43:31.050943 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:31.050943 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:43:31.050943 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:43:31.050943 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:43:31.050943 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:43:31.050943 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:43:31.050943 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:43:31.050943 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:43:31.050943 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:43:31.050943 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:43:31.050943 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:43:31.050943 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:43:31.050943 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:43:31.050943 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:43:31.050943 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:43:31.051819 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:43:31.051819 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:43:31.051819 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:43:31.051819 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:43:31.051819 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:43:31.051819 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:43:31.051819 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:43:31.051819 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:43:31.051819 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:43:31.051819 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:43:31.051819 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:43:31.051819 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:43:31.051819 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:43:31.051819 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:43:31.051819 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:43:31.051819 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:43:31.052600 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:43:31.052600 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:43:31.052600 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:43:31.052600 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:43:31.052600 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:43:31.052600 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:43:31.052600 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:43:31.052600 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:43:31.052600 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:43:31.052600 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:43:31.052600 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 14:43:31.052600 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:43:31.052600 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 170/339] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Sep 19 14:43:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:43:31.058195 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bc0be1-5e11-483c-8a9a-e4d87bc455a9 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:31.078882 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941f6582-dc47-4feb-bd32-ae80bf37211b None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:31.079184 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941f6582-dc47-4feb-bd32-ae80bf37211b None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:31.079437 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941f6582-dc47-4feb-bd32-ae80bf37211b None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:31.080977 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 171/340] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:43:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 14:43:31.085885 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6d0c6e-01ca-4f83-b3d1-6c88f105d4b2 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:31.086190 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6d0c6e-01ca-4f83-b3d1-6c88f105d4b2 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:31.086435 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6d0c6e-01ca-4f83-b3d1-6c88f105d4b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:31.122556 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-7f6d0c6e-01ca-4f83-b3d1-6c88f105d4b2 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:43:31.123751 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-7f6d0c6e-01ca-4f83-b3d1-6c88f105d4b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:43:31.144664 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:31.242570 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bc0be1-5e11-483c-8a9a-e4d87bc455a9 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:31.278180 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 172/341] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:43:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:43:31.292280 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8bae36-c900-49a9-a495-5b0ddddc4ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:31.293481 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8bae36-c900-49a9-a495-5b0ddddc4ae1 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:31.293713 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8bae36-c900-49a9-a495-5b0ddddc4ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:31.293978 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8bae36-c900-49a9-a495-5b0ddddc4ae1 None admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:31.294645 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8bae36-c900-49a9-a495-5b0ddddc4ae1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:31.294941 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8bae36-c900-49a9-a495-5b0ddddc4ae1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:31.296365 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8bae36-c900-49a9-a495-5b0ddddc4ae1 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:31.305287 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 170/342] 10.222.0.72 () {56 vars in 1101 bytes} [Mon Sep 19 14:43:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:31.311150 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6d0c6e-01ca-4f83-b3d1-6c88f105d4b2 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:31.367493 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8bae36-c900-49a9-a495-5b0ddddc4ae1 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:31.445930 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:31.472121 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6d0c6e-01ca-4f83-b3d1-6c88f105d4b2 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:31.505390 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8bae36-c900-49a9-a495-5b0ddddc4ae1 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:31.535605 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b518dc2-1bee-40e9-b1b9-35ea67e0bed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:31.536276 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b518dc2-1bee-40e9-b1b9-35ea67e0bed1 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:31.536708 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b518dc2-1bee-40e9-b1b9-35ea67e0bed1 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:31.537027 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b518dc2-1bee-40e9-b1b9-35ea67e0bed1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:31.554485 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479098f6-8c62-4f5c-9b67-f67c3ea25152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:31.555057 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479098f6-8c62-4f5c-9b67-f67c3ea25152 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:31.555341 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479098f6-8c62-4f5c-9b67-f67c3ea25152 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:31.555597 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479098f6-8c62-4f5c-9b67-f67c3ea25152 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:31.565130 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:31.578922 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479098f6-8c62-4f5c-9b67-f67c3ea25152 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:43:31.585306 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-479098f6-8c62-4f5c-9b67-f67c3ea25152 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 14:43:31.585306 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:31.585306 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:43:31.585306 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:43:31.585306 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:43:31.585306 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:43:31.585306 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:43:31.585306 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:43:31.585306 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:43:31.585306 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:43:31.585306 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:43:31.585306 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:43:31.585306 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:43:31.585306 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:43:31.585306 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:43:31.585306 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:43:31.586209 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:43:31.586209 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:43:31.586209 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:43:31.586209 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:43:31.586209 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:43:31.586209 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:43:31.586209 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:43:31.586209 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:43:31.586209 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:43:31.586209 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:43:31.586209 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:43:31.586209 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:43:31.586209 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:43:31.586209 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:43:31.586209 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:43:31.586209 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:43:31.590546 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:43:31.590546 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:43:31.590546 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:43:31.590546 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:43:31.590546 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:43:31.590546 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:43:31.590546 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:43:31.590546 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:43:31.590546 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:43:31.590546 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:43:31.590546 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 14:43:31.590546 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:43:31.590546 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 171/343] 10.222.0.72 () {56 vars in 1114 bytes} [Mon Sep 19 14:43:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:43:31.593712 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479098f6-8c62-4f5c-9b67-f67c3ea25152 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:31.710032 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b518dc2-1bee-40e9-b1b9-35ea67e0bed1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:31.711509 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b518dc2-1bee-40e9-b1b9-35ea67e0bed1 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:31.767039 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479098f6-8c62-4f5c-9b67-f67c3ea25152 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:31.779259 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:31.815785 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac5ff0b-ece6-49df-8e7e-3c14b000acaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:31.816319 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac5ff0b-ece6-49df-8e7e-3c14b000acaf None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:31.816624 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac5ff0b-ece6-49df-8e7e-3c14b000acaf None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:31.816893 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac5ff0b-ece6-49df-8e7e-3c14b000acaf None admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:31.817556 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac5ff0b-ece6-49df-8e7e-3c14b000acaf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:31.817854 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac5ff0b-ece6-49df-8e7e-3c14b000acaf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:31.819210 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac5ff0b-ece6-49df-8e7e-3c14b000acaf None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:31.831888 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 172/344] 10.222.0.72 () {56 vars in 1111 bytes} [Mon Sep 19 14:43:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:43:31.833062 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac5ff0b-ece6-49df-8e7e-3c14b000acaf None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:31.897670 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 173/345] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Sep 19 14:43:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 587 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 14:43:31.899013 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573c5f33-13e5-4c73-940f-d0b5c82feb93 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:31.899471 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573c5f33-13e5-4c73-940f-d0b5c82feb93 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:31.899747 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573c5f33-13e5-4c73-940f-d0b5c82feb93 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:31.902954 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 174/346] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:43:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:43:31.908775 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573c5f33-13e5-4c73-940f-d0b5c82feb93 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:31.974062 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:31.976810 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac5ff0b-ece6-49df-8e7e-3c14b000acaf None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:32.025620 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2950436-e1a1-469c-8afc-4f1916373fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:32.026511 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2950436-e1a1-469c-8afc-4f1916373fc2 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:32.026795 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2950436-e1a1-469c-8afc-4f1916373fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:32.028242 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2950436-e1a1-469c-8afc-4f1916373fc2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:32.042714 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2950436-e1a1-469c-8afc-4f1916373fc2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:43:32.050293 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573c5f33-13e5-4c73-940f-d0b5c82feb93 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:32.050421 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-b2950436-e1a1-469c-8afc-4f1916373fc2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 14:43:32.050421 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:32.050421 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:43:32.050421 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:43:32.050421 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:43:32.050421 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:43:32.050421 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:43:32.050421 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:43:32.050421 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:43:32.050421 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:43:32.050421 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:43:32.050421 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:43:32.050421 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:43:32.050421 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:43:32.050421 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:43:32.050421 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:43:32.051335 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:43:32.051335 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:43:32.051335 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:43:32.051335 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:43:32.051335 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:43:32.051335 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:43:32.051335 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:43:32.051335 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:43:32.051335 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:43:32.051335 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:43:32.051335 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:43:32.051335 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:43:32.051335 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:43:32.051335 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:43:32.051335 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:43:32.051335 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:43:32.052898 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:43:32.052898 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:43:32.052898 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:43:32.052898 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:43:32.052898 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:43:32.052898 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:43:32.052898 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:43:32.052898 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:43:32.052898 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:43:32.052898 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:43:32.052898 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 14:43:32.052898 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:43:32.052898 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 173/347] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Sep 19 14:43:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:43:32.054452 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2950436-e1a1-469c-8afc-4f1916373fc2 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:32.094547 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99af733-fc4c-4bdc-8367-b4253278e313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:32.095078 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99af733-fc4c-4bdc-8367-b4253278e313 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:32.095354 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99af733-fc4c-4bdc-8367-b4253278e313 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:32.095625 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99af733-fc4c-4bdc-8367-b4253278e313 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:32.099192 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:32.169011 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99af733-fc4c-4bdc-8367-b4253278e313 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:32.170479 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99af733-fc4c-4bdc-8367-b4253278e313 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:32.177845 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2950436-e1a1-469c-8afc-4f1916373fc2 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:32.215455 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:32.217687 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1996b0-1f21-4a62-ba90-dfb43889baec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:32.218664 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1996b0-1f21-4a62-ba90-dfb43889baec None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:32.219146 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1996b0-1f21-4a62-ba90-dfb43889baec None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:32.219875 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1996b0-1f21-4a62-ba90-dfb43889baec None admin] PATH_INFO: `/v3/projects/f2d0f3b33b264908b42ee8c76c5527f3` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:32.221726 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1996b0-1f21-4a62-ba90-dfb43889baec None admin] RBAC: Authorizing `identity:get_project(project_id=f2d0f3b33b264908b42ee8c76c5527f3)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:32.223449 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1996b0-1f21-4a62-ba90-dfb43889baec None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:32.225374 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 174/348] 10.222.0.72 () {56 vars in 1186 bytes} [Mon Sep 19 14:43:32 2022] GET /identity/v3/projects/f2d0f3b33b264908b42ee8c76c5527f3 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:32.226641 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984d518b-6e3d-4e04-87e2-ac2efa4f40f7 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:32.227157 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984d518b-6e3d-4e04-87e2-ac2efa4f40f7 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:32.227625 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984d518b-6e3d-4e04-87e2-ac2efa4f40f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:32.247170 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-984d518b-6e3d-4e04-87e2-ac2efa4f40f7 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:43:32.249111 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-984d518b-6e3d-4e04-87e2-ac2efa4f40f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:43:32.281442 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 175/349] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Sep 19 14:43:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 14:43:32.282287 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99af733-fc4c-4bdc-8367-b4253278e313 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:32.325716 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 175/350] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:43:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:43:32.327005 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984d518b-6e3d-4e04-87e2-ac2efa4f40f7 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:32.360678 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:32.421444 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99af733-fc4c-4bdc-8367-b4253278e313 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:32.439429 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984d518b-6e3d-4e04-87e2-ac2efa4f40f7 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:32.479966 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89711c26-e554-4ca8-b259-4b597b021c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:32.480873 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89711c26-e554-4ca8-b259-4b597b021c73 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:32.481314 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89711c26-e554-4ca8-b259-4b597b021c73 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:32.481595 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89711c26-e554-4ca8-b259-4b597b021c73 None admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:32.481978 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ed918b-0123-4b1e-bd0f-7b14ede67666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:32.482259 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89711c26-e554-4ca8-b259-4b597b021c73 None admin] RBAC: Adding query filter params (name=member) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:32.482558 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89711c26-e554-4ca8-b259-4b597b021c73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:32.483220 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ed918b-0123-4b1e-bd0f-7b14ede67666 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:32.483776 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ed918b-0123-4b1e-bd0f-7b14ede67666 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:32.484029 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89711c26-e554-4ca8-b259-4b597b021c73 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:32.484476 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ed918b-0123-4b1e-bd0f-7b14ede67666 None admin] PATH_INFO: `/v3/groups/6d3f2ba43f564d788da119d6fd102c8d` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:32.491349 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ed918b-0123-4b1e-bd0f-7b14ede67666 None admin] RBAC: Authorizing `identity:get_group(group_id=6d3f2ba43f564d788da119d6fd102c8d)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:32.493176 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ed918b-0123-4b1e-bd0f-7b14ede67666 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:32.495080 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 176/351] 10.222.0.72 () {56 vars in 1180 bytes} [Mon Sep 19 14:43:32 2022] GET /identity/v3/groups/6d3f2ba43f564d788da119d6fd102c8d => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:32.496767 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ed918b-0123-4b1e-bd0f-7b14ede67666 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:32.499012 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 176/352] 10.222.0.72 () {56 vars in 1101 bytes} [Mon Sep 19 14:43:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:32.501509 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89711c26-e554-4ca8-b259-4b597b021c73 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:32.507732 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:32.609870 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:32.618211 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ed918b-0123-4b1e-bd0f-7b14ede67666 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:32.658190 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f24384-698b-47de-861f-fbb6f559b411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:32.659181 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f24384-698b-47de-861f-fbb6f559b411 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:32.659671 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f24384-698b-47de-861f-fbb6f559b411 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:32.660261 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f24384-698b-47de-861f-fbb6f559b411 None admin] PATH_INFO: `/v3/projects/f2d0f3b33b264908b42ee8c76c5527f3` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:32.661693 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f24384-698b-47de-861f-fbb6f559b411 None admin] RBAC: Authorizing `identity:get_project(project_id=f2d0f3b33b264908b42ee8c76c5527f3)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:32.663741 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f24384-698b-47de-861f-fbb6f559b411 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:32.665880 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 177/353] 10.222.0.72 () {56 vars in 1186 bytes} [Mon Sep 19 14:43:32 2022] GET /identity/v3/projects/f2d0f3b33b264908b42ee8c76c5527f3 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:32.666993 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f24384-698b-47de-861f-fbb6f559b411 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:32.689153 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89711c26-e554-4ca8-b259-4b597b021c73 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:32.749435 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476d119d-456b-4804-ac3b-96e7ed697219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:32.750073 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476d119d-456b-4804-ac3b-96e7ed697219 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:32.750736 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476d119d-456b-4804-ac3b-96e7ed697219 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:32.751019 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476d119d-456b-4804-ac3b-96e7ed697219 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:32.751753 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476d119d-456b-4804-ac3b-96e7ed697219 None admin] RBAC: Adding query filter params (group.id=6d3f2ba43f564d788da119d6fd102c8d, role.id=efa0e5b3413748dc828a89b12d67df79, scope.project.id=f2d0f3b33b264908b42ee8c76c5527f3) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:32.752062 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476d119d-456b-4804-ac3b-96e7ed697219 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:32.755521 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476d119d-456b-4804-ac3b-96e7ed697219 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:32.762447 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 177/354] 10.222.0.72 () {56 vars in 1376 bytes} [Mon Sep 19 14:43:32 2022] GET /identity/v3/role_assignments?group.id=6d3f2ba43f564d788da119d6fd102c8d&scope.project.id=f2d0f3b33b264908b42ee8c76c5527f3&role.id=efa0e5b3413748dc828a89b12d67df79 => generated 260 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:43:32.764642 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f46c0-05ac-4bb5-b774-ccc3802c7c9c None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:32.764642 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f46c0-05ac-4bb5-b774-ccc3802c7c9c None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:32.764642 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f46c0-05ac-4bb5-b774-ccc3802c7c9c None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:32.765999 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 178/355] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:43:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:43:32.767538 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22f46c0-05ac-4bb5-b774-ccc3802c7c9c None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:32.810487 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f24384-698b-47de-861f-fbb6f559b411 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:32.856406 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789ddd0a-f7f7-42d2-a43f-6e4d69a760e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:32.857601 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ddd0a-f7f7-42d2-a43f-6e4d69a760e9 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:32.857883 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ddd0a-f7f7-42d2-a43f-6e4d69a760e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:32.858149 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ddd0a-f7f7-42d2-a43f-6e4d69a760e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:32.865585 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:32.899825 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:32.915707 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22f46c0-05ac-4bb5-b774-ccc3802c7c9c None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:32.956711 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789ddd0a-f7f7-42d2-a43f-6e4d69a760e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:32.957110 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c381fb-f064-41e7-bd35-413cbf2f1be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:32.957751 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c381fb-f064-41e7-bd35-413cbf2f1be1 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:32.958026 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c381fb-f064-41e7-bd35-413cbf2f1be1 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:32.958186 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789ddd0a-f7f7-42d2-a43f-6e4d69a760e9 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:32.958275 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c381fb-f064-41e7-bd35-413cbf2f1be1 None admin] PATH_INFO: `/v3/groups/6d3f2ba43f564d788da119d6fd102c8d` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:32.959428 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c381fb-f064-41e7-bd35-413cbf2f1be1 None admin] RBAC: Authorizing `identity:get_group(group_id=6d3f2ba43f564d788da119d6fd102c8d)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:32.961077 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c381fb-f064-41e7-bd35-413cbf2f1be1 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:32.963895 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 179/356] 10.222.0.72 () {56 vars in 1180 bytes} [Mon Sep 19 14:43:32 2022] GET /identity/v3/groups/6d3f2ba43f564d788da119d6fd102c8d => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:32.965583 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc21173-dedc-4846-9c26-950cda64399e None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:32.965872 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc21173-dedc-4846-9c26-950cda64399e None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:32.966140 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc21173-dedc-4846-9c26-950cda64399e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:32.989688 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-ccc21173-dedc-4846-9c26-950cda64399e None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:43:32.990888 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-ccc21173-dedc-4846-9c26-950cda64399e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:43:33.079138 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 180/357] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:43:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:43:33.080456 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e01371-4918-4cc4-b705-5aa46326298c None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:33.080850 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e01371-4918-4cc4-b705-5aa46326298c None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:33.081130 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e01371-4918-4cc4-b705-5aa46326298c None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:33.083142 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 181/358] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:43:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:43:33.085144 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e01371-4918-4cc4-b705-5aa46326298c None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:33.110716 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 178/359] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Sep 19 14:43:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 14:43:33.112017 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789ddd0a-f7f7-42d2-a43f-6e4d69a760e9 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:33.171543 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:33.179430 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:33.212863 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e01371-4918-4cc4-b705-5aa46326298c None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:33.219090 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789ddd0a-f7f7-42d2-a43f-6e4d69a760e9 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:33.252282 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93dfb16-f909-44fe-9887-64c8117d1914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:33.253422 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93dfb16-f909-44fe-9887-64c8117d1914 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:33.254005 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93dfb16-f909-44fe-9887-64c8117d1914 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:33.254538 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93dfb16-f909-44fe-9887-64c8117d1914 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:33.256210 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7fe99a-ec5c-49e5-b793-7df17d5b6daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:33.256939 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7fe99a-ec5c-49e5-b793-7df17d5b6daa None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:33.257289 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7fe99a-ec5c-49e5-b793-7df17d5b6daa None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:33.257714 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7fe99a-ec5c-49e5-b793-7df17d5b6daa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:33.258433 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7fe99a-ec5c-49e5-b793-7df17d5b6daa None admin] RBAC: Adding query filter params (group.id=6d3f2ba43f564d788da119d6fd102c8d, role.id=962ee04d08ae41b08c1a5108c54c7469, scope.project.id=f2d0f3b33b264908b42ee8c76c5527f3) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:33.259035 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7fe99a-ec5c-49e5-b793-7df17d5b6daa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:33.260471 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7fe99a-ec5c-49e5-b793-7df17d5b6daa None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:33.266897 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 179/360] 10.222.0.72 () {56 vars in 1376 bytes} [Mon Sep 19 14:43:33 2022] GET /identity/v3/role_assignments?group.id=6d3f2ba43f564d788da119d6fd102c8d&scope.project.id=f2d0f3b33b264908b42ee8c76c5527f3&role.id=962ee04d08ae41b08c1a5108c54c7469 => generated 260 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:33.268411 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b770c8-c1a1-455b-a0e6-e064567e95f7 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:33.268828 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b770c8-c1a1-455b-a0e6-e064567e95f7 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:33.269605 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93dfb16-f909-44fe-9887-64c8117d1914 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:43:33.270518 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b770c8-c1a1-455b-a0e6-e064567e95f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:33.276785 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-f93dfb16-f909-44fe-9887-64c8117d1914 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 14:43:33.276785 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:33.276785 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:43:33.276785 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:43:33.276785 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:43:33.276785 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:43:33.276785 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:43:33.276785 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:43:33.276785 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:43:33.276785 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:43:33.276785 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:43:33.276785 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:43:33.276785 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:43:33.276785 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:43:33.276785 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:43:33.276785 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:43:33.278805 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:43:33.278805 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:43:33.278805 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:43:33.278805 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:43:33.278805 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:43:33.278805 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:43:33.278805 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:43:33.278805 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:43:33.278805 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:43:33.278805 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:43:33.278805 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:43:33.278805 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:43:33.278805 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:43:33.278805 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:43:33.278805 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:43:33.278805 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:43:33.279628 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:43:33.279628 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:43:33.279628 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:43:33.279628 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:43:33.279628 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:43:33.279628 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:43:33.279628 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:43:33.279628 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:43:33.279628 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:43:33.279628 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:43:33.279628 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 14:43:33.279628 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:43:33.282828 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 182/361] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Sep 19 14:43:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:43:33.283906 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93dfb16-f909-44fe-9887-64c8117d1914 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:33.302313 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-98b770c8-c1a1-455b-a0e6-e064567e95f7 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:43:33.303487 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-98b770c8-c1a1-455b-a0e6-e064567e95f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:43:33.394960 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 180/362] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:43:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:43:33.398042 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b770c8-c1a1-455b-a0e6-e064567e95f7 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:33.489062 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:33.501206 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93dfb16-f909-44fe-9887-64c8117d1914 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:33.552755 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:33.559723 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b770c8-c1a1-455b-a0e6-e064567e95f7 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:33.566184 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2283d610-4383-41d0-a806-5ea79049b4fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:33.566986 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2283d610-4383-41d0-a806-5ea79049b4fc None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:33.567365 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2283d610-4383-41d0-a806-5ea79049b4fc None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:33.567909 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2283d610-4383-41d0-a806-5ea79049b4fc None admin] PATH_INFO: `/v3/projects/4a1ea1922c4946d79ba6bac82ade352e` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:33.569253 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2283d610-4383-41d0-a806-5ea79049b4fc None admin] RBAC: Authorizing `identity:get_project(project_id=4a1ea1922c4946d79ba6bac82ade352e)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:33.576351 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2283d610-4383-41d0-a806-5ea79049b4fc None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:33.579215 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 183/363] 10.222.0.72 () {56 vars in 1186 bytes} [Mon Sep 19 14:43:33 2022] GET /identity/v3/projects/4a1ea1922c4946d79ba6bac82ade352e => generated 302 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:33.580203 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2283d610-4383-41d0-a806-5ea79049b4fc None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:33.617844 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8b4b1c-2258-415a-9af4-259950388e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:33.618825 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b4b1c-2258-415a-9af4-259950388e0c None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:33.619257 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b4b1c-2258-415a-9af4-259950388e0c None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:33.619680 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b4b1c-2258-415a-9af4-259950388e0c None admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:33.621737 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8b4b1c-2258-415a-9af4-259950388e0c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:33.622208 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8b4b1c-2258-415a-9af4-259950388e0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:33.623741 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8b4b1c-2258-415a-9af4-259950388e0c None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:33.635720 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 181/364] 10.222.0.72 () {56 vars in 1101 bytes} [Mon Sep 19 14:43:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:33.635720 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8b4b1c-2258-415a-9af4-259950388e0c None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:33.708152 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2283d610-4383-41d0-a806-5ea79049b4fc None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:33.748009 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dff7fc4-7d8b-47a9-8226-239be3ff414b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:33.748622 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dff7fc4-7d8b-47a9-8226-239be3ff414b None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:33.748898 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dff7fc4-7d8b-47a9-8226-239be3ff414b None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:33.749170 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dff7fc4-7d8b-47a9-8226-239be3ff414b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:33.758853 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8b4b1c-2258-415a-9af4-259950388e0c None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:33.761111 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dff7fc4-7d8b-47a9-8226-239be3ff414b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:43:33.767420 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-4dff7fc4-7d8b-47a9-8226-239be3ff414b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 14:43:33.767420 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:33.767420 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:43:33.767420 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:43:33.767420 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:43:33.767420 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:43:33.767420 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:43:33.767420 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:43:33.767420 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:43:33.767420 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:43:33.767420 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:43:33.767420 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:43:33.767420 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:43:33.767420 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:43:33.767420 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:43:33.767420 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:43:33.768322 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:43:33.768322 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:43:33.768322 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:43:33.768322 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:43:33.768322 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:43:33.768322 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:43:33.768322 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:43:33.768322 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:43:33.768322 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:43:33.768322 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:43:33.768322 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:43:33.768322 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:43:33.768322 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:43:33.768322 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:43:33.768322 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:43:33.768322 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:43:33.769168 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:43:33.769168 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:43:33.769168 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:43:33.769168 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:43:33.769168 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:43:33.769168 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:43:33.769168 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:43:33.769168 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:43:33.769168 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:43:33.769168 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:43:33.769168 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 14:43:33.769168 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:43:33.769779 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 184/365] 10.222.0.72 () {56 vars in 1114 bytes} [Mon Sep 19 14:43:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:43:33.772000 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dff7fc4-7d8b-47a9-8226-239be3ff414b None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:33.787261 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:33.810460 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bf688e-9eb6-435d-b5a4-39b2378539e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:33.811434 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bf688e-9eb6-435d-b5a4-39b2378539e2 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:33.811919 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bf688e-9eb6-435d-b5a4-39b2378539e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:33.812382 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bf688e-9eb6-435d-b5a4-39b2378539e2 None admin] PATH_INFO: `/v3/groups/6d3f2ba43f564d788da119d6fd102c8d` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:33.813881 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bf688e-9eb6-435d-b5a4-39b2378539e2 None admin] RBAC: Authorizing `identity:get_group(group_id=6d3f2ba43f564d788da119d6fd102c8d)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:33.815524 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bf688e-9eb6-435d-b5a4-39b2378539e2 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:33.817450 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 182/366] 10.222.0.72 () {56 vars in 1180 bytes} [Mon Sep 19 14:43:33 2022] GET /identity/v3/groups/6d3f2ba43f564d788da119d6fd102c8d => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:33.818650 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bf688e-9eb6-435d-b5a4-39b2378539e2 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:33.838331 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:33.900301 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dff7fc4-7d8b-47a9-8226-239be3ff414b None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:33.954101 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2406c1d1-7e78-4160-be20-9be7ab4642b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:33.954739 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2406c1d1-7e78-4160-be20-9be7ab4642b1 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:33.955015 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2406c1d1-7e78-4160-be20-9be7ab4642b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:33.955285 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2406c1d1-7e78-4160-be20-9be7ab4642b1 None admin] PATH_INFO: `/v3/users/3f4aeed0227d4f46a5318cd7d7c1e986` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:33.957083 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2406c1d1-7e78-4160-be20-9be7ab4642b1 None admin] RBAC: Authorizing `identity:get_user(user_id=3f4aeed0227d4f46a5318cd7d7c1e986)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:33.958810 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2406c1d1-7e78-4160-be20-9be7ab4642b1 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:33.960655 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 185/367] 10.222.0.72 () {56 vars in 1177 bytes} [Mon Sep 19 14:43:33 2022] GET /identity/v3/users/3f4aeed0227d4f46a5318cd7d7c1e986 => generated 293 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:33.961604 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2406c1d1-7e78-4160-be20-9be7ab4642b1 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:33.963993 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bf688e-9eb6-435d-b5a4-39b2378539e2 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:34.009408 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5042c8d5-a03f-4c3c-b303-32c3e98764e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:34.009968 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5042c8d5-a03f-4c3c-b303-32c3e98764e6 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:34.010251 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5042c8d5-a03f-4c3c-b303-32c3e98764e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:34.010517 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5042c8d5-a03f-4c3c-b303-32c3e98764e6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:34.024287 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5042c8d5-a03f-4c3c-b303-32c3e98764e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:43:34.030862 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-5042c8d5-a03f-4c3c-b303-32c3e98764e6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:43:34.030862 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:34.030862 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:43:34.030862 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:43:34.030862 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:43:34.030862 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:43:34.030862 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:43:34.030862 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:43:34.030862 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:43:34.030862 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:43:34.030862 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:43:34.030862 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:43:34.030862 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:43:34.030862 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:43:34.030862 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:43:34.030862 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:43:34.031728 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:43:34.031728 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:43:34.031728 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:43:34.031728 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:43:34.031728 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:43:34.031728 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:43:34.031728 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:43:34.031728 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:43:34.031728 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:43:34.031728 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:43:34.031728 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:43:34.031728 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:43:34.031728 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:43:34.031728 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:43:34.031728 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:43:34.031728 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:43:34.032564 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:43:34.032564 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:43:34.032564 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:43:34.032564 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:43:34.032564 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:43:34.032564 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:43:34.032564 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:43:34.032564 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:43:34.032564 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:43:34.032564 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:43:34.032564 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:43:34.032564 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:43:34.032564 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 183/368] 10.222.0.72 () {56 vars in 1096 bytes} [Mon Sep 19 14:43:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:43:34.033216 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5042c8d5-a03f-4c3c-b303-32c3e98764e6 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:34.095476 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:34.098811 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2406c1d1-7e78-4160-be20-9be7ab4642b1 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:34.130588 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:34.144955 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a93778-32a6-421d-8ae9-38daa4959930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:34.145569 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a93778-32a6-421d-8ae9-38daa4959930 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:34.145947 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a93778-32a6-421d-8ae9-38daa4959930 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:34.146225 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a93778-32a6-421d-8ae9-38daa4959930 None admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:34.146889 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a93778-32a6-421d-8ae9-38daa4959930 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:34.147194 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a93778-32a6-421d-8ae9-38daa4959930 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:34.148746 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a93778-32a6-421d-8ae9-38daa4959930 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:34.160552 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 186/369] 10.222.0.72 () {56 vars in 1111 bytes} [Mon Sep 19 14:43:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:34.161381 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a93778-32a6-421d-8ae9-38daa4959930 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:34.161553 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5042c8d5-a03f-4c3c-b303-32c3e98764e6 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:34.201995 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d95eaa-f314-4e39-bf9a-47e3b1240e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:34.202606 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d95eaa-f314-4e39-bf9a-47e3b1240e8f None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:34.202887 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d95eaa-f314-4e39-bf9a-47e3b1240e8f None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:34.203160 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d95eaa-f314-4e39-bf9a-47e3b1240e8f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:34.203887 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d95eaa-f314-4e39-bf9a-47e3b1240e8f None admin] RBAC: Adding query filter params (group.id=6d3f2ba43f564d788da119d6fd102c8d, role.id=efa0e5b3413748dc828a89b12d67df79, scope.project.id=4a1ea1922c4946d79ba6bac82ade352e) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:34.204193 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d95eaa-f314-4e39-bf9a-47e3b1240e8f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:34.205656 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d95eaa-f314-4e39-bf9a-47e3b1240e8f None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:34.212664 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 184/370] 10.222.0.72 () {56 vars in 1376 bytes} [Mon Sep 19 14:43:34 2022] GET /identity/v3/role_assignments?group.id=6d3f2ba43f564d788da119d6fd102c8d&scope.project.id=4a1ea1922c4946d79ba6bac82ade352e&role.id=efa0e5b3413748dc828a89b12d67df79 => generated 260 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:34.213903 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d95eaa-f314-4e39-bf9a-47e3b1240e8f None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:34.297786 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a93778-32a6-421d-8ae9-38daa4959930 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:34.334474 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d95eaa-f314-4e39-bf9a-47e3b1240e8f None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:34.347508 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:34.371358 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa157bfe-e15c-429a-ab74-cb35c4f67b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:34.372155 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa157bfe-e15c-429a-ab74-cb35c4f67b11 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:34.372469 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa157bfe-e15c-429a-ab74-cb35c4f67b11 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:34.372737 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa157bfe-e15c-429a-ab74-cb35c4f67b11 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:34.373489 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa157bfe-e15c-429a-ab74-cb35c4f67b11 None admin] RBAC: Adding query filter params (role.id=dc1fc2b7f53a4f1084d0ecf5473f9dce, user.id=3f4aeed0227d4f46a5318cd7d7c1e986, scope.system=all) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:34.373839 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa157bfe-e15c-429a-ab74-cb35c4f67b11 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:34.375349 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa157bfe-e15c-429a-ab74-cb35c4f67b11 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:34.376807 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988247e1-5d52-46c2-8334-cd61e89cc648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:34.377432 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988247e1-5d52-46c2-8334-cd61e89cc648 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:34.377716 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988247e1-5d52-46c2-8334-cd61e89cc648 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:34.377987 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988247e1-5d52-46c2-8334-cd61e89cc648 None admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:34.378666 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988247e1-5d52-46c2-8334-cd61e89cc648 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:34.378959 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988247e1-5d52-46c2-8334-cd61e89cc648 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:34.380387 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988247e1-5d52-46c2-8334-cd61e89cc648 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:34.390854 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 185/371] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Sep 19 14:43:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:34.391556 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988247e1-5d52-46c2-8334-cd61e89cc648 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:34.403863 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 187/372] 10.222.0.72 () {56 vars in 1308 bytes} [Mon Sep 19 14:43:34 2022] GET /identity/v3/role_assignments?user.id=3f4aeed0227d4f46a5318cd7d7c1e986&scope.system=all&role.id=dc1fc2b7f53a4f1084d0ecf5473f9dce => generated 510 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:34.411098 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa157bfe-e15c-429a-ab74-cb35c4f67b11 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:34.497926 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:34.514413 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988247e1-5d52-46c2-8334-cd61e89cc648 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:34.556531 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ea4427-6792-42b9-8640-05799d0e018c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:34.557062 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea4427-6792-42b9-8640-05799d0e018c None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:34.557980 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea4427-6792-42b9-8640-05799d0e018c None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:34.558320 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea4427-6792-42b9-8640-05799d0e018c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:34.607874 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:34.614920 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa157bfe-e15c-429a-ab74-cb35c4f67b11 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:34.641151 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ea4427-6792-42b9-8640-05799d0e018c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:34.642644 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ea4427-6792-42b9-8640-05799d0e018c None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:34.687864 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1390b500-1c9c-4d2e-a1ab-eb2c3fc77dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:34.688653 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1390b500-1c9c-4d2e-a1ab-eb2c3fc77dcd None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:34.688937 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1390b500-1c9c-4d2e-a1ab-eb2c3fc77dcd None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:34.689324 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1390b500-1c9c-4d2e-a1ab-eb2c3fc77dcd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:34.776084 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 186/373] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Sep 19 14:43:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 14:43:34.782839 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ea4427-6792-42b9-8640-05799d0e018c None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:34.811646 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1390b500-1c9c-4d2e-a1ab-eb2c3fc77dcd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:34.813085 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1390b500-1c9c-4d2e-a1ab-eb2c3fc77dcd None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:34.884386 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:34.912860 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:34.921352 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ea4427-6792-42b9-8640-05799d0e018c None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:35.003172 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32db5501-4c89-4069-a4e5-3f5ce013f2f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:35.004082 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 188/374] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Sep 19 14:43:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 593 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 14:43:35.007153 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db5501-4c89-4069-a4e5-3f5ce013f2f7 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:35.007153 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db5501-4c89-4069-a4e5-3f5ce013f2f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:35.007153 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db5501-4c89-4069-a4e5-3f5ce013f2f7 None admin] PATH_INFO: `/v3/projects/4a1ea1922c4946d79ba6bac82ade352e` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:35.007153 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32db5501-4c89-4069-a4e5-3f5ce013f2f7 None admin] RBAC: Authorizing `identity:get_project(project_id=4a1ea1922c4946d79ba6bac82ade352e)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:35.008133 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32db5501-4c89-4069-a4e5-3f5ce013f2f7 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:35.010145 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 187/375] 10.222.0.72 () {56 vars in 1186 bytes} [Mon Sep 19 14:43:34 2022] GET /identity/v3/projects/4a1ea1922c4946d79ba6bac82ade352e => generated 302 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:43:35.010505 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1390b500-1c9c-4d2e-a1ab-eb2c3fc77dcd None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:35.019236 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32db5501-4c89-4069-a4e5-3f5ce013f2f7 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:35.142141 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1390b500-1c9c-4d2e-a1ab-eb2c3fc77dcd None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:35.154442 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32db5501-4c89-4069-a4e5-3f5ce013f2f7 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:35.190695 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f190a568-f98b-4889-9ff3-7b33b63a6220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:35.193067 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f190a568-f98b-4889-9ff3-7b33b63a6220 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:35.193714 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f190a568-f98b-4889-9ff3-7b33b63a6220 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:35.195304 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f190a568-f98b-4889-9ff3-7b33b63a6220 None admin] PATH_INFO: `/v3/projects/feee070208394133a3522f3d666241d3` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:35.197985 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f190a568-f98b-4889-9ff3-7b33b63a6220 None admin] RBAC: Authorizing `identity:get_project(project_id=feee070208394133a3522f3d666241d3)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:35.200500 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f190a568-f98b-4889-9ff3-7b33b63a6220 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:35.204229 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 189/376] 10.222.0.72 () {56 vars in 1186 bytes} [Mon Sep 19 14:43:35 2022] GET /identity/v3/projects/feee070208394133a3522f3d666241d3 => generated 344 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:43:35.209177 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aedd11-3acc-49ea-aa47-bb32d5bda0b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:35.210297 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f190a568-f98b-4889-9ff3-7b33b63a6220 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:35.211478 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aedd11-3acc-49ea-aa47-bb32d5bda0b9 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:35.213043 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aedd11-3acc-49ea-aa47-bb32d5bda0b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:35.213529 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aedd11-3acc-49ea-aa47-bb32d5bda0b9 None admin] PATH_INFO: `/v3/groups/6d3f2ba43f564d788da119d6fd102c8d` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:35.216668 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aedd11-3acc-49ea-aa47-bb32d5bda0b9 None admin] RBAC: Authorizing `identity:get_group(group_id=6d3f2ba43f564d788da119d6fd102c8d)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:35.218499 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aedd11-3acc-49ea-aa47-bb32d5bda0b9 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:35.220681 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 188/377] 10.222.0.72 () {56 vars in 1180 bytes} [Mon Sep 19 14:43:35 2022] GET /identity/v3/groups/6d3f2ba43f564d788da119d6fd102c8d => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:35.226847 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aedd11-3acc-49ea-aa47-bb32d5bda0b9 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:35.239263 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:35.240036 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:35.398805 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f190a568-f98b-4889-9ff3-7b33b63a6220 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:35.419075 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aedd11-3acc-49ea-aa47-bb32d5bda0b9 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:35.450008 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a4c4dd-f8f6-4219-b691-541dd5025bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:35.451029 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a4c4dd-f8f6-4219-b691-541dd5025bb8 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:35.451538 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a4c4dd-f8f6-4219-b691-541dd5025bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:35.452002 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a4c4dd-f8f6-4219-b691-541dd5025bb8 None admin] PATH_INFO: `/v3/groups/63c4e945afeb49dbaf6cdc00601f1a78` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:35.468908 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a4c4dd-f8f6-4219-b691-541dd5025bb8 None admin] RBAC: Authorizing `identity:get_group(group_id=63c4e945afeb49dbaf6cdc00601f1a78)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:35.470841 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a4c4dd-f8f6-4219-b691-541dd5025bb8 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:35.473044 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 190/378] 10.222.0.72 () {56 vars in 1180 bytes} [Mon Sep 19 14:43:35 2022] GET /identity/v3/groups/63c4e945afeb49dbaf6cdc00601f1a78 => generated 229 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:35.479161 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a4c4dd-f8f6-4219-b691-541dd5025bb8 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:35.484283 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa24173-ec52-4240-81bf-8e41c26d1249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:35.485588 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa24173-ec52-4240-81bf-8e41c26d1249 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:35.485588 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa24173-ec52-4240-81bf-8e41c26d1249 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:35.485588 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa24173-ec52-4240-81bf-8e41c26d1249 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:35.486174 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa24173-ec52-4240-81bf-8e41c26d1249 None admin] RBAC: Adding query filter params (group.id=6d3f2ba43f564d788da119d6fd102c8d, role.id=962ee04d08ae41b08c1a5108c54c7469, scope.project.id=4a1ea1922c4946d79ba6bac82ade352e) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:35.486482 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa24173-ec52-4240-81bf-8e41c26d1249 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:35.487915 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa24173-ec52-4240-81bf-8e41c26d1249 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:35.494041 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 189/379] 10.222.0.72 () {56 vars in 1376 bytes} [Mon Sep 19 14:43:35 2022] GET /identity/v3/role_assignments?group.id=6d3f2ba43f564d788da119d6fd102c8d&scope.project.id=4a1ea1922c4946d79ba6bac82ade352e&role.id=962ee04d08ae41b08c1a5108c54c7469 => generated 260 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:43:35.603383 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:35.647498 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a4c4dd-f8f6-4219-b691-541dd5025bb8 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:35.700993 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e8dffe-28e0-41a3-a472-8a94e26f3994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:35.701543 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e8dffe-28e0-41a3-a472-8a94e26f3994 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:35.701823 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e8dffe-28e0-41a3-a472-8a94e26f3994 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:35.702104 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e8dffe-28e0-41a3-a472-8a94e26f3994 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:35.702842 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e8dffe-28e0-41a3-a472-8a94e26f3994 None admin] RBAC: Adding query filter params (group.id=63c4e945afeb49dbaf6cdc00601f1a78, role.id=ddb643577b2e4e478100ec370decfaeb, scope.project.id=feee070208394133a3522f3d666241d3) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:35.703151 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e8dffe-28e0-41a3-a472-8a94e26f3994 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:35.704668 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e8dffe-28e0-41a3-a472-8a94e26f3994 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:35.717250 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 191/380] 10.222.0.72 () {56 vars in 1376 bytes} [Mon Sep 19 14:43:35 2022] GET /identity/v3/role_assignments?group.id=63c4e945afeb49dbaf6cdc00601f1a78&scope.project.id=feee070208394133a3522f3d666241d3&role.id=ddb643577b2e4e478100ec370decfaeb => generated 260 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:43:36.093790 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa4f763-d248-48bd-acb1-508589ed6be7 None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:36.094182 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa4f763-d248-48bd-acb1-508589ed6be7 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:36.094371 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa4f763-d248-48bd-acb1-508589ed6be7 None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:36.095911 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 190/381] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:43:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:43:36.101493 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea91047b-d586-41c3-89cd-721097f6e537 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:36.101780 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea91047b-d586-41c3-89cd-721097f6e537 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:36.102057 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea91047b-d586-41c3-89cd-721097f6e537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:36.123037 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-ea91047b-d586-41c3-89cd-721097f6e537 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:43:36.124602 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-ea91047b-d586-41c3-89cd-721097f6e537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:43:36.190297 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ad0cf-fa66-4bc4-bc5e-b6cb234b8ae9 None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:36.190598 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ad0cf-fa66-4bc4-bc5e-b6cb234b8ae9 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:36.190846 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ad0cf-fa66-4bc4-bc5e-b6cb234b8ae9 None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:36.192465 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 191/382] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:43:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:43:36.197275 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2853e11-887e-49a1-b1d2-86ab6285a356 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:36.197556 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2853e11-887e-49a1-b1d2-86ab6285a356 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:36.197828 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2853e11-887e-49a1-b1d2-86ab6285a356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:36.213960 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 192/383] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:43:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 14:43:36.229353 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-d2853e11-887e-49a1-b1d2-86ab6285a356 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:43:36.230595 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-d2853e11-887e-49a1-b1d2-86ab6285a356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:43:36.317313 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 192/384] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:43:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:43:36.539204 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea91047b-d586-41c3-89cd-721097f6e537 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:36.625499 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:36.664617 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea91047b-d586-41c3-89cd-721097f6e537 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:36.707563 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2853e11-887e-49a1-b1d2-86ab6285a356 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:36.708907 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfd986c-5011-49e7-8c29-247cc242bf20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:36.709735 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfd986c-5011-49e7-8c29-247cc242bf20 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:36.709890 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:36.710065 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfd986c-5011-49e7-8c29-247cc242bf20 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:36.710302 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfd986c-5011-49e7-8c29-247cc242bf20 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:36.733620 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfd986c-5011-49e7-8c29-247cc242bf20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:43:36.738728 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-dcfd986c-5011-49e7-8c29-247cc242bf20 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 14:43:36.738728 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:36.738728 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:43:36.738728 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:43:36.738728 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:43:36.738728 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:43:36.738728 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:43:36.738728 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:43:36.738728 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:43:36.738728 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:43:36.738728 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:43:36.738728 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:43:36.738728 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:43:36.738728 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:43:36.738728 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:43:36.738728 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:43:36.739643 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:43:36.739643 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:43:36.739643 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:43:36.739643 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:43:36.739643 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:43:36.739643 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:43:36.739643 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:43:36.739643 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:43:36.739643 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:43:36.739643 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:43:36.739643 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:43:36.739643 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:43:36.739643 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:43:36.739643 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:43:36.739643 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:43:36.739643 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:43:36.740873 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:43:36.740873 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:43:36.740873 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:43:36.740873 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:43:36.740873 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:43:36.740873 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:43:36.740873 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:43:36.740873 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:43:36.740873 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:43:36.740873 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:43:36.740873 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 14:43:36.740873 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:43:36.740873 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 193/385] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Sep 19 14:43:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:43:36.746453 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfd986c-5011-49e7-8c29-247cc242bf20 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:36.873545 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfd986c-5011-49e7-8c29-247cc242bf20 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:36.913679 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:36.919363 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2853e11-887e-49a1-b1d2-86ab6285a356 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:36.930845 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72df58b4-0dcf-44ab-a156-48a805aa622b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:36.932006 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72df58b4-0dcf-44ab-a156-48a805aa622b None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:36.932497 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72df58b4-0dcf-44ab-a156-48a805aa622b None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:36.933900 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72df58b4-0dcf-44ab-a156-48a805aa622b None admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:36.935068 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72df58b4-0dcf-44ab-a156-48a805aa622b None admin] RBAC: Adding query filter params (name=member) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:36.935516 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72df58b4-0dcf-44ab-a156-48a805aa622b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:36.937084 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72df58b4-0dcf-44ab-a156-48a805aa622b None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:36.947414 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 194/386] 10.222.0.72 () {56 vars in 1101 bytes} [Mon Sep 19 14:43:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:36.954082 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72df58b4-0dcf-44ab-a156-48a805aa622b None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:37.001585 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2353a454-c5bf-495a-a7d4-97776aa76075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:37.002319 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2353a454-c5bf-495a-a7d4-97776aa76075 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:37.002602 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2353a454-c5bf-495a-a7d4-97776aa76075 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:37.002877 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2353a454-c5bf-495a-a7d4-97776aa76075 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:37.035351 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2353a454-c5bf-495a-a7d4-97776aa76075 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:43:37.040405 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-2353a454-c5bf-495a-a7d4-97776aa76075 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 14:43:37.040405 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:37.040405 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:43:37.040405 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:43:37.040405 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:43:37.040405 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:43:37.040405 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:43:37.040405 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:43:37.040405 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:43:37.040405 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:43:37.040405 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:43:37.040405 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:43:37.040405 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:43:37.040405 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:43:37.040405 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:43:37.040405 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:43:37.041255 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:43:37.041255 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:43:37.041255 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:43:37.041255 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:43:37.041255 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:43:37.041255 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:43:37.041255 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:43:37.041255 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:43:37.041255 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:43:37.041255 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:43:37.041255 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:43:37.041255 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:43:37.041255 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:43:37.041255 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:43:37.041255 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:43:37.041255 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:43:37.042030 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:43:37.042030 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:43:37.042030 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:43:37.042030 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:43:37.042030 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:43:37.042030 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:43:37.042030 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:43:37.042030 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:43:37.042030 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:43:37.042030 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:43:37.042030 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 14:43:37.042030 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:43:37.042030 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 193/387] 10.222.0.72 () {56 vars in 1114 bytes} [Mon Sep 19 14:43:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:43:37.048588 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2353a454-c5bf-495a-a7d4-97776aa76075 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:37.078631 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72df58b4-0dcf-44ab-a156-48a805aa622b None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:37.124593 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b1a219-31f6-424d-b053-6657102b7487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:37.125556 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b1a219-31f6-424d-b053-6657102b7487 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:37.126059 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b1a219-31f6-424d-b053-6657102b7487 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:37.126497 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b1a219-31f6-424d-b053-6657102b7487 None admin] PATH_INFO: `/v3/groups/6d3f2ba43f564d788da119d6fd102c8d` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:37.127792 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b1a219-31f6-424d-b053-6657102b7487 None admin] RBAC: Authorizing `identity:get_group(group_id=6d3f2ba43f564d788da119d6fd102c8d)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:37.129739 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b1a219-31f6-424d-b053-6657102b7487 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:37.132553 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 195/388] 10.222.0.72 () {56 vars in 1180 bytes} [Mon Sep 19 14:43:36 2022] GET /identity/v3/groups/6d3f2ba43f564d788da119d6fd102c8d => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:37.139926 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b1a219-31f6-424d-b053-6657102b7487 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:37.199412 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:37.257395 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:37.266555 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2353a454-c5bf-495a-a7d4-97776aa76075 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:37.312624 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e322947-30b2-451d-b1c8-330df8130ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:37.313692 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e322947-30b2-451d-b1c8-330df8130ee0 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:37.314166 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e322947-30b2-451d-b1c8-330df8130ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:37.314622 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e322947-30b2-451d-b1c8-330df8130ee0 None admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:37.315722 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e322947-30b2-451d-b1c8-330df8130ee0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:37.316229 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e322947-30b2-451d-b1c8-330df8130ee0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:37.317827 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e322947-30b2-451d-b1c8-330df8130ee0 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:37.322823 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b1a219-31f6-424d-b053-6657102b7487 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:37.328668 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 194/389] 10.222.0.72 () {56 vars in 1111 bytes} [Mon Sep 19 14:43:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:43:37.330169 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a3651a-057c-4101-9c98-80c412ebec4f None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:37.330609 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a3651a-057c-4101-9c98-80c412ebec4f None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:37.331099 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a3651a-057c-4101-9c98-80c412ebec4f None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:37.332688 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 195/390] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:43:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:43:37.337550 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cc2b58-6942-4b05-8f37-ce5ce9a9e63c None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:37.338380 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cc2b58-6942-4b05-8f37-ce5ce9a9e63c None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:37.338863 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cc2b58-6942-4b05-8f37-ce5ce9a9e63c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:37.363639 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-15cc2b58-6942-4b05-8f37-ce5ce9a9e63c None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:43:37.367389 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-15cc2b58-6942-4b05-8f37-ce5ce9a9e63c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:43:37.369993 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50df5c43-40ba-470c-8a67-cc38fe16476b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:37.370732 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df5c43-40ba-470c-8a67-cc38fe16476b None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:37.371148 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df5c43-40ba-470c-8a67-cc38fe16476b None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:37.371513 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df5c43-40ba-470c-8a67-cc38fe16476b None admin] PATH_INFO: `/v3/projects/f2d0f3b33b264908b42ee8c76c5527f3` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:37.373722 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50df5c43-40ba-470c-8a67-cc38fe16476b None admin] RBAC: Authorizing `identity:get_project(project_id=f2d0f3b33b264908b42ee8c76c5527f3)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:37.375649 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50df5c43-40ba-470c-8a67-cc38fe16476b None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:37.378616 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 196/391] 10.222.0.72 () {56 vars in 1186 bytes} [Mon Sep 19 14:43:37 2022] GET /identity/v3/projects/f2d0f3b33b264908b42ee8c76c5527f3 => generated 298 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:43:37.379402 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50df5c43-40ba-470c-8a67-cc38fe16476b None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:37.452898 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 196/392] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:43:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 14:43:37.454259 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cc2b58-6942-4b05-8f37-ce5ce9a9e63c None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:37.496107 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50df5c43-40ba-470c-8a67-cc38fe16476b None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:37.515725 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:37.527170 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:37.537871 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958da788-2c60-4407-9625-557ce269096b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:37.538511 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958da788-2c60-4407-9625-557ce269096b None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:37.538792 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958da788-2c60-4407-9625-557ce269096b None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:37.539066 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958da788-2c60-4407-9625-557ce269096b None admin] PATH_INFO: `/v3/groups/6d3f2ba43f564d788da119d6fd102c8d` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:37.540182 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958da788-2c60-4407-9625-557ce269096b None admin] RBAC: Authorizing `identity:get_group(group_id=6d3f2ba43f564d788da119d6fd102c8d)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:37.541716 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958da788-2c60-4407-9625-557ce269096b None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:37.543998 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 197/393] 10.222.0.72 () {56 vars in 1180 bytes} [Mon Sep 19 14:43:37 2022] GET /identity/v3/groups/6d3f2ba43f564d788da119d6fd102c8d => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:37.550039 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958da788-2c60-4407-9625-557ce269096b None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:37.570598 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cc2b58-6942-4b05-8f37-ce5ce9a9e63c None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:37.609305 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c275d3-e6f1-4b4f-b328-2824c2d1d2ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:37.610309 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c275d3-e6f1-4b4f-b328-2824c2d1d2ae None admin] REQUEST_METHOD: `PUT` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:37.611075 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c275d3-e6f1-4b4f-b328-2824c2d1d2ae None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:37.611539 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c275d3-e6f1-4b4f-b328-2824c2d1d2ae None admin] PATH_INFO: `/v3/projects/f2d0f3b33b264908b42ee8c76c5527f3/groups/6d3f2ba43f564d788da119d6fd102c8d/roles/efa0e5b3413748dc828a89b12d67df79` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:37.613877 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c275d3-e6f1-4b4f-b328-2824c2d1d2ae None admin] RBAC: Authorizing `identity:create_grant(project_id=f2d0f3b33b264908b42ee8c76c5527f3, group_id=6d3f2ba43f564d788da119d6fd102c8d, role_id=efa0e5b3413748dc828a89b12d67df79)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:37.615695 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c275d3-e6f1-4b4f-b328-2824c2d1d2ae None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:37.639443 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 197/394] 10.222.0.72 () {58 vars in 1442 bytes} [Mon Sep 19 14:43:37 2022] PUT /identity/v3/projects/f2d0f3b33b264908b42ee8c76c5527f3/groups/6d3f2ba43f564d788da119d6fd102c8d/roles/efa0e5b3413748dc828a89b12d67df79 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:43:37.701050 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958da788-2c60-4407-9625-557ce269096b None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:37.759634 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a6bbaf-489d-4803-b6a1-6f9761565285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:37.760282 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a6bbaf-489d-4803-b6a1-6f9761565285 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:37.760601 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a6bbaf-489d-4803-b6a1-6f9761565285 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:37.760874 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a6bbaf-489d-4803-b6a1-6f9761565285 None admin] PATH_INFO: `/v3/projects/f2d0f3b33b264908b42ee8c76c5527f3` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:37.762590 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a6bbaf-489d-4803-b6a1-6f9761565285 None admin] RBAC: Authorizing `identity:get_project(project_id=f2d0f3b33b264908b42ee8c76c5527f3)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:37.764055 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a6bbaf-489d-4803-b6a1-6f9761565285 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:37.766110 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 198/395] 10.222.0.72 () {56 vars in 1186 bytes} [Mon Sep 19 14:43:37 2022] GET /identity/v3/projects/f2d0f3b33b264908b42ee8c76c5527f3 => generated 298 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:37.771830 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c275d3-e6f1-4b4f-b328-2824c2d1d2ae None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:37.861228 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a6bbaf-489d-4803-b6a1-6f9761565285 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:37.941386 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c275d3-e6f1-4b4f-b328-2824c2d1d2ae None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:37.970018 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:37.971900 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:37.997368 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b376eea-dd4b-493f-af99-b8f15a0963b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:37.998382 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b376eea-dd4b-493f-af99-b8f15a0963b5 None admin] REQUEST_METHOD: `PUT` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:37.998858 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b376eea-dd4b-493f-af99-b8f15a0963b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:37.999431 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b376eea-dd4b-493f-af99-b8f15a0963b5 None admin] PATH_INFO: `/v3/projects/f2d0f3b33b264908b42ee8c76c5527f3/groups/6d3f2ba43f564d788da119d6fd102c8d/roles/962ee04d08ae41b08c1a5108c54c7469` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:38.002103 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b376eea-dd4b-493f-af99-b8f15a0963b5 None admin] RBAC: Authorizing `identity:create_grant(project_id=f2d0f3b33b264908b42ee8c76c5527f3, group_id=6d3f2ba43f564d788da119d6fd102c8d, role_id=962ee04d08ae41b08c1a5108c54c7469)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:38.003798 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b376eea-dd4b-493f-af99-b8f15a0963b5 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:38.029469 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 198/396] 10.222.0.72 () {58 vars in 1442 bytes} [Mon Sep 19 14:43:37 2022] PUT /identity/v3/projects/f2d0f3b33b264908b42ee8c76c5527f3/groups/6d3f2ba43f564d788da119d6fd102c8d/roles/962ee04d08ae41b08c1a5108c54c7469 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:43:38.036238 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a6bbaf-489d-4803-b6a1-6f9761565285 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:38.086108 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682497c6-f8c2-4b64-ad05-966c69fc28a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:38.086754 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682497c6-f8c2-4b64-ad05-966c69fc28a1 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:38.087032 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682497c6-f8c2-4b64-ad05-966c69fc28a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:38.087299 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682497c6-f8c2-4b64-ad05-966c69fc28a1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:38.103563 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682497c6-f8c2-4b64-ad05-966c69fc28a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:43:38.109871 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-682497c6-f8c2-4b64-ad05-966c69fc28a1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 14:43:38.109871 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:38.109871 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:43:38.109871 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:43:38.109871 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:43:38.109871 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:43:38.109871 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:43:38.109871 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:43:38.109871 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:43:38.109871 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:43:38.109871 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:43:38.109871 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:43:38.109871 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:43:38.109871 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:43:38.109871 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:43:38.109871 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:43:38.110824 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:43:38.110824 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:43:38.110824 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:43:38.110824 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:43:38.110824 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:43:38.110824 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:43:38.110824 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:43:38.110824 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:43:38.110824 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:43:38.110824 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:43:38.110824 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:43:38.110824 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:43:38.110824 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:43:38.110824 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:43:38.110824 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:43:38.110824 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:43:38.112025 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:43:38.112025 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:43:38.112025 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:43:38.112025 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:43:38.112025 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:43:38.112025 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:43:38.112025 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:43:38.112025 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:43:38.112025 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:43:38.112025 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:43:38.112025 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 14:43:38.112025 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:43:38.112025 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 199/397] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Sep 19 14:43:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:43:38.117091 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b376eea-dd4b-493f-af99-b8f15a0963b5 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:38.246185 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b376eea-dd4b-493f-af99-b8f15a0963b5 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:38.295508 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8133ae-6785-40ef-8d6a-84cee642720a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:38.296201 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8133ae-6785-40ef-8d6a-84cee642720a None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:38.296559 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8133ae-6785-40ef-8d6a-84cee642720a None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:38.296837 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8133ae-6785-40ef-8d6a-84cee642720a None admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:38.297620 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8133ae-6785-40ef-8d6a-84cee642720a None admin] RBAC: Adding query filter params (name=member) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:38.297924 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8133ae-6785-40ef-8d6a-84cee642720a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:38.299402 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8133ae-6785-40ef-8d6a-84cee642720a None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:38.310178 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 199/398] 10.222.0.72 () {56 vars in 1101 bytes} [Mon Sep 19 14:43:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:38.316300 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682497c6-f8c2-4b64-ad05-966c69fc28a1 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:38.461843 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682497c6-f8c2-4b64-ad05-966c69fc28a1 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:38.491169 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:38.505632 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57544516-ffda-4d87-bd7e-96743021d615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:38.506202 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57544516-ffda-4d87-bd7e-96743021d615 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:38.506484 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57544516-ffda-4d87-bd7e-96743021d615 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:38.506758 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57544516-ffda-4d87-bd7e-96743021d615 None admin] PATH_INFO: `/v3/groups/6d3f2ba43f564d788da119d6fd102c8d` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:38.508289 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57544516-ffda-4d87-bd7e-96743021d615 None admin] RBAC: Authorizing `identity:get_group(group_id=6d3f2ba43f564d788da119d6fd102c8d)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:38.509804 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57544516-ffda-4d87-bd7e-96743021d615 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:38.512847 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 200/399] 10.222.0.72 () {56 vars in 1180 bytes} [Mon Sep 19 14:43:38 2022] GET /identity/v3/groups/6d3f2ba43f564d788da119d6fd102c8d => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:38.518257 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8133ae-6785-40ef-8d6a-84cee642720a None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:38.550705 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee1f799-884b-4b05-80b0-42c332d354b7 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:38.551278 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee1f799-884b-4b05-80b0-42c332d354b7 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:38.551278 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee1f799-884b-4b05-80b0-42c332d354b7 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:38.555236 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 201/400] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:43:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:43:38.560666 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6d7564-ccba-48e5-ac26-eb11057cd4b6 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:38.560979 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6d7564-ccba-48e5-ac26-eb11057cd4b6 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:38.561179 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6d7564-ccba-48e5-ac26-eb11057cd4b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:38.572744 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:38.603298 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-3c6d7564-ccba-48e5-ac26-eb11057cd4b6 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:43:38.604536 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-3c6d7564-ccba-48e5-ac26-eb11057cd4b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:43:38.659443 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8133ae-6785-40ef-8d6a-84cee642720a None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:38.696243 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3392852-ee4a-4f34-a584-03e46451338c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:38.696911 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3392852-ee4a-4f34-a584-03e46451338c None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:38.697186 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3392852-ee4a-4f34-a584-03e46451338c None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:38.697454 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3392852-ee4a-4f34-a584-03e46451338c None admin] PATH_INFO: `/v3/projects/4a1ea1922c4946d79ba6bac82ade352e` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:38.698623 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3392852-ee4a-4f34-a584-03e46451338c None admin] RBAC: Authorizing `identity:get_project(project_id=4a1ea1922c4946d79ba6bac82ade352e)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:38.700559 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3392852-ee4a-4f34-a584-03e46451338c None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:38.702220 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 200/401] 10.222.0.72 () {56 vars in 1186 bytes} [Mon Sep 19 14:43:38 2022] GET /identity/v3/projects/4a1ea1922c4946d79ba6bac82ade352e => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:38.707028 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed809911-9c80-47a4-81b4-6a41bb4a3034 None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:38.707028 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed809911-9c80-47a4-81b4-6a41bb4a3034 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:38.707028 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed809911-9c80-47a4-81b4-6a41bb4a3034 None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:38.707028 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 201/402] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:43:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:43:38.709408 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed809911-9c80-47a4-81b4-6a41bb4a3034 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:38.737029 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 202/403] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:43:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:43:38.738667 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139d4035-f6a1-425c-8099-ccbed2f44ee1 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:38.739208 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139d4035-f6a1-425c-8099-ccbed2f44ee1 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:38.739779 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139d4035-f6a1-425c-8099-ccbed2f44ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:38.759859 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-139d4035-f6a1-425c-8099-ccbed2f44ee1 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:43:38.761915 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-139d4035-f6a1-425c-8099-ccbed2f44ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:43:38.827311 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed809911-9c80-47a4-81b4-6a41bb4a3034 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:38.834785 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:38.867136 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 203/404] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:43:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:43:38.868862 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b8a68c-57ea-4dfb-ba8e-978272ecadc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:38.869536 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b8a68c-57ea-4dfb-ba8e-978272ecadc2 None admin] REQUEST_METHOD: `PUT` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:38.869863 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b8a68c-57ea-4dfb-ba8e-978272ecadc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:38.870138 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b8a68c-57ea-4dfb-ba8e-978272ecadc2 None admin] PATH_INFO: `/v3/projects/4a1ea1922c4946d79ba6bac82ade352e/groups/6d3f2ba43f564d788da119d6fd102c8d/roles/efa0e5b3413748dc828a89b12d67df79` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:38.873633 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b8a68c-57ea-4dfb-ba8e-978272ecadc2 None admin] RBAC: Authorizing `identity:create_grant(project_id=4a1ea1922c4946d79ba6bac82ade352e, group_id=6d3f2ba43f564d788da119d6fd102c8d, role_id=efa0e5b3413748dc828a89b12d67df79)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:38.875995 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b8a68c-57ea-4dfb-ba8e-978272ecadc2 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:38.908483 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 202/405] 10.222.0.72 () {58 vars in 1442 bytes} [Mon Sep 19 14:43:38 2022] PUT /identity/v3/projects/4a1ea1922c4946d79ba6bac82ade352e/groups/6d3f2ba43f564d788da119d6fd102c8d/roles/efa0e5b3413748dc828a89b12d67df79 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 14:43:39.077046 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139d4035-f6a1-425c-8099-ccbed2f44ee1 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:39.149278 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:39.209632 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139d4035-f6a1-425c-8099-ccbed2f44ee1 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:39.250109 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003a6775-12bd-4832-86e4-078226b16ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:39.250755 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003a6775-12bd-4832-86e4-078226b16ef3 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:39.251029 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003a6775-12bd-4832-86e4-078226b16ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:39.251303 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003a6775-12bd-4832-86e4-078226b16ef3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:39.262488 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003a6775-12bd-4832-86e4-078226b16ef3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:43:39.267567 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-003a6775-12bd-4832-86e4-078226b16ef3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 14:43:39.267567 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:39.267567 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:43:39.267567 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:43:39.267567 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:43:39.267567 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:43:39.267567 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:43:39.267567 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:43:39.267567 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:43:39.267567 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:43:39.267567 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:43:39.267567 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:43:39.267567 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:43:39.267567 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:43:39.267567 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:43:39.267567 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:43:39.268454 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:43:39.268454 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:43:39.268454 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:43:39.268454 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:43:39.268454 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:43:39.268454 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:43:39.268454 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:43:39.268454 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:43:39.268454 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:43:39.268454 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:43:39.268454 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:43:39.268454 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:43:39.268454 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:43:39.268454 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:43:39.268454 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:43:39.268454 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:43:39.269250 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:43:39.269250 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:43:39.269250 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:43:39.269250 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:43:39.269250 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:43:39.269250 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:43:39.269250 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:43:39.269250 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:43:39.269250 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:43:39.269250 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:43:39.269250 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 14:43:39.269250 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:43:39.269250 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 204/406] 10.222.0.72 () {56 vars in 1114 bytes} [Mon Sep 19 14:43:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:43:39.274826 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b8a68c-57ea-4dfb-ba8e-978272ecadc2 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:39.364495 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003a6775-12bd-4832-86e4-078226b16ef3 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:39.411336 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b8a68c-57ea-4dfb-ba8e-978272ecadc2 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:39.469700 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96c34fb-9399-480d-8da7-9e035b2444bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:39.470652 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c34fb-9399-480d-8da7-9e035b2444bd None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:39.471282 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c34fb-9399-480d-8da7-9e035b2444bd None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:39.472214 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c34fb-9399-480d-8da7-9e035b2444bd None admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:39.473586 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96c34fb-9399-480d-8da7-9e035b2444bd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:39.475062 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96c34fb-9399-480d-8da7-9e035b2444bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:39.476669 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96c34fb-9399-480d-8da7-9e035b2444bd None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:39.495682 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 203/407] 10.222.0.72 () {56 vars in 1111 bytes} [Mon Sep 19 14:43:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:39.502505 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96c34fb-9399-480d-8da7-9e035b2444bd None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:39.551479 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:39.556976 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003a6775-12bd-4832-86e4-078226b16ef3 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:39.580617 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:39.624509 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77caa9a-8ec0-4550-9fc2-f5a4412fe3c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:39.625058 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77caa9a-8ec0-4550-9fc2-f5a4412fe3c4 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:39.625332 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77caa9a-8ec0-4550-9fc2-f5a4412fe3c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:39.625597 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77caa9a-8ec0-4550-9fc2-f5a4412fe3c4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:39.643499 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77caa9a-8ec0-4550-9fc2-f5a4412fe3c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:43:39.648434 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-d77caa9a-8ec0-4550-9fc2-f5a4412fe3c4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:43:39.648434 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:39.648434 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:43:39.648434 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:43:39.648434 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:43:39.648434 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:43:39.648434 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:43:39.648434 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:43:39.648434 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:43:39.648434 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:43:39.648434 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:43:39.648434 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:43:39.648434 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:43:39.648434 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:43:39.648434 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:43:39.648434 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:43:39.649276 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:43:39.649276 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:43:39.649276 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:43:39.649276 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:43:39.649276 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:43:39.649276 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:43:39.649276 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:43:39.649276 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:43:39.649276 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:43:39.649276 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:43:39.649276 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:43:39.649276 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:43:39.649276 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:43:39.649276 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:43:39.649276 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:43:39.649276 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:43:39.650068 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:43:39.650068 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:43:39.650068 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:43:39.650068 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:43:39.650068 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:43:39.650068 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:43:39.650068 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:43:39.650068 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:43:39.650068 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:43:39.650068 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:43:39.650068 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:43:39.650068 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:43:39.650068 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 205/408] 10.222.0.72 () {56 vars in 1096 bytes} [Mon Sep 19 14:43:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:43:39.655965 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77caa9a-8ec0-4550-9fc2-f5a4412fe3c4 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:39.686872 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96c34fb-9399-480d-8da7-9e035b2444bd None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:39.748744 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607aaab9-669c-4010-8db9-cc5ba9f7faee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:39.749382 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607aaab9-669c-4010-8db9-cc5ba9f7faee None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:39.749659 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607aaab9-669c-4010-8db9-cc5ba9f7faee None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:39.749931 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607aaab9-669c-4010-8db9-cc5ba9f7faee None admin] PATH_INFO: `/v3/groups/6d3f2ba43f564d788da119d6fd102c8d` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:39.751066 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607aaab9-669c-4010-8db9-cc5ba9f7faee None admin] RBAC: Authorizing `identity:get_group(group_id=6d3f2ba43f564d788da119d6fd102c8d)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:39.752497 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607aaab9-669c-4010-8db9-cc5ba9f7faee None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:39.754376 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 204/409] 10.222.0.72 () {56 vars in 1180 bytes} [Mon Sep 19 14:43:39 2022] GET /identity/v3/groups/6d3f2ba43f564d788da119d6fd102c8d => generated 226 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:39.759889 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607aaab9-669c-4010-8db9-cc5ba9f7faee None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:39.854933 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77caa9a-8ec0-4550-9fc2-f5a4412fe3c4 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:39.922453 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c025d1f1-6cdb-455d-b2bf-4c6242ec2fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:39.923256 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c025d1f1-6cdb-455d-b2bf-4c6242ec2fa0 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:39.923533 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c025d1f1-6cdb-455d-b2bf-4c6242ec2fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:39.923808 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c025d1f1-6cdb-455d-b2bf-4c6242ec2fa0 None admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:39.925386 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c025d1f1-6cdb-455d-b2bf-4c6242ec2fa0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:39.925691 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c025d1f1-6cdb-455d-b2bf-4c6242ec2fa0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:39.927869 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c025d1f1-6cdb-455d-b2bf-4c6242ec2fa0 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:39.944837 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 206/410] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Sep 19 14:43:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:39.946957 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:39.950976 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c025d1f1-6cdb-455d-b2bf-4c6242ec2fa0 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:39.958028 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607aaab9-669c-4010-8db9-cc5ba9f7faee None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:40.010556 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:40.026173 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8dde17-45cd-43cd-bd63-23784ffb9dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:40.026811 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8dde17-45cd-43cd-bd63-23784ffb9dca None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:40.027689 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8dde17-45cd-43cd-bd63-23784ffb9dca None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:40.028075 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8dde17-45cd-43cd-bd63-23784ffb9dca None admin] PATH_INFO: `/v3/projects/4a1ea1922c4946d79ba6bac82ade352e` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:40.029713 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8dde17-45cd-43cd-bd63-23784ffb9dca None admin] RBAC: Authorizing `identity:get_project(project_id=4a1ea1922c4946d79ba6bac82ade352e)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:40.031166 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8dde17-45cd-43cd-bd63-23784ffb9dca None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:40.032826 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 205/411] 10.222.0.72 () {56 vars in 1186 bytes} [Mon Sep 19 14:43:39 2022] GET /identity/v3/projects/4a1ea1922c4946d79ba6bac82ade352e => generated 302 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:43:40.040394 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8dde17-45cd-43cd-bd63-23784ffb9dca None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:40.147899 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c025d1f1-6cdb-455d-b2bf-4c6242ec2fa0 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:40.213331 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a29ba1-a49d-40c6-8dfa-cd402cecd9a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:40.214048 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a29ba1-a49d-40c6-8dfa-cd402cecd9a4 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:40.214327 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a29ba1-a49d-40c6-8dfa-cd402cecd9a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:40.214631 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a29ba1-a49d-40c6-8dfa-cd402cecd9a4 None admin] PATH_INFO: `/v3/groups/63c4e945afeb49dbaf6cdc00601f1a78` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:40.216220 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a29ba1-a49d-40c6-8dfa-cd402cecd9a4 None admin] RBAC: Authorizing `identity:get_group(group_id=63c4e945afeb49dbaf6cdc00601f1a78)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:40.218342 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a29ba1-a49d-40c6-8dfa-cd402cecd9a4 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:40.220072 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 207/412] 10.222.0.72 () {56 vars in 1180 bytes} [Mon Sep 19 14:43:39 2022] GET /identity/v3/groups/63c4e945afeb49dbaf6cdc00601f1a78 => generated 229 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:40.227164 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a29ba1-a49d-40c6-8dfa-cd402cecd9a4 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:40.237129 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8dde17-45cd-43cd-bd63-23784ffb9dca None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:40.282826 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0d4c8c-d75e-4652-b61f-298cfe4b0484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:40.283760 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0d4c8c-d75e-4652-b61f-298cfe4b0484 None admin] REQUEST_METHOD: `PUT` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:40.284303 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0d4c8c-d75e-4652-b61f-298cfe4b0484 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:40.284629 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0d4c8c-d75e-4652-b61f-298cfe4b0484 None admin] PATH_INFO: `/v3/projects/4a1ea1922c4946d79ba6bac82ade352e/groups/6d3f2ba43f564d788da119d6fd102c8d/roles/962ee04d08ae41b08c1a5108c54c7469` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:40.287261 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0d4c8c-d75e-4652-b61f-298cfe4b0484 None admin] RBAC: Authorizing `identity:create_grant(project_id=4a1ea1922c4946d79ba6bac82ade352e, group_id=6d3f2ba43f564d788da119d6fd102c8d, role_id=962ee04d08ae41b08c1a5108c54c7469)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:40.289571 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0d4c8c-d75e-4652-b61f-298cfe4b0484 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:40.312230 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 206/413] 10.222.0.72 () {58 vars in 1442 bytes} [Mon Sep 19 14:43:40 2022] PUT /identity/v3/projects/4a1ea1922c4946d79ba6bac82ade352e/groups/6d3f2ba43f564d788da119d6fd102c8d/roles/962ee04d08ae41b08c1a5108c54c7469 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:43:40.380812 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:40.387766 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a29ba1-a49d-40c6-8dfa-cd402cecd9a4 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:40.437262 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b56574-176b-4a02-ac7c-a2961d20fe05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:40.437897 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b56574-176b-4a02-ac7c-a2961d20fe05 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:40.438176 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b56574-176b-4a02-ac7c-a2961d20fe05 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:40.438444 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b56574-176b-4a02-ac7c-a2961d20fe05 None admin] PATH_INFO: `/v3/projects/feee070208394133a3522f3d666241d3` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:40.439649 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b56574-176b-4a02-ac7c-a2961d20fe05 None admin] RBAC: Authorizing `identity:get_project(project_id=feee070208394133a3522f3d666241d3)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:40.441149 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b56574-176b-4a02-ac7c-a2961d20fe05 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:40.443180 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 208/414] 10.222.0.72 () {56 vars in 1186 bytes} [Mon Sep 19 14:43:40 2022] GET /identity/v3/projects/feee070208394133a3522f3d666241d3 => generated 344 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:40.453469 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0d4c8c-d75e-4652-b61f-298cfe4b0484 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:40.487926 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:40.577961 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0d4c8c-d75e-4652-b61f-298cfe4b0484 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:40.613317 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f93ca7-1d17-4b18-b4e7-b67095ac20ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:40.613982 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f93ca7-1d17-4b18-b4e7-b67095ac20ab None admin] REQUEST_METHOD: `PUT` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:40.614263 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f93ca7-1d17-4b18-b4e7-b67095ac20ab None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:40.614540 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f93ca7-1d17-4b18-b4e7-b67095ac20ab None admin] PATH_INFO: `/v3/projects/feee070208394133a3522f3d666241d3/groups/63c4e945afeb49dbaf6cdc00601f1a78/roles/ddb643577b2e4e478100ec370decfaeb` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:40.616537 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f93ca7-1d17-4b18-b4e7-b67095ac20ab None admin] RBAC: Authorizing `identity:create_grant(project_id=feee070208394133a3522f3d666241d3, group_id=63c4e945afeb49dbaf6cdc00601f1a78, role_id=ddb643577b2e4e478100ec370decfaeb)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:40.617961 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f93ca7-1d17-4b18-b4e7-b67095ac20ab None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:40.625297 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dc76b3-e1be-4ef0-804b-0d118961a883 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:40.625808 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dc76b3-e1be-4ef0-804b-0d118961a883 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:40.625909 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dc76b3-e1be-4ef0-804b-0d118961a883 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:40.627267 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 209/415] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:43:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:43:40.635228 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 207/416] 10.222.0.72 () {58 vars in 1442 bytes} [Mon Sep 19 14:43:40 2022] PUT /identity/v3/projects/feee070208394133a3522f3d666241d3/groups/63c4e945afeb49dbaf6cdc00601f1a78/roles/ddb643577b2e4e478100ec370decfaeb => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:43:40.635458 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb7cf8-d61d-468f-b211-7127897d997d None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:40.635806 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb7cf8-d61d-468f-b211-7127897d997d None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:40.636166 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb7cf8-d61d-468f-b211-7127897d997d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:40.670565 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-fdcb7cf8-d61d-468f-b211-7127897d997d None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:43:40.671905 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-fdcb7cf8-d61d-468f-b211-7127897d997d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:43:40.776716 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77f3676-6974-4096-a886-083deecafa4b None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:40.776929 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77f3676-6974-4096-a886-083deecafa4b None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:40.778001 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77f3676-6974-4096-a886-083deecafa4b None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:40.779979 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 208/417] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:43:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 14:43:40.785690 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caa816b-d960-4542-900e-8c5471fc45ec None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:40.786015 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caa816b-d960-4542-900e-8c5471fc45ec None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:40.786240 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 210/418] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:43:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 14:43:40.786565 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caa816b-d960-4542-900e-8c5471fc45ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:40.807204 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-5caa816b-d960-4542-900e-8c5471fc45ec None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:43:40.808600 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-5caa816b-d960-4542-900e-8c5471fc45ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:43:40.920589 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 209/419] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:43:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:43:41.096245 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcb7cf8-d61d-468f-b211-7127897d997d None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:41.196389 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:41.204233 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcb7cf8-d61d-468f-b211-7127897d997d None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:41.221974 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caa816b-d960-4542-900e-8c5471fc45ec None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:41.248967 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05203d67-545b-4ed1-b24b-16094139a503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:41.249615 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05203d67-545b-4ed1-b24b-16094139a503 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:41.249897 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05203d67-545b-4ed1-b24b-16094139a503 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:41.250173 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05203d67-545b-4ed1-b24b-16094139a503 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:41.255189 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:41.263439 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05203d67-545b-4ed1-b24b-16094139a503 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:43:41.268743 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-05203d67-545b-4ed1-b24b-16094139a503 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 14:43:41.268743 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:41.268743 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:43:41.268743 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:43:41.268743 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:43:41.268743 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:43:41.268743 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:43:41.268743 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:43:41.268743 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:43:41.268743 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:43:41.268743 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:43:41.268743 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:43:41.268743 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:43:41.268743 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:43:41.268743 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:43:41.268743 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:43:41.269580 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:43:41.269580 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:43:41.269580 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:43:41.269580 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:43:41.269580 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:43:41.269580 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:43:41.269580 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:43:41.269580 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:43:41.269580 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:43:41.269580 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:43:41.269580 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:43:41.269580 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:43:41.269580 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:43:41.269580 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:43:41.269580 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:43:41.269580 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:43:41.270363 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:43:41.270363 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:43:41.270363 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:43:41.270363 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:43:41.270363 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:43:41.270363 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:43:41.270363 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:43:41.270363 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:43:41.270363 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:43:41.270363 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:43:41.270363 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 14:43:41.270363 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:43:41.270363 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 211/420] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Sep 19 14:43:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:43:41.276149 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05203d67-545b-4ed1-b24b-16094139a503 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:41.391232 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05203d67-545b-4ed1-b24b-16094139a503 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:41.429943 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c12c0c-b38d-4084-b5ea-d98d6b90b48f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:41.430554 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c12c0c-b38d-4084-b5ea-d98d6b90b48f None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:41.430842 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c12c0c-b38d-4084-b5ea-d98d6b90b48f None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:41.431121 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c12c0c-b38d-4084-b5ea-d98d6b90b48f None admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:41.432050 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c12c0c-b38d-4084-b5ea-d98d6b90b48f None admin] RBAC: Adding query filter params (name=member) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:41.432380 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c12c0c-b38d-4084-b5ea-d98d6b90b48f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:41.434179 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c12c0c-b38d-4084-b5ea-d98d6b90b48f None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:41.443922 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 212/421] 10.222.0.72 () {56 vars in 1101 bytes} [Mon Sep 19 14:43:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:41.449970 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c12c0c-b38d-4084-b5ea-d98d6b90b48f None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:41.484676 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:41.510110 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caa816b-d960-4542-900e-8c5471fc45ec None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:41.550115 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b97a286-bccd-42d6-890e-d58bb8c89a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:41.551126 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b97a286-bccd-42d6-890e-d58bb8c89a15 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:41.551598 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b97a286-bccd-42d6-890e-d58bb8c89a15 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:41.552061 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b97a286-bccd-42d6-890e-d58bb8c89a15 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:41.564156 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b97a286-bccd-42d6-890e-d58bb8c89a15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:43:41.569414 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-3b97a286-bccd-42d6-890e-d58bb8c89a15 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 14:43:41.569414 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:41.569414 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:43:41.569414 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:43:41.569414 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:43:41.569414 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:43:41.569414 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:43:41.569414 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:43:41.569414 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:43:41.569414 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:43:41.569414 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:43:41.569414 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:43:41.569414 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:43:41.569414 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:43:41.569414 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:43:41.569414 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:43:41.570250 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:43:41.570250 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:43:41.570250 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:43:41.570250 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:43:41.570250 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:43:41.570250 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:43:41.570250 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:43:41.570250 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:43:41.570250 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:43:41.570250 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:43:41.570250 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:43:41.570250 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:43:41.570250 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:43:41.570250 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:43:41.570250 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:43:41.570250 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:43:41.571037 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:43:41.571037 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:43:41.571037 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:43:41.571037 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:43:41.571037 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:43:41.571037 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:43:41.571037 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:43:41.571037 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:43:41.571037 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:43:41.571037 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:43:41.571037 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 14:43:41.571037 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:43:41.573411 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 210/422] 10.222.0.72 () {56 vars in 1114 bytes} [Mon Sep 19 14:43:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:43:41.581969 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b97a286-bccd-42d6-890e-d58bb8c89a15 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:41.676403 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c12c0c-b38d-4084-b5ea-d98d6b90b48f None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:41.716986 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:41.743330 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a14ae2b-3b47-4829-be31-ab4d212388ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:41.744296 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a14ae2b-3b47-4829-be31-ab4d212388ba None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:41.744936 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a14ae2b-3b47-4829-be31-ab4d212388ba None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:41.746423 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a14ae2b-3b47-4829-be31-ab4d212388ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:41.769764 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b97a286-bccd-42d6-890e-d58bb8c89a15 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:41.808382 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f36d76a-93ee-47d9-98a2-4adc119b2fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:41.809535 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f36d76a-93ee-47d9-98a2-4adc119b2fff None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:41.810006 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f36d76a-93ee-47d9-98a2-4adc119b2fff None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:41.810489 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f36d76a-93ee-47d9-98a2-4adc119b2fff None admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:41.811357 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f36d76a-93ee-47d9-98a2-4adc119b2fff None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:41.811956 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f36d76a-93ee-47d9-98a2-4adc119b2fff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:41.813628 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f36d76a-93ee-47d9-98a2-4adc119b2fff None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:41.819342 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a14ae2b-3b47-4829-be31-ab4d212388ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:41.820574 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a14ae2b-3b47-4829-be31-ab4d212388ba None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:41.823197 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 211/423] 10.222.0.72 () {56 vars in 1111 bytes} [Mon Sep 19 14:43:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:41.825219 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8567294b-fef8-4b68-a412-9c1cfa3e83aa None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:41.825709 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8567294b-fef8-4b68-a412-9c1cfa3e83aa None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:41.826175 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8567294b-fef8-4b68-a412-9c1cfa3e83aa None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:41.827595 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 212/424] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:43:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:43:41.831804 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8567294b-fef8-4b68-a412-9c1cfa3e83aa None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:41.846643 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:41.937536 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 213/425] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Sep 19 14:43:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 19 14:43:41.938812 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316654f2-3457-47e9-ae62-d9fd10e3651f None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:41.939097 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316654f2-3457-47e9-ae62-d9fd10e3651f None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:41.939584 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316654f2-3457-47e9-ae62-d9fd10e3651f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:41.949451 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8567294b-fef8-4b68-a412-9c1cfa3e83aa None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:41.957838 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-316654f2-3457-47e9-ae62-d9fd10e3651f None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:43:41.959034 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-316654f2-3457-47e9-ae62-d9fd10e3651f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:43:41.986350 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be56727c-cff0-49b9-8a2f-ee03e7b80b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:41.987356 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be56727c-cff0-49b9-8a2f-ee03e7b80b18 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:41.987925 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be56727c-cff0-49b9-8a2f-ee03e7b80b18 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:41.988442 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be56727c-cff0-49b9-8a2f-ee03e7b80b18 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:41.991409 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:42.029551 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 214/426] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:43:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:43:42.030407 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316654f2-3457-47e9-ae62-d9fd10e3651f None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:42.065992 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be56727c-cff0-49b9-8a2f-ee03e7b80b18 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:42.067758 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be56727c-cff0-49b9-8a2f-ee03e7b80b18 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:42.131531 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:42.174230 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 213/427] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Sep 19 14:43:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 14:43:42.179469 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be56727c-cff0-49b9-8a2f-ee03e7b80b18 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:42.216108 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:42.227471 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316654f2-3457-47e9-ae62-d9fd10e3651f None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:42.284017 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76fcee5-57e8-4ab1-b22e-6bd49d4e470f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:42.284680 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76fcee5-57e8-4ab1-b22e-6bd49d4e470f None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:42.284963 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76fcee5-57e8-4ab1-b22e-6bd49d4e470f None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:42.285236 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76fcee5-57e8-4ab1-b22e-6bd49d4e470f None admin] PATH_INFO: `/v3/projects/f2d0f3b33b264908b42ee8c76c5527f3` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:42.286719 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be56727c-cff0-49b9-8a2f-ee03e7b80b18 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:42.293245 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76fcee5-57e8-4ab1-b22e-6bd49d4e470f None admin] RBAC: Authorizing `identity:get_project(project_id=f2d0f3b33b264908b42ee8c76c5527f3)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:42.294725 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76fcee5-57e8-4ab1-b22e-6bd49d4e470f None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:42.296724 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 215/428] 10.222.0.72 () {56 vars in 1186 bytes} [Mon Sep 19 14:43:42 2022] GET /identity/v3/projects/f2d0f3b33b264908b42ee8c76c5527f3 => generated 298 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:42.302014 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76fcee5-57e8-4ab1-b22e-6bd49d4e470f None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:42.324819 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863219a9-731d-4c43-9e3a-1cdc8048c4a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:42.325862 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863219a9-731d-4c43-9e3a-1cdc8048c4a6 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:42.326331 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863219a9-731d-4c43-9e3a-1cdc8048c4a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:42.326812 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863219a9-731d-4c43-9e3a-1cdc8048c4a6 None admin] PATH_INFO: `/v3/projects/f2d0f3b33b264908b42ee8c76c5527f3` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:42.328275 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863219a9-731d-4c43-9e3a-1cdc8048c4a6 None admin] RBAC: Authorizing `identity:get_project(project_id=f2d0f3b33b264908b42ee8c76c5527f3)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:42.330079 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863219a9-731d-4c43-9e3a-1cdc8048c4a6 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:42.332365 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 214/429] 10.222.0.72 () {56 vars in 1186 bytes} [Mon Sep 19 14:43:42 2022] GET /identity/v3/projects/f2d0f3b33b264908b42ee8c76c5527f3 => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:42.337500 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863219a9-731d-4c43-9e3a-1cdc8048c4a6 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:42.446940 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863219a9-731d-4c43-9e3a-1cdc8048c4a6 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:42.460779 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:42.486864 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6ad52e-36a6-4c8f-8229-a5a331f634d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:42.487792 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6ad52e-36a6-4c8f-8229-a5a331f634d1 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:42.488263 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6ad52e-36a6-4c8f-8229-a5a331f634d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:42.489103 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6ad52e-36a6-4c8f-8229-a5a331f634d1 None admin] PATH_INFO: `/v3/groups/6d3f2ba43f564d788da119d6fd102c8d` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:42.491231 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6ad52e-36a6-4c8f-8229-a5a331f634d1 None admin] RBAC: Authorizing `identity:get_group(group_id=6d3f2ba43f564d788da119d6fd102c8d)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:42.493078 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6ad52e-36a6-4c8f-8229-a5a331f634d1 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:42.495270 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 215/430] 10.222.0.72 () {56 vars in 1180 bytes} [Mon Sep 19 14:43:42 2022] GET /identity/v3/groups/6d3f2ba43f564d788da119d6fd102c8d => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:42.495927 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76fcee5-57e8-4ab1-b22e-6bd49d4e470f None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:42.501182 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6ad52e-36a6-4c8f-8229-a5a331f634d1 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:42.524083 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:42.584083 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b133a29-4911-4e99-8c3b-4d55227aac16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:42.584750 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b133a29-4911-4e99-8c3b-4d55227aac16 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:42.585034 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b133a29-4911-4e99-8c3b-4d55227aac16 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:42.585310 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b133a29-4911-4e99-8c3b-4d55227aac16 None admin] PATH_INFO: `/v3/groups/6d3f2ba43f564d788da119d6fd102c8d` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:42.587995 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b133a29-4911-4e99-8c3b-4d55227aac16 None admin] RBAC: Authorizing `identity:get_group(group_id=6d3f2ba43f564d788da119d6fd102c8d)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:42.590258 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b133a29-4911-4e99-8c3b-4d55227aac16 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:42.592237 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 216/431] 10.222.0.72 () {56 vars in 1180 bytes} [Mon Sep 19 14:43:42 2022] GET /identity/v3/groups/6d3f2ba43f564d788da119d6fd102c8d => generated 226 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:43:42.598184 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b133a29-4911-4e99-8c3b-4d55227aac16 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:42.627555 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6ad52e-36a6-4c8f-8229-a5a331f634d1 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:42.664149 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff27b598-40a6-4a31-8132-1fb087133bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:42.665132 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff27b598-40a6-4a31-8132-1fb087133bd6 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:42.665625 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff27b598-40a6-4a31-8132-1fb087133bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:42.666089 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff27b598-40a6-4a31-8132-1fb087133bd6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:42.666996 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff27b598-40a6-4a31-8132-1fb087133bd6 None admin] RBAC: Adding query filter params (group.id=6d3f2ba43f564d788da119d6fd102c8d, role.id=962ee04d08ae41b08c1a5108c54c7469, scope.project.id=f2d0f3b33b264908b42ee8c76c5527f3) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:42.667517 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff27b598-40a6-4a31-8132-1fb087133bd6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:42.669439 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff27b598-40a6-4a31-8132-1fb087133bd6 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:42.675994 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 216/432] 10.222.0.72 () {56 vars in 1376 bytes} [Mon Sep 19 14:43:42 2022] GET /identity/v3/role_assignments?group.id=6d3f2ba43f564d788da119d6fd102c8d&scope.project.id=f2d0f3b33b264908b42ee8c76c5527f3&role.id=962ee04d08ae41b08c1a5108c54c7469 => generated 611 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:42.677160 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff27b598-40a6-4a31-8132-1fb087133bd6 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:42.706066 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b133a29-4911-4e99-8c3b-4d55227aac16 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:42.716788 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:42.744592 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8f84e0-d34b-4c81-9eba-9e9bfc47ee98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:42.745155 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8f84e0-d34b-4c81-9eba-9e9bfc47ee98 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:42.745435 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8f84e0-d34b-4c81-9eba-9e9bfc47ee98 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:42.745708 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8f84e0-d34b-4c81-9eba-9e9bfc47ee98 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:42.757536 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8f84e0-d34b-4c81-9eba-9e9bfc47ee98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:43:42.762571 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-7c8f84e0-d34b-4c81-9eba-9e9bfc47ee98 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 14:43:42.762571 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:42.762571 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:43:42.762571 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:43:42.762571 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:43:42.762571 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:43:42.762571 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:43:42.762571 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:43:42.762571 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:43:42.762571 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:43:42.762571 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:43:42.762571 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:43:42.762571 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:43:42.762571 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:43:42.762571 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:43:42.762571 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:43:42.763502 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:43:42.763502 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:43:42.763502 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:43:42.763502 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:43:42.763502 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:43:42.763502 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:43:42.763502 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:43:42.763502 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:43:42.763502 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:43:42.763502 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:43:42.763502 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:43:42.763502 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:43:42.763502 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:43:42.763502 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:43:42.763502 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:43:42.763502 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:43:42.764349 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:43:42.764349 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:43:42.764349 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:43:42.764349 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:43:42.764349 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:43:42.764349 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:43:42.764349 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:43:42.764349 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:43:42.764349 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:43:42.764349 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:43:42.764349 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 14:43:42.764349 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:43:42.764349 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 217/433] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Sep 19 14:43:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:43:42.775342 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8f84e0-d34b-4c81-9eba-9e9bfc47ee98 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:42.799862 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff27b598-40a6-4a31-8132-1fb087133bd6 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:42.839264 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba737e61-dcc9-447a-92a6-77e5a8ef8997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:42.840413 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba737e61-dcc9-447a-92a6-77e5a8ef8997 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:42.840888 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba737e61-dcc9-447a-92a6-77e5a8ef8997 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:42.841551 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba737e61-dcc9-447a-92a6-77e5a8ef8997 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:42.842552 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba737e61-dcc9-447a-92a6-77e5a8ef8997 None admin] RBAC: Adding query filter params (group.id=6d3f2ba43f564d788da119d6fd102c8d, role.id=efa0e5b3413748dc828a89b12d67df79, scope.project.id=f2d0f3b33b264908b42ee8c76c5527f3) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:42.843057 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba737e61-dcc9-447a-92a6-77e5a8ef8997 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:42.844740 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba737e61-dcc9-447a-92a6-77e5a8ef8997 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:42.852462 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 217/434] 10.222.0.72 () {56 vars in 1376 bytes} [Mon Sep 19 14:43:42 2022] GET /identity/v3/role_assignments?group.id=6d3f2ba43f564d788da119d6fd102c8d&scope.project.id=f2d0f3b33b264908b42ee8c76c5527f3&role.id=efa0e5b3413748dc828a89b12d67df79 => generated 611 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:42.880023 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:42.955524 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8f84e0-d34b-4c81-9eba-9e9bfc47ee98 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:42.999790 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a9ab10-0d6e-4df1-aa42-b57dc7521efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:43.000352 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a9ab10-0d6e-4df1-aa42-b57dc7521efe None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:43.000649 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a9ab10-0d6e-4df1-aa42-b57dc7521efe None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:43.000920 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a9ab10-0d6e-4df1-aa42-b57dc7521efe None admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:43.001613 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a9ab10-0d6e-4df1-aa42-b57dc7521efe None admin] RBAC: Adding query filter params (name=member) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:43.001915 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a9ab10-0d6e-4df1-aa42-b57dc7521efe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:43.003377 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a9ab10-0d6e-4df1-aa42-b57dc7521efe None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:43.013973 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 218/435] 10.222.0.72 () {56 vars in 1101 bytes} [Mon Sep 19 14:43:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:43.019824 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba737e61-dcc9-447a-92a6-77e5a8ef8997 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:43.126564 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d24b8bb-999f-4a83-8063-ba324083573e None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:43.126896 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d24b8bb-999f-4a83-8063-ba324083573e None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:43.127126 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d24b8bb-999f-4a83-8063-ba324083573e None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:43.128866 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 219/436] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:43:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 14:43:43.134887 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46188333-3cba-4299-8d8d-378b5fe1a8a7 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:43.135215 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46188333-3cba-4299-8d8d-378b5fe1a8a7 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:43.135442 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46188333-3cba-4299-8d8d-378b5fe1a8a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:43.148029 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba737e61-dcc9-447a-92a6-77e5a8ef8997 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:43.151300 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:43.157342 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-46188333-3cba-4299-8d8d-378b5fe1a8a7 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:43:43.158542 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-46188333-3cba-4299-8d8d-378b5fe1a8a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:43:43.186655 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d294e0-43a7-42e1-8666-1c3de0a060b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:43.187415 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d294e0-43a7-42e1-8666-1c3de0a060b3 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:43.187785 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d294e0-43a7-42e1-8666-1c3de0a060b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:43.188145 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d294e0-43a7-42e1-8666-1c3de0a060b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:43.241360 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 220/437] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:43:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:43:43.250296 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7fa3b8-7faa-44b3-adec-27a1dfdb6543 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:43.250477 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7fa3b8-7faa-44b3-adec-27a1dfdb6543 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:43.250752 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7fa3b8-7faa-44b3-adec-27a1dfdb6543 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:43.252249 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 221/438] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:43:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:43:43.257493 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0628ba78-20c2-48a2-b5b0-c2153d1d5fdb None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:43.257950 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0628ba78-20c2-48a2-b5b0-c2153d1d5fdb None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:43.258053 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0628ba78-20c2-48a2-b5b0-c2153d1d5fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:43.276622 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-0628ba78-20c2-48a2-b5b0-c2153d1d5fdb None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:43:43.277712 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d294e0-43a7-42e1-8666-1c3de0a060b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:43.277918 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-0628ba78-20c2-48a2-b5b0-c2153d1d5fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:43:43.279339 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d294e0-43a7-42e1-8666-1c3de0a060b3 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:43.311411 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:43.360033 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 222/439] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:43:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:43:43.393930 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:43.399431 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 218/440] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Sep 19 14:43:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 14:43:43.405266 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0628ba78-20c2-48a2-b5b0-c2153d1d5fdb None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:43.515147 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d294e0-43a7-42e1-8666-1c3de0a060b3 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:43.517044 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0628ba78-20c2-48a2-b5b0-c2153d1d5fdb None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:43.557757 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5968f369-f459-4597-b8c4-486971d669c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:43.559013 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5968f369-f459-4597-b8c4-486971d669c9 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:43.559287 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5968f369-f459-4597-b8c4-486971d669c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:43.559558 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5968f369-f459-4597-b8c4-486971d669c9 None admin] PATH_INFO: `/v3/projects/4a1ea1922c4946d79ba6bac82ade352e` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:43.560761 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5968f369-f459-4597-b8c4-486971d669c9 None admin] RBAC: Authorizing `identity:get_project(project_id=4a1ea1922c4946d79ba6bac82ade352e)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:43.562208 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5968f369-f459-4597-b8c4-486971d669c9 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:43.564148 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 223/441] 10.222.0.72 () {56 vars in 1186 bytes} [Mon Sep 19 14:43:43 2022] GET /identity/v3/projects/4a1ea1922c4946d79ba6bac82ade352e => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:43.570477 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5968f369-f459-4597-b8c4-486971d669c9 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:43.612272 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:43.647211 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d294e0-43a7-42e1-8666-1c3de0a060b3 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:43.686403 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160d5649-7b59-41b6-b8e8-37dc3400b1f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:43.687045 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160d5649-7b59-41b6-b8e8-37dc3400b1f5 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:43.687328 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160d5649-7b59-41b6-b8e8-37dc3400b1f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:43.687592 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160d5649-7b59-41b6-b8e8-37dc3400b1f5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:43.690890 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5968f369-f459-4597-b8c4-486971d669c9 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:43.697763 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160d5649-7b59-41b6-b8e8-37dc3400b1f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:43:43.703409 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-160d5649-7b59-41b6-b8e8-37dc3400b1f5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 14:43:43.703409 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:43.703409 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:43:43.703409 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:43:43.703409 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:43:43.703409 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:43:43.703409 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:43:43.703409 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:43:43.703409 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:43:43.703409 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:43:43.703409 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:43:43.703409 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:43:43.703409 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:43:43.703409 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:43:43.703409 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:43:43.703409 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:43:43.704478 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:43:43.704478 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:43:43.704478 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:43:43.704478 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:43:43.704478 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:43:43.704478 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:43:43.704478 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:43:43.704478 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:43:43.704478 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:43:43.704478 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:43:43.704478 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:43:43.704478 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:43:43.704478 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:43:43.704478 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:43:43.704478 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:43:43.704478 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:43:43.705464 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:43:43.705464 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:43:43.705464 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:43:43.705464 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:43:43.705464 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:43:43.705464 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:43:43.705464 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:43:43.705464 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:43:43.705464 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:43:43.705464 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:43:43.705464 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 14:43:43.705464 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:43:43.705464 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 219/442] 10.222.0.72 () {56 vars in 1114 bytes} [Mon Sep 19 14:43:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:43:43.705464 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160d5649-7b59-41b6-b8e8-37dc3400b1f5 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:43.727505 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c85103-9f5c-43d4-b446-eb6dbdbfa6c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:43.728127 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c85103-9f5c-43d4-b446-eb6dbdbfa6c0 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:43.728438 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c85103-9f5c-43d4-b446-eb6dbdbfa6c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:43.728712 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c85103-9f5c-43d4-b446-eb6dbdbfa6c0 None admin] PATH_INFO: `/v3/groups/6d3f2ba43f564d788da119d6fd102c8d` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:43.729818 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c85103-9f5c-43d4-b446-eb6dbdbfa6c0 None admin] RBAC: Authorizing `identity:get_group(group_id=6d3f2ba43f564d788da119d6fd102c8d)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:43.731376 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c85103-9f5c-43d4-b446-eb6dbdbfa6c0 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:43.732963 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 224/443] 10.222.0.72 () {56 vars in 1180 bytes} [Mon Sep 19 14:43:43 2022] GET /identity/v3/groups/6d3f2ba43f564d788da119d6fd102c8d => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:43.733703 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c85103-9f5c-43d4-b446-eb6dbdbfa6c0 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:43.769007 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:43.811879 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160d5649-7b59-41b6-b8e8-37dc3400b1f5 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:43.831867 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c85103-9f5c-43d4-b446-eb6dbdbfa6c0 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:43.834171 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:43.844764 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b684c10-cf50-4726-8857-5575e9dbdfc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:43.845471 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b684c10-cf50-4726-8857-5575e9dbdfc4 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:43.845809 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b684c10-cf50-4726-8857-5575e9dbdfc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:43.846084 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b684c10-cf50-4726-8857-5575e9dbdfc4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:43.855774 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b684c10-cf50-4726-8857-5575e9dbdfc4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:43:43.860668 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-1b684c10-cf50-4726-8857-5575e9dbdfc4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:43:43.860668 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:43.860668 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:43:43.860668 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:43:43.860668 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:43:43.860668 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:43:43.860668 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:43:43.860668 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:43:43.860668 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:43:43.860668 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:43:43.860668 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:43:43.860668 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:43:43.860668 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:43:43.860668 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:43:43.860668 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:43:43.860668 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:43:43.861545 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:43:43.861545 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:43:43.861545 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:43:43.861545 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:43:43.861545 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:43:43.861545 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:43:43.861545 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:43:43.861545 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:43:43.861545 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:43:43.861545 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:43:43.861545 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:43:43.861545 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:43:43.861545 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:43:43.861545 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:43:43.861545 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:43:43.861545 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:43:43.862327 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:43:43.862327 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:43:43.862327 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:43:43.862327 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:43:43.862327 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:43:43.862327 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:43:43.862327 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:43:43.862327 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:43:43.862327 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:43:43.862327 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:43:43.862327 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:43:43.862327 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:43:43.862327 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 220/444] 10.222.0.72 () {56 vars in 1096 bytes} [Mon Sep 19 14:43:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:43:43.863311 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b684c10-cf50-4726-8857-5575e9dbdfc4 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:43.869640 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2eb669-ba35-4aa4-9693-4cccd4030296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:43.870251 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2eb669-ba35-4aa4-9693-4cccd4030296 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:43.870515 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2eb669-ba35-4aa4-9693-4cccd4030296 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:43.871323 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2eb669-ba35-4aa4-9693-4cccd4030296 None admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:43.871970 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2eb669-ba35-4aa4-9693-4cccd4030296 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:43.872271 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2eb669-ba35-4aa4-9693-4cccd4030296 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:43.873661 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2eb669-ba35-4aa4-9693-4cccd4030296 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:43.881796 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 225/445] 10.222.0.72 () {56 vars in 1111 bytes} [Mon Sep 19 14:43:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:43.882867 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2eb669-ba35-4aa4-9693-4cccd4030296 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:43.967750 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b684c10-cf50-4726-8857-5575e9dbdfc4 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:43.982961 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2eb669-ba35-4aa4-9693-4cccd4030296 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:43.984831 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:44.002115 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc91f77-532d-4217-a93b-0672bfafd614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:44.002718 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc91f77-532d-4217-a93b-0672bfafd614 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:44.002991 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc91f77-532d-4217-a93b-0672bfafd614 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:44.003255 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc91f77-532d-4217-a93b-0672bfafd614 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:44.003962 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc91f77-532d-4217-a93b-0672bfafd614 None admin] RBAC: Adding query filter params (group.id=6d3f2ba43f564d788da119d6fd102c8d, role.id=efa0e5b3413748dc828a89b12d67df79, scope.project.id=4a1ea1922c4946d79ba6bac82ade352e) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:44.004265 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc91f77-532d-4217-a93b-0672bfafd614 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:44.005700 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc91f77-532d-4217-a93b-0672bfafd614 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:44.011556 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 221/446] 10.222.0.72 () {56 vars in 1376 bytes} [Mon Sep 19 14:43:43 2022] GET /identity/v3/role_assignments?group.id=6d3f2ba43f564d788da119d6fd102c8d&scope.project.id=4a1ea1922c4946d79ba6bac82ade352e&role.id=efa0e5b3413748dc828a89b12d67df79 => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:44.012409 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc91f77-532d-4217-a93b-0672bfafd614 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:44.021553 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37c9fd2-9734-4f9a-aa54-7384a2ee460e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:44.022090 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c9fd2-9734-4f9a-aa54-7384a2ee460e None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:44.022366 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c9fd2-9734-4f9a-aa54-7384a2ee460e None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:44.022632 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c9fd2-9734-4f9a-aa54-7384a2ee460e None admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:44.023304 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37c9fd2-9734-4f9a-aa54-7384a2ee460e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:44.023603 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37c9fd2-9734-4f9a-aa54-7384a2ee460e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:44.025068 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37c9fd2-9734-4f9a-aa54-7384a2ee460e None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:44.034730 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 226/447] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Sep 19 14:43:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:44.040902 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37c9fd2-9734-4f9a-aa54-7384a2ee460e None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:44.075043 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:44.143261 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc91f77-532d-4217-a93b-0672bfafd614 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:44.155903 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37c9fd2-9734-4f9a-aa54-7384a2ee460e None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:44.182378 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf637cc-2ceb-4da2-85cf-a63e6281d899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:44.182987 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf637cc-2ceb-4da2-85cf-a63e6281d899 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:44.183299 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf637cc-2ceb-4da2-85cf-a63e6281d899 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:44.184109 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf637cc-2ceb-4da2-85cf-a63e6281d899 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:44.193638 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff644e2-2977-4e32-b55c-4a99078df9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:44.194249 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff644e2-2977-4e32-b55c-4a99078df9c0 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:44.194528 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff644e2-2977-4e32-b55c-4a99078df9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:44.194803 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff644e2-2977-4e32-b55c-4a99078df9c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:44.245621 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:44.272021 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf637cc-2ceb-4da2-85cf-a63e6281d899 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:44.273503 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf637cc-2ceb-4da2-85cf-a63e6281d899 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:44.276177 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff644e2-2977-4e32-b55c-4a99078df9c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:44.277702 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff644e2-2977-4e32-b55c-4a99078df9c0 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:44.309286 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:44.389164 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 227/448] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Sep 19 14:43:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 14:43:44.395718 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff644e2-2977-4e32-b55c-4a99078df9c0 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:44.400059 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 222/449] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Sep 19 14:43:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 14:43:44.406415 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf637cc-2ceb-4da2-85cf-a63e6281d899 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:44.486332 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:44.495490 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff644e2-2977-4e32-b55c-4a99078df9c0 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:44.503746 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf637cc-2ceb-4da2-85cf-a63e6281d899 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:44.521585 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:44.530185 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676e8195-dad5-4838-b7eb-360f21881534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:44.530743 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676e8195-dad5-4838-b7eb-360f21881534 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:44.531022 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676e8195-dad5-4838-b7eb-360f21881534 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:44.531294 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676e8195-dad5-4838-b7eb-360f21881534 None admin] PATH_INFO: `/v3/projects/feee070208394133a3522f3d666241d3` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:44.532489 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676e8195-dad5-4838-b7eb-360f21881534 None admin] RBAC: Authorizing `identity:get_project(project_id=feee070208394133a3522f3d666241d3)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:44.533938 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676e8195-dad5-4838-b7eb-360f21881534 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:44.535546 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 228/450] 10.222.0.72 () {56 vars in 1186 bytes} [Mon Sep 19 14:43:44 2022] GET /identity/v3/projects/feee070208394133a3522f3d666241d3 => generated 344 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:44.537292 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848c4e9e-2246-48c5-92a0-452ffb830ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:44.537914 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848c4e9e-2246-48c5-92a0-452ffb830ddb None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:44.538190 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848c4e9e-2246-48c5-92a0-452ffb830ddb None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:44.538460 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848c4e9e-2246-48c5-92a0-452ffb830ddb None admin] PATH_INFO: `/v3/projects/4a1ea1922c4946d79ba6bac82ade352e` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:44.539557 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848c4e9e-2246-48c5-92a0-452ffb830ddb None admin] RBAC: Authorizing `identity:get_project(project_id=4a1ea1922c4946d79ba6bac82ade352e)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:44.540957 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676e8195-dad5-4838-b7eb-360f21881534 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:44.541056 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848c4e9e-2246-48c5-92a0-452ffb830ddb None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:44.547197 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 223/451] 10.222.0.72 () {56 vars in 1186 bytes} [Mon Sep 19 14:43:44 2022] GET /identity/v3/projects/4a1ea1922c4946d79ba6bac82ade352e => generated 302 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:43:44.548285 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848c4e9e-2246-48c5-92a0-452ffb830ddb None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:44.643545 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676e8195-dad5-4838-b7eb-360f21881534 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:44.647543 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848c4e9e-2246-48c5-92a0-452ffb830ddb None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:44.677312 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ff83dd-6ca6-49d4-aff2-2b7c6cac3b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:44.677930 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ff83dd-6ca6-49d4-aff2-2b7c6cac3b3e None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:44.678206 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ff83dd-6ca6-49d4-aff2-2b7c6cac3b3e None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:44.678478 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ff83dd-6ca6-49d4-aff2-2b7c6cac3b3e None admin] PATH_INFO: `/v3/groups/63c4e945afeb49dbaf6cdc00601f1a78` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:44.679561 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ff83dd-6ca6-49d4-aff2-2b7c6cac3b3e None admin] RBAC: Authorizing `identity:get_group(group_id=63c4e945afeb49dbaf6cdc00601f1a78)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:44.681029 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ff83dd-6ca6-49d4-aff2-2b7c6cac3b3e None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:44.681514 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7334577-59d8-4df2-ab56-7cd117e250ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:44.682389 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7334577-59d8-4df2-ab56-7cd117e250ca None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:44.682671 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7334577-59d8-4df2-ab56-7cd117e250ca None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:44.682946 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7334577-59d8-4df2-ab56-7cd117e250ca None admin] PATH_INFO: `/v3/groups/6d3f2ba43f564d788da119d6fd102c8d` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:44.683133 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 229/452] 10.222.0.72 () {56 vars in 1180 bytes} [Mon Sep 19 14:43:44 2022] GET /identity/v3/groups/63c4e945afeb49dbaf6cdc00601f1a78 => generated 229 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:44.684268 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7334577-59d8-4df2-ab56-7cd117e250ca None admin] RBAC: Authorizing `identity:get_group(group_id=6d3f2ba43f564d788da119d6fd102c8d)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:44.685732 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7334577-59d8-4df2-ab56-7cd117e250ca None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:44.687278 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 224/453] 10.222.0.72 () {56 vars in 1180 bytes} [Mon Sep 19 14:43:44 2022] GET /identity/v3/groups/6d3f2ba43f564d788da119d6fd102c8d => generated 226 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:43:44.691992 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ff83dd-6ca6-49d4-aff2-2b7c6cac3b3e None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:44.692803 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7334577-59d8-4df2-ab56-7cd117e250ca None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:44.710845 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:44.750743 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:44.789632 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ff83dd-6ca6-49d4-aff2-2b7c6cac3b3e None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:44.792283 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7334577-59d8-4df2-ab56-7cd117e250ca None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:44.824496 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dbc06d-36e5-438d-98eb-cc99cedd7b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:44.825099 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dbc06d-36e5-438d-98eb-cc99cedd7b42 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:44.825380 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dbc06d-36e5-438d-98eb-cc99cedd7b42 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:44.825658 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dbc06d-36e5-438d-98eb-cc99cedd7b42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:44.826373 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dbc06d-36e5-438d-98eb-cc99cedd7b42 None admin] RBAC: Adding query filter params (group.id=63c4e945afeb49dbaf6cdc00601f1a78, role.id=ddb643577b2e4e478100ec370decfaeb, scope.project.id=feee070208394133a3522f3d666241d3) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:44.826682 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dbc06d-36e5-438d-98eb-cc99cedd7b42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:44.826770 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05c105d-44ea-4a10-9e2c-de4477cd1c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:44.827297 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c105d-44ea-4a10-9e2c-de4477cd1c5c None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:44.827580 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c105d-44ea-4a10-9e2c-de4477cd1c5c None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:44.827886 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c105d-44ea-4a10-9e2c-de4477cd1c5c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:44.828115 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dbc06d-36e5-438d-98eb-cc99cedd7b42 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:44.828641 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05c105d-44ea-4a10-9e2c-de4477cd1c5c None admin] RBAC: Adding query filter params (group.id=6d3f2ba43f564d788da119d6fd102c8d, role.id=962ee04d08ae41b08c1a5108c54c7469, scope.project.id=4a1ea1922c4946d79ba6bac82ade352e) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:44.828954 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05c105d-44ea-4a10-9e2c-de4477cd1c5c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:44.830367 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05c105d-44ea-4a10-9e2c-de4477cd1c5c None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:44.833967 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 230/454] 10.222.0.72 () {56 vars in 1376 bytes} [Mon Sep 19 14:43:44 2022] GET /identity/v3/role_assignments?group.id=63c4e945afeb49dbaf6cdc00601f1a78&scope.project.id=feee070208394133a3522f3d666241d3&role.id=ddb643577b2e4e478100ec370decfaeb => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:43:44.839696 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 225/455] 10.222.0.72 () {56 vars in 1376 bytes} [Mon Sep 19 14:43:44 2022] GET /identity/v3/role_assignments?group.id=6d3f2ba43f564d788da119d6fd102c8d&scope.project.id=4a1ea1922c4946d79ba6bac82ade352e&role.id=962ee04d08ae41b08c1a5108c54c7469 => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:47.604918 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dce43a-80a8-4521-8e53-b1747a663346 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:47.606176 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dce43a-80a8-4521-8e53-b1747a663346 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:47.606747 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dce43a-80a8-4521-8e53-b1747a663346 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:47.608408 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 231/456] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:43:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:43:47.614435 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa534e4-e26f-4ff4-ab22-4538772d941e None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:47.614959 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa534e4-e26f-4ff4-ab22-4538772d941e None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:47.614959 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa534e4-e26f-4ff4-ab22-4538772d941e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:47.641529 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-9fa534e4-e26f-4ff4-ab22-4538772d941e None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:43:47.642735 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-9fa534e4-e26f-4ff4-ab22-4538772d941e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:43:47.730465 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 226/457] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:43:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:43:47.845110 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b653b23-d9b4-48a1-8098-077c6b604f46 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:47.845444 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b653b23-d9b4-48a1-8098-077c6b604f46 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:47.845659 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b653b23-d9b4-48a1-8098-077c6b604f46 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:47.847229 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 232/458] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:43:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:43:47.852212 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74a368b-ae15-4fb2-9360-5c6ca557f557 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:47.852536 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74a368b-ae15-4fb2-9360-5c6ca557f557 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:47.852810 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74a368b-ae15-4fb2-9360-5c6ca557f557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:47.880668 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-c74a368b-ae15-4fb2-9360-5c6ca557f557 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:43:47.881776 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-c74a368b-ae15-4fb2-9360-5c6ca557f557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:43:47.898120 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:47.930748 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b59c765-661e-4a39-90b3-0e5245a67bec None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:47.931031 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b59c765-661e-4a39-90b3-0e5245a67bec None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:47.931299 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b59c765-661e-4a39-90b3-0e5245a67bec None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:47.932920 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 233/459] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:43:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 14:43:47.939540 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e9bdab-072f-40a3-9594-c6a98b291397 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:47.939817 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e9bdab-072f-40a3-9594-c6a98b291397 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:47.940086 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e9bdab-072f-40a3-9594-c6a98b291397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:47.967016 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-a6e9bdab-072f-40a3-9594-c6a98b291397 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:43:47.968223 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-a6e9bdab-072f-40a3-9594-c6a98b291397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:43:48.014556 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 227/460] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:43:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:43:48.086087 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 234/461] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:43:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:43:48.121773 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74a368b-ae15-4fb2-9360-5c6ca557f557 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:48.237990 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74a368b-ae15-4fb2-9360-5c6ca557f557 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:48.286280 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8000aa95-7c40-4f86-b6c9-cd47e2a1e4fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:48.286921 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8000aa95-7c40-4f86-b6c9-cd47e2a1e4fb None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:48.287202 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8000aa95-7c40-4f86-b6c9-cd47e2a1e4fb None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:48.287474 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8000aa95-7c40-4f86-b6c9-cd47e2a1e4fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:48.298774 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8000aa95-7c40-4f86-b6c9-cd47e2a1e4fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:48.300227 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8000aa95-7c40-4f86-b6c9-cd47e2a1e4fb None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:48.302054 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:48.316135 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-8000aa95-7c40-4f86-b6c9-cd47e2a1e4fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:43:48.316135 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:48.316135 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:43:48.316135 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:43:48.316135 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:43:48.316135 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:43:48.316135 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:43:48.316135 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:43:48.316135 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:43:48.316135 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:43:48.316135 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:43:48.316135 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:43:48.316135 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:43:48.316135 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:43:48.316135 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:43:48.316135 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:43:48.318290 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:43:48.318290 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:43:48.318290 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:43:48.318290 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:43:48.318290 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:43:48.318290 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:43:48.318290 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:43:48.318290 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:43:48.318290 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:43:48.318290 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:43:48.318290 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:43:48.318290 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:43:48.318290 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:43:48.318290 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:43:48.318290 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:43:48.318290 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:43:48.318290 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:43:48.320364 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:43:48.320364 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:43:48.320364 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:43:48.320364 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 228/462] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:43:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:43:48.323464 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e9bdab-072f-40a3-9594-c6a98b291397 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:48.394115 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8000aa95-7c40-4f86-b6c9-cd47e2a1e4fb None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:48.415342 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:48.474652 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e9bdab-072f-40a3-9594-c6a98b291397 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:48.522928 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9087d5b9-004e-426c-8249-82baaeb08251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:48.524436 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9087d5b9-004e-426c-8249-82baaeb08251 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:48.525025 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9087d5b9-004e-426c-8249-82baaeb08251 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:48.525526 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9087d5b9-004e-426c-8249-82baaeb08251 None admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:48.527030 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9087d5b9-004e-426c-8249-82baaeb08251 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:48.527721 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9087d5b9-004e-426c-8249-82baaeb08251 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:48.530098 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9087d5b9-004e-426c-8249-82baaeb08251 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:48.532856 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8000aa95-7c40-4f86-b6c9-cd47e2a1e4fb None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:48.547003 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 235/463] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Sep 19 14:43:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:48.548113 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9087d5b9-004e-426c-8249-82baaeb08251 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:48.578310 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84c9c0d-04f3-4c04-a6e3-3a6bc6dfd196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:48.578938 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c9c0d-04f3-4c04-a6e3-3a6bc6dfd196 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:48.579219 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c9c0d-04f3-4c04-a6e3-3a6bc6dfd196 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:48.579491 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c9c0d-04f3-4c04-a6e3-3a6bc6dfd196 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:48.590929 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84c9c0d-04f3-4c04-a6e3-3a6bc6dfd196 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:48.592400 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84c9c0d-04f3-4c04-a6e3-3a6bc6dfd196 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:48.608176 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-f84c9c0d-04f3-4c04-a6e3-3a6bc6dfd196 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:43:48.608176 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:48.608176 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:43:48.608176 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:43:48.608176 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:43:48.608176 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:43:48.608176 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:43:48.608176 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:43:48.608176 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:43:48.608176 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:43:48.608176 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:43:48.608176 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:43:48.608176 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:43:48.608176 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:43:48.608176 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:43:48.608176 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:43:48.609130 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:43:48.609130 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:43:48.609130 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:43:48.609130 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:43:48.609130 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:43:48.609130 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:43:48.609130 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:43:48.609130 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:43:48.609130 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:43:48.609130 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:43:48.609130 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:43:48.609130 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:43:48.609130 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:43:48.609130 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:43:48.609130 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:43:48.609130 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:43:48.609130 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:43:48.613576 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:43:48.613576 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:43:48.613576 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:43:48.613576 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 229/464] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:43:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:43:48.613576 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84c9c0d-04f3-4c04-a6e3-3a6bc6dfd196 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:48.657883 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9087d5b9-004e-426c-8249-82baaeb08251 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:48.659577 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:48.677663 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:48.696913 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0575776c-0f8b-4ce6-ab38-5aaf3049cabc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:48.697745 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0575776c-0f8b-4ce6-ab38-5aaf3049cabc None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:48.697855 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0575776c-0f8b-4ce6-ab38-5aaf3049cabc None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:48.698079 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0575776c-0f8b-4ce6-ab38-5aaf3049cabc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:48.708852 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0575776c-0f8b-4ce6-ab38-5aaf3049cabc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:48.710359 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0575776c-0f8b-4ce6-ab38-5aaf3049cabc None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:48.721476 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84c9c0d-04f3-4c04-a6e3-3a6bc6dfd196 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:48.725213 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-0575776c-0f8b-4ce6-ab38-5aaf3049cabc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:43:48.725213 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:48.725213 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:43:48.725213 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:43:48.725213 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:43:48.725213 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:43:48.725213 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:43:48.725213 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:43:48.725213 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:43:48.725213 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:43:48.725213 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:43:48.725213 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:43:48.725213 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:43:48.725213 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:43:48.725213 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:43:48.725213 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:43:48.726082 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:43:48.726082 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:43:48.726082 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:43:48.726082 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:43:48.726082 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:43:48.726082 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:43:48.726082 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:43:48.726082 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:43:48.726082 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:43:48.726082 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:43:48.726082 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:43:48.726082 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:43:48.726082 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:43:48.726082 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:43:48.726082 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:43:48.726082 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:43:48.726082 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:43:48.726899 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:43:48.726899 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:43:48.726899 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:43:48.726899 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 236/465] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:43:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:43:48.727852 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833f978d-7aca-497f-8fc4-fdfdad5dbf83 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:48.728138 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833f978d-7aca-497f-8fc4-fdfdad5dbf83 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:48.728438 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833f978d-7aca-497f-8fc4-fdfdad5dbf83 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:48.734222 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 237/466] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:43:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:43:48.735036 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833f978d-7aca-497f-8fc4-fdfdad5dbf83 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:48.760457 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94adfce-e4a4-4c29-98c7-798d6f237c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:48.761093 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94adfce-e4a4-4c29-98c7-798d6f237c6c None admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:48.761901 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94adfce-e4a4-4c29-98c7-798d6f237c6c None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:48.762182 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94adfce-e4a4-4c29-98c7-798d6f237c6c None admin] PATH_INFO: `/v3/users` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:48.762835 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94adfce-e4a4-4c29-98c7-798d6f237c6c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:48.764273 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94adfce-e4a4-4c29-98c7-798d6f237c6c None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:48.794000 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 230/467] 10.222.0.72 () {60 vars in 1132 bytes} [Mon Sep 19 14:43:48 2022] POST /identity/v3/users => generated 246 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:43:48.794000 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94adfce-e4a4-4c29-98c7-798d6f237c6c None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:48.865486 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833f978d-7aca-497f-8fc4-fdfdad5dbf83 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:48.910222 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed69442-0dfc-4a84-a0a2-eaa178a4d4b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:48.910863 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed69442-0dfc-4a84-a0a2-eaa178a4d4b5 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:48.911470 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed69442-0dfc-4a84-a0a2-eaa178a4d4b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:48.911470 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed69442-0dfc-4a84-a0a2-eaa178a4d4b5 None admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:48.912197 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed69442-0dfc-4a84-a0a2-eaa178a4d4b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:48.912569 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed69442-0dfc-4a84-a0a2-eaa178a4d4b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:48.914047 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed69442-0dfc-4a84-a0a2-eaa178a4d4b5 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:48.926643 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94adfce-e4a4-4c29-98c7-798d6f237c6c None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:48.928451 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:48.929966 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 238/468] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Sep 19 14:43:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:48.931356 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973ba26a-112c-474b-8d98-d94a77ef8fad None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:48.931650 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973ba26a-112c-474b-8d98-d94a77ef8fad None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:48.932197 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973ba26a-112c-474b-8d98-d94a77ef8fad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:48.954793 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-973ba26a-112c-474b-8d98-d94a77ef8fad None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:43:48.956097 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-973ba26a-112c-474b-8d98-d94a77ef8fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:43:48.974822 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b45271-3a8e-4ea2-b35c-8ecf663aa78b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:48.975436 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b45271-3a8e-4ea2-b35c-8ecf663aa78b None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:48.975718 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b45271-3a8e-4ea2-b35c-8ecf663aa78b None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:48.975994 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b45271-3a8e-4ea2-b35c-8ecf663aa78b None admin] PATH_INFO: `/v3/domains` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:48.976872 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b45271-3a8e-4ea2-b35c-8ecf663aa78b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:48.977171 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b45271-3a8e-4ea2-b35c-8ecf663aa78b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:48.978793 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b45271-3a8e-4ea2-b35c-8ecf663aa78b None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:48.986623 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:48.994235 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 231/469] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Sep 19 14:43:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:48.994794 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b45271-3a8e-4ea2-b35c-8ecf663aa78b None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:49.046672 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 239/470] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:43:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:43:49.047970 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973ba26a-112c-474b-8d98-d94a77ef8fad None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:49.127776 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b45271-3a8e-4ea2-b35c-8ecf663aa78b None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:49.174245 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bb69e4-4795-4c07-9d80-0e1c31e18237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:49.175261 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb69e4-4795-4c07-9d80-0e1c31e18237 None admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:49.175544 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb69e4-4795-4c07-9d80-0e1c31e18237 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:49.175813 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb69e4-4795-4c07-9d80-0e1c31e18237 None admin] PATH_INFO: `/v3/users` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:49.176754 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bb69e4-4795-4c07-9d80-0e1c31e18237 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:49.178260 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bb69e4-4795-4c07-9d80-0e1c31e18237 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:49.178798 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973ba26a-112c-474b-8d98-d94a77ef8fad None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:49.219688 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 232/471] 10.222.0.72 () {60 vars in 1132 bytes} [Mon Sep 19 14:43:48 2022] POST /identity/v3/users => generated 248 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:43:49.222791 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244072ac-ff5a-495f-bfe0-e492326fc8ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:49.223425 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244072ac-ff5a-495f-bfe0-e492326fc8ca None admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:49.223704 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244072ac-ff5a-495f-bfe0-e492326fc8ca None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:49.223974 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244072ac-ff5a-495f-bfe0-e492326fc8ca None admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:49.228460 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244072ac-ff5a-495f-bfe0-e492326fc8ca None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:49.228460 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244072ac-ff5a-495f-bfe0-e492326fc8ca None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:49.250400 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 240/472] 10.222.0.72 () {60 vars in 1132 bytes} [Mon Sep 19 14:43:49 2022] POST /identity/v3/users => generated 248 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:43:49.329159 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7befe1d-1e71-4d30-8d5e-9f900727d10c None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:49.329809 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7befe1d-1e71-4d30-8d5e-9f900727d10c None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:49.330306 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7befe1d-1e71-4d30-8d5e-9f900727d10c None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:49.333148 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 233/473] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:43:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:43:49.338853 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2bdf42-780e-4027-af7c-270ad1c24a0b None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:49.339191 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2bdf42-780e-4027-af7c-270ad1c24a0b None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:49.339391 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2bdf42-780e-4027-af7c-270ad1c24a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:49.365855 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-2d2bdf42-780e-4027-af7c-270ad1c24a0b None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:43:49.367073 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-2d2bdf42-780e-4027-af7c-270ad1c24a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:43:49.380621 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:49.447739 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7befe1d-1e71-4d30-8d5e-9f900727d10c None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:49.466718 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 241/474] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:43:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:43:49.479991 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:49.579887 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7befe1d-1e71-4d30-8d5e-9f900727d10c None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:49.616982 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4f0180-161e-4a3e-b8bc-f9ad17d4962f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:49.617620 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f0180-161e-4a3e-b8bc-f9ad17d4962f None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:49.617905 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f0180-161e-4a3e-b8bc-f9ad17d4962f None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:49.618185 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f0180-161e-4a3e-b8bc-f9ad17d4962f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:49.631967 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4f0180-161e-4a3e-b8bc-f9ad17d4962f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:49.633746 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4f0180-161e-4a3e-b8bc-f9ad17d4962f None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:49.655099 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-8e4f0180-161e-4a3e-b8bc-f9ad17d4962f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:43:49.655099 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:49.655099 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:43:49.655099 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:43:49.655099 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:43:49.655099 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:43:49.655099 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:43:49.655099 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:43:49.655099 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:43:49.655099 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:43:49.655099 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:43:49.655099 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:43:49.655099 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:43:49.655099 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:43:49.655099 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:43:49.655099 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:43:49.656024 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:43:49.656024 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:43:49.656024 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:43:49.656024 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:43:49.656024 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:43:49.656024 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:43:49.656024 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:43:49.656024 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:43:49.656024 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:43:49.656024 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:43:49.656024 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:43:49.656024 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:43:49.656024 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:43:49.656024 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:43:49.656024 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:43:49.656024 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:43:49.656024 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:43:49.657109 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:43:49.657109 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:43:49.657109 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:43:49.657109 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 234/475] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:43:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:43:49.662178 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2bdf42-780e-4027-af7c-270ad1c24a0b None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:49.755165 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4f0180-161e-4a3e-b8bc-f9ad17d4962f None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:49.841712 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2bdf42-780e-4027-af7c-270ad1c24a0b None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:49.872125 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:49.915811 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f978e03-d220-4c27-a751-d7598f61e7f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:49.916761 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f978e03-d220-4c27-a751-d7598f61e7f8 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:49.917233 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f978e03-d220-4c27-a751-d7598f61e7f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:49.918335 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f978e03-d220-4c27-a751-d7598f61e7f8 None admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:49.919544 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f978e03-d220-4c27-a751-d7598f61e7f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:49.920038 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f978e03-d220-4c27-a751-d7598f61e7f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:49.921641 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f978e03-d220-4c27-a751-d7598f61e7f8 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:49.930447 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4f0180-161e-4a3e-b8bc-f9ad17d4962f None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:49.958549 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 242/476] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Sep 19 14:43:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:49.965141 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f978e03-d220-4c27-a751-d7598f61e7f8 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:49.971833 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a7aeb7-ac60-4d01-ae0f-e605445e19f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:49.972480 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a7aeb7-ac60-4d01-ae0f-e605445e19f2 None admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:49.972763 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a7aeb7-ac60-4d01-ae0f-e605445e19f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:49.973038 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a7aeb7-ac60-4d01-ae0f-e605445e19f2 None admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:49.973728 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a7aeb7-ac60-4d01-ae0f-e605445e19f2 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:49.975097 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a7aeb7-ac60-4d01-ae0f-e605445e19f2 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:49.984239 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:49.991284 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.sql.core [None req-a5a7aeb7-ac60-4d01-ae0f-e605445e19f2 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 19 14:43:49.991284 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 19 14:43:49.991284 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [parameters: {'id': 'd5721c8a720848d083517020c91c2c54', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 19 14:43:49.991284 dv-cinder-756711-11-smb devstack@keystone.service[81452]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81452) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 19 14:43:50.009049 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-a5a7aeb7-ac60-4d01-ae0f-e605445e19f2 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 19 14:43:50.009049 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:50.009049 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 19 14:43:50.009049 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 19 14:43:50.009049 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 19 14:43:50.009049 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 19 14:43:50.009049 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 19 14:43:50.009049 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application result = self._query(query) Sep 19 14:43:50.009049 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 19 14:43:50.009049 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application conn.query(q) Sep 19 14:43:50.009049 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 19 14:43:50.009049 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 19 14:43:50.009049 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 19 14:43:50.009049 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application result.read() Sep 19 14:43:50.009049 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 19 14:43:50.009947 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 19 14:43:50.009947 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 19 14:43:50.009947 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 19 14:43:50.009947 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 19 14:43:50.009947 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 19 14:43:50.009947 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 19 14:43:50.009947 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 19 14:43:50.009947 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 19 14:43:50.009947 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:43:50.009947 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 19 14:43:50.009947 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:43:50.009947 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:50.009947 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 19 14:43:50.009947 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 19 14:43:50.009947 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 19 14:43:50.009947 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return ref.to_dict() Sep 19 14:43:50.009947 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 19 14:43:50.009947 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application next(self.gen) Sep 19 14:43:50.010821 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 19 14:43:50.010821 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application yield resource Sep 19 14:43:50.010821 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 19 14:43:50.010821 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application next(self.gen) Sep 19 14:43:50.010821 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 19 14:43:50.010821 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application self.session.rollback() Sep 19 14:43:50.010821 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 19 14:43:50.010821 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application self.force_reraise() Sep 19 14:43:50.010821 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 19 14:43:50.010821 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise self.value Sep 19 14:43:50.010821 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 19 14:43:50.010821 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 19 14:43:50.010821 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 19 14:43:50.010821 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application session.commit() Sep 19 14:43:50.010821 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 19 14:43:50.010821 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 19 14:43:50.010821 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 19 14:43:50.012294 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application self._prepare_impl() Sep 19 14:43:50.012294 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 19 14:43:50.012294 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application self.session.flush() Sep 19 14:43:50.012294 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 19 14:43:50.012294 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application self._flush(objects) Sep 19 14:43:50.012294 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 19 14:43:50.012294 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 19 14:43:50.012294 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 19 14:43:50.012294 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application compat.raise_( Sep 19 14:43:50.012294 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 19 14:43:50.012294 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception Sep 19 14:43:50.012294 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 19 14:43:50.012294 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application flush_context.execute() Sep 19 14:43:50.012294 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 19 14:43:50.012294 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rec.execute(self) Sep 19 14:43:50.012294 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 19 14:43:50.012294 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 19 14:43:50.016668 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 19 14:43:50.016668 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 19 14:43:50.016668 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 19 14:43:50.016668 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 19 14:43:50.016668 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 19 14:43:50.016668 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 19 14:43:50.016668 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 19 14:43:50.016668 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 19 14:43:50.016668 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 19 14:43:50.016668 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 19 14:43:50.016668 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 19 14:43:50.016668 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 19 14:43:50.016668 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 19 14:43:50.016668 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 19 14:43:50.016668 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 19 14:43:50.016668 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception Sep 19 14:43:50.020588 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 19 14:43:50.020588 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 19 14:43:50.020588 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 19 14:43:50.020588 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 19 14:43:50.020588 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 19 14:43:50.020588 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application result = self._query(query) Sep 19 14:43:50.020588 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 19 14:43:50.020588 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application conn.query(q) Sep 19 14:43:50.020588 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 19 14:43:50.020588 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 19 14:43:50.020588 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 19 14:43:50.020588 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application result.read() Sep 19 14:43:50.020588 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 19 14:43:50.020588 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 19 14:43:50.020588 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 19 14:43:50.020588 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 19 14:43:50.022503 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 19 14:43:50.022503 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 19 14:43:50.022503 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 19 14:43:50.022503 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 19 14:43:50.022503 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 19 14:43:50.022503 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 19 14:43:50.022503 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [parameters: {'id': 'd5721c8a720848d083517020c91c2c54', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 19 14:43:50.022503 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 19 14:43:50.022503 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:43:50.022503 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 14:43:50.022503 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:43:50.022503 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:50.022503 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:43:50.022503 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:43:50.022503 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:43:50.022503 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:43:50.023681 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:43:50.023681 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:43:50.023681 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:43:50.023681 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:43:50.023681 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:43:50.023681 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:43:50.023681 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 19 14:43:50.023681 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 19 14:43:50.023681 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:43:50.023681 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:43:50.023681 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 19 14:43:50.023681 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 19 14:43:50.023681 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 19 14:43:50.023681 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 19 14:43:50.023681 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 19 14:43:50.023681 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:43:50.024665 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 235/477] 10.222.0.72 () {60 vars in 1131 bytes} [Mon Sep 19 14:43:49 2022] POST /identity/v3/roles => generated 144 bytes in 256 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:43:50.028698 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a7aeb7-ac60-4d01-ae0f-e605445e19f2 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:50.171556 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f978e03-d220-4c27-a751-d7598f61e7f8 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:50.193580 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a7aeb7-ac60-4d01-ae0f-e605445e19f2 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:50.231058 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e35817-ed69-4135-be02-aa44fc3f365b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:50.231854 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e35817-ed69-4135-be02-aa44fc3f365b None admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:50.232138 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e35817-ed69-4135-be02-aa44fc3f365b None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:50.232440 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e35817-ed69-4135-be02-aa44fc3f365b None admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:50.233096 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e35817-ed69-4135-be02-aa44fc3f365b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:50.234541 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e35817-ed69-4135-be02-aa44fc3f365b None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:50.254783 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0fb661-920b-485d-887b-15aecca36927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:50.255418 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0fb661-920b-485d-887b-15aecca36927 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:50.255700 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0fb661-920b-485d-887b-15aecca36927 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:50.255973 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0fb661-920b-485d-887b-15aecca36927 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:50.258590 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:50.274453 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 243/478] 10.222.0.72 () {60 vars in 1132 bytes} [Mon Sep 19 14:43:49 2022] POST /identity/v3/users => generated 249 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:43:50.276523 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0fb661-920b-485d-887b-15aecca36927 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:43:50.281845 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-da0fb661-920b-485d-887b-15aecca36927 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 14:43:50.281845 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:50.281845 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:43:50.281845 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:43:50.281845 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:43:50.281845 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:43:50.281845 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:43:50.281845 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:43:50.281845 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:43:50.281845 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:43:50.281845 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:43:50.281845 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:43:50.281845 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:43:50.281845 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:43:50.281845 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:43:50.281845 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:43:50.282783 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:43:50.282783 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:43:50.282783 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:43:50.282783 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:43:50.282783 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:43:50.282783 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:43:50.282783 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:43:50.282783 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:43:50.282783 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:43:50.282783 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:43:50.282783 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:43:50.282783 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:43:50.282783 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:43:50.282783 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:43:50.282783 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:43:50.282783 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:43:50.283563 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:43:50.283563 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:43:50.283563 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:43:50.283563 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:43:50.283563 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:43:50.283563 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:43:50.283563 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:43:50.283563 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:43:50.283563 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:43:50.283563 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:43:50.283563 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 14:43:50.283563 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:43:50.283563 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 236/479] 10.222.0.72 () {56 vars in 1114 bytes} [Mon Sep 19 14:43:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:43:50.290256 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e35817-ed69-4135-be02-aa44fc3f365b None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:50.390096 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:50.446961 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e35817-ed69-4135-be02-aa44fc3f365b None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:50.497603 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d3c533-2405-425a-bc6f-e75107596193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:50.498215 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d3c533-2405-425a-bc6f-e75107596193 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:50.498493 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d3c533-2405-425a-bc6f-e75107596193 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:50.498765 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d3c533-2405-425a-bc6f-e75107596193 None admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:50.499439 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d3c533-2405-425a-bc6f-e75107596193 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:50.499736 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d3c533-2405-425a-bc6f-e75107596193 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:50.501191 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d3c533-2405-425a-bc6f-e75107596193 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:50.510351 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 244/480] 10.222.0.72 () {56 vars in 1111 bytes} [Mon Sep 19 14:43:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:51.588906 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a9e030-cba4-4660-9c6e-6ff6d82c75a8 None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:51.589418 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a9e030-cba4-4660-9c6e-6ff6d82c75a8 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:51.589418 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a9e030-cba4-4660-9c6e-6ff6d82c75a8 None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:51.591452 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 237/481] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:43:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:43:51.596587 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c90fd8a-af0a-4aaa-8bc9-3924fe9e45cc None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:51.597015 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c90fd8a-af0a-4aaa-8bc9-3924fe9e45cc None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:51.597187 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c90fd8a-af0a-4aaa-8bc9-3924fe9e45cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:51.622158 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-3c90fd8a-af0a-4aaa-8bc9-3924fe9e45cc None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:43:51.623359 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-3c90fd8a-af0a-4aaa-8bc9-3924fe9e45cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:43:51.713565 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 245/482] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:43:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:43:52.050194 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d390630-0d9c-44ad-a2db-d2cf8d0a19e2 None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:52.050520 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d390630-0d9c-44ad-a2db-d2cf8d0a19e2 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:52.050776 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d390630-0d9c-44ad-a2db-d2cf8d0a19e2 None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:52.052440 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 238/483] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:43:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:43:52.057592 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a3373f-06d5-42b6-bc52-453d8d61531e None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:52.057878 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a3373f-06d5-42b6-bc52-453d8d61531e None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:52.058155 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a3373f-06d5-42b6-bc52-453d8d61531e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:52.081605 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-30a3373f-06d5-42b6-bc52-453d8d61531e None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:43:52.082669 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d390630-0d9c-44ad-a2db-d2cf8d0a19e2 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:52.082848 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-30a3373f-06d5-42b6-bc52-453d8d61531e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:43:52.145891 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:52.167976 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 246/484] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:43:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:43:52.228728 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b67541e-d3ea-4ba6-a6f7-3bec946cd73a None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:52.229118 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b67541e-d3ea-4ba6-a6f7-3bec946cd73a None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:52.229465 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b67541e-d3ea-4ba6-a6f7-3bec946cd73a None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:52.231281 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 247/485] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:43:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:43:52.236126 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245612aa-92d4-4a63-9139-0ff7db5c13ed None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:52.236446 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245612aa-92d4-4a63-9139-0ff7db5c13ed None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:52.236729 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245612aa-92d4-4a63-9139-0ff7db5c13ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:52.264217 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d390630-0d9c-44ad-a2db-d2cf8d0a19e2 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:52.274737 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-245612aa-92d4-4a63-9139-0ff7db5c13ed None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:43:52.278658 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-245612aa-92d4-4a63-9139-0ff7db5c13ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:43:52.330140 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d866abfa-3c55-416b-8e04-d42b71ad0117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:52.330751 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d866abfa-3c55-416b-8e04-d42b71ad0117 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:52.331103 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d866abfa-3c55-416b-8e04-d42b71ad0117 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:52.331466 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d866abfa-3c55-416b-8e04-d42b71ad0117 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:52.357447 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d866abfa-3c55-416b-8e04-d42b71ad0117 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:43:52.359600 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 248/486] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:43:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:43:52.367427 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-d866abfa-3c55-416b-8e04-d42b71ad0117 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:43:52.367427 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:52.367427 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:43:52.367427 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:43:52.367427 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:43:52.367427 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:43:52.367427 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:43:52.367427 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:43:52.367427 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:43:52.367427 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:43:52.367427 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:43:52.367427 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:43:52.367427 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:43:52.367427 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:43:52.367427 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:43:52.367427 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:43:52.368279 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:43:52.368279 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:43:52.368279 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:43:52.368279 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:43:52.368279 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:43:52.368279 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:43:52.368279 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:43:52.368279 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:43:52.368279 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:43:52.368279 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:43:52.368279 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:43:52.368279 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:43:52.368279 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:43:52.368279 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:43:52.368279 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:43:52.368279 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:43:52.369418 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:43:52.369418 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:43:52.369418 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:43:52.369418 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:43:52.369418 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:43:52.369418 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:43:52.369418 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:43:52.369418 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:43:52.369418 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:43:52.369418 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:43:52.369418 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:43:52.369418 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:43:52.371857 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 239/487] 10.222.0.72 () {56 vars in 1102 bytes} [Mon Sep 19 14:43:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:43:52.377722 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245612aa-92d4-4a63-9139-0ff7db5c13ed None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:52.507161 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d866abfa-3c55-416b-8e04-d42b71ad0117 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:52.545779 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245612aa-92d4-4a63-9139-0ff7db5c13ed None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:52.565001 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:52.588813 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6af950d-ce08-4758-a9a3-01b3bf84000a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:52.590516 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6af950d-ce08-4758-a9a3-01b3bf84000a None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:52.591121 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6af950d-ce08-4758-a9a3-01b3bf84000a None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:52.591625 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6af950d-ce08-4758-a9a3-01b3bf84000a None admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:52.592591 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6af950d-ce08-4758-a9a3-01b3bf84000a None admin] RBAC: Adding query filter params (name=service) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:52.593085 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6af950d-ce08-4758-a9a3-01b3bf84000a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:52.594635 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6af950d-ce08-4758-a9a3-01b3bf84000a None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:52.609514 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:52.612472 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 249/488] 10.222.0.72 () {56 vars in 1103 bytes} [Mon Sep 19 14:43:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:52.618872 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6af950d-ce08-4758-a9a3-01b3bf84000a None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:52.661119 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d866abfa-3c55-416b-8e04-d42b71ad0117 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:52.698057 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ff9fb1-7924-4f7c-aa64-a0617312726a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:52.699186 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ff9fb1-7924-4f7c-aa64-a0617312726a None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:52.699738 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ff9fb1-7924-4f7c-aa64-a0617312726a None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:52.700204 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ff9fb1-7924-4f7c-aa64-a0617312726a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:52.712553 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ff9fb1-7924-4f7c-aa64-a0617312726a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:43:52.719791 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-57ff9fb1-7924-4f7c-aa64-a0617312726a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:43:52.719791 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:52.719791 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:43:52.719791 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:43:52.719791 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:43:52.719791 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:43:52.719791 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:43:52.719791 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:43:52.719791 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:43:52.719791 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:43:52.719791 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:43:52.719791 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:43:52.719791 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:43:52.719791 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:43:52.719791 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:43:52.719791 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:43:52.720817 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:43:52.720817 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:43:52.720817 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:43:52.720817 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:43:52.720817 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:43:52.720817 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:43:52.720817 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:43:52.720817 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:43:52.720817 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:43:52.720817 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:43:52.720817 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:43:52.720817 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:43:52.720817 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:43:52.720817 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:43:52.720817 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:43:52.720817 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:43:52.721592 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:43:52.721592 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:43:52.721592 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:43:52.721592 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:43:52.721592 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:43:52.721592 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:43:52.721592 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:43:52.721592 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:43:52.721592 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:43:52.721592 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:43:52.721592 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:43:52.721592 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:43:52.722190 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 240/489] 10.222.0.72 () {56 vars in 1102 bytes} [Mon Sep 19 14:43:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:43:52.722782 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ff9fb1-7924-4f7c-aa64-a0617312726a None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:52.748624 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6af950d-ce08-4758-a9a3-01b3bf84000a None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:52.796662 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717f951a-a44b-4cd6-a569-df860b25f0f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:52.797260 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717f951a-a44b-4cd6-a569-df860b25f0f6 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:52.797533 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717f951a-a44b-4cd6-a569-df860b25f0f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:52.798923 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717f951a-a44b-4cd6-a569-df860b25f0f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:52.811894 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717f951a-a44b-4cd6-a569-df860b25f0f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:52.813445 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717f951a-a44b-4cd6-a569-df860b25f0f6 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:52.828175 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-717f951a-a44b-4cd6-a569-df860b25f0f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:43:52.828175 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:52.828175 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:43:52.828175 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:43:52.828175 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:43:52.828175 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:43:52.828175 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:43:52.828175 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:43:52.828175 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:43:52.828175 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:43:52.828175 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:43:52.828175 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:43:52.828175 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:43:52.828175 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:43:52.828175 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:43:52.828175 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:43:52.829148 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:43:52.829148 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:43:52.829148 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:43:52.829148 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:43:52.829148 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:43:52.829148 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:43:52.829148 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:43:52.829148 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:43:52.829148 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:43:52.829148 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:43:52.829148 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:43:52.829148 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:43:52.829148 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:43:52.829148 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:43:52.829148 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:43:52.829148 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:43:52.829148 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:43:52.829975 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:43:52.829975 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:43:52.829975 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:43:52.833948 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 250/490] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:43:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:43:52.834777 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717f951a-a44b-4cd6-a569-df860b25f0f6 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:52.858568 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ff9fb1-7924-4f7c-aa64-a0617312726a None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:52.865297 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:52.878953 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:52.914334 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1746ab99-75cd-48e4-9163-db92b3fdb968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:52.915226 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1746ab99-75cd-48e4-9163-db92b3fdb968 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:52.915695 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1746ab99-75cd-48e4-9163-db92b3fdb968 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:52.916431 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1746ab99-75cd-48e4-9163-db92b3fdb968 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:52.930979 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1746ab99-75cd-48e4-9163-db92b3fdb968 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:43:52.939001 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-1746ab99-75cd-48e4-9163-db92b3fdb968 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:43:52.939001 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:52.939001 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:43:52.939001 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:43:52.939001 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:43:52.939001 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:43:52.939001 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:43:52.939001 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:43:52.939001 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:43:52.939001 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:43:52.939001 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:43:52.939001 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:43:52.939001 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:43:52.939001 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:43:52.939001 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:43:52.939001 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:43:52.939865 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:43:52.939865 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:43:52.939865 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:43:52.939865 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:43:52.939865 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:43:52.939865 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:43:52.939865 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:43:52.939865 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:43:52.939865 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:43:52.939865 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:43:52.939865 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:43:52.939865 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:43:52.939865 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:43:52.939865 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:43:52.939865 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:43:52.939865 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:43:52.940675 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:43:52.940675 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:43:52.940675 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:43:52.940675 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:43:52.940675 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:43:52.940675 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:43:52.940675 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:43:52.940675 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:43:52.940675 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:43:52.940675 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:43:52.940675 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:43:52.940675 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:43:52.943809 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 241/491] 10.222.0.72 () {56 vars in 1102 bytes} [Mon Sep 19 14:43:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:43:52.945122 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1746ab99-75cd-48e4-9163-db92b3fdb968 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:52.950419 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717f951a-a44b-4cd6-a569-df860b25f0f6 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:52.989581 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43206cae-0e5e-4125-b009-c46c4d8d3ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:52.990276 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43206cae-0e5e-4125-b009-c46c4d8d3ade None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:52.990622 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43206cae-0e5e-4125-b009-c46c4d8d3ade None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:52.990961 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43206cae-0e5e-4125-b009-c46c4d8d3ade None admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:52.991689 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43206cae-0e5e-4125-b009-c46c4d8d3ade None admin] RBAC: Adding query filter params (name=service) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:52.992056 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43206cae-0e5e-4125-b009-c46c4d8d3ade None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:52.993671 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43206cae-0e5e-4125-b009-c46c4d8d3ade None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:53.007624 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 251/492] 10.222.0.72 () {56 vars in 1103 bytes} [Mon Sep 19 14:43:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:53.008785 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43206cae-0e5e-4125-b009-c46c4d8d3ade None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:53.062791 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1746ab99-75cd-48e4-9163-db92b3fdb968 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:53.100395 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f136fc6-7ca2-4399-aff6-028aef9f36f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:53.101345 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f136fc6-7ca2-4399-aff6-028aef9f36f9 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:53.101773 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f136fc6-7ca2-4399-aff6-028aef9f36f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:53.102219 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f136fc6-7ca2-4399-aff6-028aef9f36f9 None admin] PATH_INFO: `/v3/domains` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:53.103113 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f136fc6-7ca2-4399-aff6-028aef9f36f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:53.103561 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f136fc6-7ca2-4399-aff6-028aef9f36f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:53.105104 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f136fc6-7ca2-4399-aff6-028aef9f36f9 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:53.115692 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:53.120698 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 242/493] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Sep 19 14:43:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:53.122036 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f136fc6-7ca2-4399-aff6-028aef9f36f9 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:53.131978 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43206cae-0e5e-4125-b009-c46c4d8d3ade None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:53.162810 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:53.172494 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d23045-e532-40ce-b70a-9b843acc0956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:53.173100 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d23045-e532-40ce-b70a-9b843acc0956 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:53.173383 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d23045-e532-40ce-b70a-9b843acc0956 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:53.173648 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d23045-e532-40ce-b70a-9b843acc0956 None admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:53.174306 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d23045-e532-40ce-b70a-9b843acc0956 None admin] RBAC: Adding query filter params (name=service) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:53.174604 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d23045-e532-40ce-b70a-9b843acc0956 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:53.175955 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d23045-e532-40ce-b70a-9b843acc0956 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:53.188743 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 252/494] 10.222.0.72 () {56 vars in 1103 bytes} [Mon Sep 19 14:43:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:53.188743 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d23045-e532-40ce-b70a-9b843acc0956 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:53.241329 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f136fc6-7ca2-4399-aff6-028aef9f36f9 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:53.275835 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8220885-212a-4366-b074-24b53df7bdbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:53.276493 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8220885-212a-4366-b074-24b53df7bdbb None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:53.276771 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8220885-212a-4366-b074-24b53df7bdbb None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:53.277166 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8220885-212a-4366-b074-24b53df7bdbb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:53.287485 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8220885-212a-4366-b074-24b53df7bdbb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:53.288941 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8220885-212a-4366-b074-24b53df7bdbb None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:53.300578 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d23045-e532-40ce-b70a-9b843acc0956 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:53.303391 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-a8220885-212a-4366-b074-24b53df7bdbb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:43:53.303391 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:53.303391 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:43:53.303391 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:43:53.303391 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:43:53.303391 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:43:53.303391 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:43:53.303391 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:43:53.303391 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:43:53.303391 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:43:53.303391 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:43:53.303391 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:43:53.303391 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:43:53.303391 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:43:53.303391 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:43:53.303391 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:43:53.304238 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:43:53.304238 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:43:53.304238 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:43:53.304238 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:43:53.304238 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:43:53.304238 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:43:53.304238 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:43:53.304238 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:43:53.304238 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:43:53.304238 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:43:53.304238 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:43:53.304238 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:43:53.304238 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:43:53.304238 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:43:53.304238 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:43:53.304238 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:43:53.304238 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:43:53.305134 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:43:53.305134 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:43:53.305134 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:43:53.305134 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 243/495] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:43:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:43:53.310866 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d818f7-c782-416a-9be4-f07694a9feec None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:53.310866 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d818f7-c782-416a-9be4-f07694a9feec None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:53.310866 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d818f7-c782-416a-9be4-f07694a9feec None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:53.310866 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 244/496] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:43:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:43:53.310866 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d818f7-c782-416a-9be4-f07694a9feec None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:53.336248 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5e4bfc-3111-4621-859e-4af50a46c9c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:53.336831 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e4bfc-3111-4621-859e-4af50a46c9c7 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:53.337117 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e4bfc-3111-4621-859e-4af50a46c9c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:53.337386 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e4bfc-3111-4621-859e-4af50a46c9c7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:53.345636 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5e4bfc-3111-4621-859e-4af50a46c9c7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:53.347180 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5e4bfc-3111-4621-859e-4af50a46c9c7 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:53.359793 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-7c5e4bfc-3111-4621-859e-4af50a46c9c7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 19 14:43:53.359793 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:53.359793 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:43:53.359793 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:43:53.359793 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:43:53.359793 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:43:53.359793 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:43:53.359793 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:43:53.359793 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:43:53.359793 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:43:53.359793 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:43:53.359793 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:43:53.359793 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 14:43:53.359793 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 14:43:53.359793 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 14:43:53.359793 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 14:43:53.360703 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:43:53.360703 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:43:53.360703 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:43:53.360703 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:43:53.360703 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:43:53.360703 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:43:53.360703 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:43:53.360703 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:43:53.360703 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:43:53.360703 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:43:53.360703 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:43:53.360703 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:43:53.360703 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:43:53.360703 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:43:53.360703 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:43:53.360703 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:43:53.360703 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:43:53.360703 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:43:53.361587 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:43:53.361587 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:43:53.361587 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 14:43:53.361587 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 14:43:53.361587 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 14:43:53.361587 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 14:43:53.361587 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 14:43:53.361587 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 14:43:53.361587 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 19 14:43:53.361587 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:43:53.361587 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 253/497] 10.222.0.72 () {56 vars in 1093 bytes} [Mon Sep 19 14:43:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:43:53.362351 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e80b79-8eb5-4c93-b3eb-9ab72d311a08 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:53.362351 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e80b79-8eb5-4c93-b3eb-9ab72d311a08 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:53.362516 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e80b79-8eb5-4c93-b3eb-9ab72d311a08 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:53.363709 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 254/498] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:43:53 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:43:53.364499 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e80b79-8eb5-4c93-b3eb-9ab72d311a08 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:53.380984 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:53.403554 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:53.420931 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d818f7-c782-416a-9be4-f07694a9feec None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:53.454943 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc70ccc9-534d-4d7a-b7bf-7098cc097336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:53.455557 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc70ccc9-534d-4d7a-b7bf-7098cc097336 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:53.455831 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc70ccc9-534d-4d7a-b7bf-7098cc097336 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:53.456098 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc70ccc9-534d-4d7a-b7bf-7098cc097336 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:53.466383 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc70ccc9-534d-4d7a-b7bf-7098cc097336 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:53.467802 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc70ccc9-534d-4d7a-b7bf-7098cc097336 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:53.469935 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e80b79-8eb5-4c93-b3eb-9ab72d311a08 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:53.481988 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-dc70ccc9-534d-4d7a-b7bf-7098cc097336 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:43:53.481988 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:53.481988 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:43:53.481988 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:43:53.481988 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:43:53.481988 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:43:53.481988 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:43:53.481988 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:43:53.481988 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:43:53.481988 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:43:53.481988 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:43:53.481988 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:43:53.481988 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:43:53.481988 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:43:53.481988 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:43:53.481988 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:43:53.482897 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:43:53.482897 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:43:53.482897 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:43:53.482897 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:43:53.482897 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:43:53.482897 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:43:53.482897 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:43:53.482897 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:43:53.482897 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:43:53.482897 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:43:53.482897 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:43:53.482897 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:43:53.482897 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:43:53.482897 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:43:53.482897 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:43:53.482897 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:43:53.482897 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:43:53.483713 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:43:53.483713 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:43:53.483713 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:43:53.483713 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 245/499] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:43:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:43:53.484294 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc0c937-04fd-4a86-9601-08ace72c040d None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:53.484598 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc0c937-04fd-4a86-9601-08ace72c040d None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:53.484894 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc0c937-04fd-4a86-9601-08ace72c040d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:53.502603 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-dcc0c937-04fd-4a86-9601-08ace72c040d None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:43:53.503770 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-dcc0c937-04fd-4a86-9601-08ace72c040d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:43:53.508251 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3074eeaa-e164-4e21-9cc6-a3309ddb63ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:53.508866 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3074eeaa-e164-4e21-9cc6-a3309ddb63ec None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:53.509142 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3074eeaa-e164-4e21-9cc6-a3309ddb63ec None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:53.509407 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3074eeaa-e164-4e21-9cc6-a3309ddb63ec None admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:53.510030 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3074eeaa-e164-4e21-9cc6-a3309ddb63ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:53.510327 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3074eeaa-e164-4e21-9cc6-a3309ddb63ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:53.512524 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3074eeaa-e164-4e21-9cc6-a3309ddb63ec None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:53.523910 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 255/500] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Sep 19 14:43:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:53.524723 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3074eeaa-e164-4e21-9cc6-a3309ddb63ec None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:53.573321 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 246/501] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:43:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:43:53.575262 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9847c668-4d38-45b1-a05d-248f00a399b3 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:53.575550 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9847c668-4d38-45b1-a05d-248f00a399b3 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:53.575827 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9847c668-4d38-45b1-a05d-248f00a399b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:53.596468 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:53.599038 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-9847c668-4d38-45b1-a05d-248f00a399b3 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:43:53.601053 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-9847c668-4d38-45b1-a05d-248f00a399b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:43:53.629921 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3074eeaa-e164-4e21-9cc6-a3309ddb63ec None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:53.668158 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226d2196-d14a-4839-a7b7-31800a310cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:53.669108 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226d2196-d14a-4839-a7b7-31800a310cd9 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:53.669521 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226d2196-d14a-4839-a7b7-31800a310cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:53.669938 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226d2196-d14a-4839-a7b7-31800a310cd9 None admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:53.670788 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226d2196-d14a-4839-a7b7-31800a310cd9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:53.670929 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:53.671332 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226d2196-d14a-4839-a7b7-31800a310cd9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:53.672851 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226d2196-d14a-4839-a7b7-31800a310cd9 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:53.677313 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 247/502] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:43:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:43:53.678327 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9847c668-4d38-45b1-a05d-248f00a399b3 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:53.716603 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 256/503] 10.222.0.72 () {56 vars in 1133 bytes} [Mon Sep 19 14:43:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:53.717811 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226d2196-d14a-4839-a7b7-31800a310cd9 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:53.786367 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9847c668-4d38-45b1-a05d-248f00a399b3 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:53.828533 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c665f1-1249-44fd-b1bd-5675f55eaf97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:53.829139 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c665f1-1249-44fd-b1bd-5675f55eaf97 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:53.829414 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c665f1-1249-44fd-b1bd-5675f55eaf97 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:53.829682 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c665f1-1249-44fd-b1bd-5675f55eaf97 None admin] PATH_INFO: `/v3/domains` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:53.830487 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c665f1-1249-44fd-b1bd-5675f55eaf97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:53.830832 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c665f1-1249-44fd-b1bd-5675f55eaf97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:53.832821 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c665f1-1249-44fd-b1bd-5675f55eaf97 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:53.834579 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226d2196-d14a-4839-a7b7-31800a310cd9 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:53.844145 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 248/504] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Sep 19 14:43:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:53.845121 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c665f1-1249-44fd-b1bd-5675f55eaf97 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:53.866787 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:53.874208 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eb717b-74ea-4579-8ebe-d0aa23b0b400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:53.874835 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eb717b-74ea-4579-8ebe-d0aa23b0b400 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:53.875115 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eb717b-74ea-4579-8ebe-d0aa23b0b400 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:53.875388 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eb717b-74ea-4579-8ebe-d0aa23b0b400 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:53.882828 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eb717b-74ea-4579-8ebe-d0aa23b0b400 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:53.885095 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eb717b-74ea-4579-8ebe-d0aa23b0b400 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:53.898435 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-d0eb717b-74ea-4579-8ebe-d0aa23b0b400 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 19 14:43:53.898435 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:53.898435 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:43:53.898435 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:43:53.898435 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:43:53.898435 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:43:53.898435 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:43:53.898435 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:43:53.898435 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:43:53.898435 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:43:53.898435 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:43:53.898435 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:43:53.898435 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 14:43:53.898435 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 14:43:53.898435 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 14:43:53.898435 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 14:43:53.899334 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:43:53.899334 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:43:53.899334 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:43:53.899334 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:43:53.899334 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:43:53.899334 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:43:53.899334 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:43:53.899334 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:43:53.899334 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:43:53.899334 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:43:53.899334 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:43:53.899334 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:43:53.899334 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:43:53.899334 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:43:53.899334 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:43:53.899334 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:43:53.899334 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:43:53.899334 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:43:53.900217 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:43:53.900217 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:43:53.900217 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 14:43:53.900217 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 14:43:53.900217 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 14:43:53.900217 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 14:43:53.900217 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 14:43:53.900217 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 14:43:53.900217 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 19 14:43:53.900217 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:43:53.900217 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 257/505] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Sep 19 14:43:53 2022] GET /identity/v3/users/glance => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:43:53.900803 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eb717b-74ea-4579-8ebe-d0aa23b0b400 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:53.916285 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:53.965483 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c665f1-1249-44fd-b1bd-5675f55eaf97 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:54.000285 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7faa51-40e7-494e-af32-ecc6fa9b0244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:54.000915 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7faa51-40e7-494e-af32-ecc6fa9b0244 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:54.001195 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7faa51-40e7-494e-af32-ecc6fa9b0244 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:54.001467 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7faa51-40e7-494e-af32-ecc6fa9b0244 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:54.012347 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eb717b-74ea-4579-8ebe-d0aa23b0b400 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:54.045790 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195b8a36-c39b-4c1a-b915-d6240d14e59b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:54.046407 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195b8a36-c39b-4c1a-b915-d6240d14e59b None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:54.046682 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195b8a36-c39b-4c1a-b915-d6240d14e59b None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:54.046949 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195b8a36-c39b-4c1a-b915-d6240d14e59b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:54.056226 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195b8a36-c39b-4c1a-b915-d6240d14e59b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:54.057949 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195b8a36-c39b-4c1a-b915-d6240d14e59b None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:54.067498 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7faa51-40e7-494e-af32-ecc6fa9b0244 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:54.068986 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7faa51-40e7-494e-af32-ecc6fa9b0244 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:54.069577 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-195b8a36-c39b-4c1a-b915-d6240d14e59b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 19 14:43:54.069577 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:54.069577 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:43:54.069577 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:43:54.069577 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:43:54.069577 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:43:54.069577 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:43:54.069577 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:43:54.069577 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:43:54.069577 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:43:54.069577 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:43:54.069577 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:43:54.069577 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 14:43:54.069577 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 14:43:54.069577 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 14:43:54.069577 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 14:43:54.070625 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:43:54.070625 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:43:54.070625 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:43:54.070625 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:43:54.070625 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:43:54.070625 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:43:54.070625 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:43:54.070625 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:43:54.070625 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:43:54.070625 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:43:54.070625 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:43:54.070625 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:43:54.070625 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:43:54.070625 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:43:54.070625 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:43:54.070625 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:43:54.070625 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:43:54.070625 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:43:54.071527 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:43:54.071527 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:43:54.071527 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 14:43:54.071527 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 14:43:54.071527 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 14:43:54.071527 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 14:43:54.071527 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 14:43:54.071527 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 14:43:54.071527 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 19 14:43:54.071527 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:43:54.071527 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 258/506] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Sep 19 14:43:53 2022] GET /identity/v3/users/cinder => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:43:54.072074 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195b8a36-c39b-4c1a-b915-d6240d14e59b None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:54.121637 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:54.126984 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:54.169976 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 249/507] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Sep 19 14:43:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 14:43:54.170821 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7faa51-40e7-494e-af32-ecc6fa9b0244 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:54.172310 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195b8a36-c39b-4c1a-b915-d6240d14e59b None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:54.208213 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7befaaf3-af68-4b42-bae8-f4d07e62795e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:54.208854 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7befaaf3-af68-4b42-bae8-f4d07e62795e None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:54.209129 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7befaaf3-af68-4b42-bae8-f4d07e62795e None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:54.209396 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7befaaf3-af68-4b42-bae8-f4d07e62795e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:54.220467 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7befaaf3-af68-4b42-bae8-f4d07e62795e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:43:54.225641 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-7befaaf3-af68-4b42-bae8-f4d07e62795e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:43:54.225641 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:54.225641 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:43:54.225641 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:43:54.225641 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:43:54.225641 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:43:54.225641 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:43:54.225641 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:43:54.225641 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:43:54.225641 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:43:54.225641 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:43:54.225641 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:43:54.225641 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:43:54.225641 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:43:54.225641 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:43:54.225641 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:43:54.226681 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:43:54.226681 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:43:54.226681 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:43:54.226681 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:43:54.226681 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:43:54.226681 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:43:54.226681 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:43:54.226681 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:43:54.226681 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:43:54.226681 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:43:54.226681 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:43:54.226681 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:43:54.226681 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:43:54.226681 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:43:54.226681 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:43:54.226681 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:43:54.233084 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:43:54.233084 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:43:54.233084 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:43:54.233084 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:43:54.233084 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:43:54.233084 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:43:54.233084 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:43:54.233084 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:43:54.233084 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:43:54.233084 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:43:54.233084 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:43:54.233084 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:43:54.233084 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 259/508] 10.222.0.72 () {56 vars in 1102 bytes} [Mon Sep 19 14:43:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:43:54.233084 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7befaaf3-af68-4b42-bae8-f4d07e62795e None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:54.274194 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7faa51-40e7-494e-af32-ecc6fa9b0244 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:54.309513 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2155ea62-fc5e-42d5-b565-4379f61bfe6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:54.310108 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2155ea62-fc5e-42d5-b565-4379f61bfe6e None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:54.310384 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2155ea62-fc5e-42d5-b565-4379f61bfe6e None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:54.310651 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2155ea62-fc5e-42d5-b565-4379f61bfe6e None admin] PATH_INFO: `/v3/users` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:54.311360 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2155ea62-fc5e-42d5-b565-4379f61bfe6e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:54.311657 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2155ea62-fc5e-42d5-b565-4379f61bfe6e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:54.313092 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2155ea62-fc5e-42d5-b565-4379f61bfe6e None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:54.327021 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7befaaf3-af68-4b42-bae8-f4d07e62795e None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:54.337127 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:54.348931 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 250/509] 10.222.0.72 () {56 vars in 1137 bytes} [Mon Sep 19 14:43:54 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:54.349841 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2155ea62-fc5e-42d5-b565-4379f61bfe6e None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:54.362132 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df1088f-b1bb-4d32-844b-5abd2d326d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:54.362755 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df1088f-b1bb-4d32-844b-5abd2d326d7e None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:54.363035 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df1088f-b1bb-4d32-844b-5abd2d326d7e None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:54.363306 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df1088f-b1bb-4d32-844b-5abd2d326d7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:54.368461 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:54.374900 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df1088f-b1bb-4d32-844b-5abd2d326d7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:54.376289 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df1088f-b1bb-4d32-844b-5abd2d326d7e None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:54.390670 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-7df1088f-b1bb-4d32-844b-5abd2d326d7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:43:54.390670 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:54.390670 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:43:54.390670 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:43:54.390670 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:43:54.390670 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:43:54.390670 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:43:54.390670 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:43:54.390670 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:43:54.390670 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:43:54.390670 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:43:54.390670 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:43:54.390670 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:43:54.390670 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:43:54.390670 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:43:54.390670 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:43:54.391734 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:43:54.391734 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:43:54.391734 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:43:54.391734 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:43:54.391734 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:43:54.391734 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:43:54.391734 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:43:54.391734 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:43:54.391734 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:43:54.391734 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:43:54.391734 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:43:54.391734 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:43:54.391734 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:43:54.391734 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:43:54.391734 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:43:54.391734 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:43:54.391734 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:43:54.392821 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:43:54.392821 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:43:54.392821 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:43:54.392821 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 260/510] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:43:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:43:54.392821 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df1088f-b1bb-4d32-844b-5abd2d326d7e None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:54.452784 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2155ea62-fc5e-42d5-b565-4379f61bfe6e None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:54.486437 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee995dd7-f233-4cc6-87cb-ddd5a49e7023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:54.487038 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee995dd7-f233-4cc6-87cb-ddd5a49e7023 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:54.487318 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee995dd7-f233-4cc6-87cb-ddd5a49e7023 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:54.487591 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee995dd7-f233-4cc6-87cb-ddd5a49e7023 None admin] PATH_INFO: `/v3/users` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:54.488305 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee995dd7-f233-4cc6-87cb-ddd5a49e7023 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:54.488633 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee995dd7-f233-4cc6-87cb-ddd5a49e7023 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:54.490053 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df1088f-b1bb-4d32-844b-5abd2d326d7e None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:54.490156 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee995dd7-f233-4cc6-87cb-ddd5a49e7023 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:54.506841 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 251/511] 10.222.0.72 () {56 vars in 1137 bytes} [Mon Sep 19 14:43:54 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:54.507630 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee995dd7-f233-4cc6-87cb-ddd5a49e7023 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:54.523661 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fc3f7c-fe7f-4b2a-a2da-b154dbfac84f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:54.524275 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fc3f7c-fe7f-4b2a-a2da-b154dbfac84f None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:54.524580 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fc3f7c-fe7f-4b2a-a2da-b154dbfac84f None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:54.524845 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fc3f7c-fe7f-4b2a-a2da-b154dbfac84f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:54.535548 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fc3f7c-fe7f-4b2a-a2da-b154dbfac84f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:54.537019 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fc3f7c-fe7f-4b2a-a2da-b154dbfac84f None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:54.551483 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-54fc3f7c-fe7f-4b2a-a2da-b154dbfac84f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:43:54.551483 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:54.551483 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:43:54.551483 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:43:54.551483 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:43:54.551483 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:43:54.551483 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:43:54.551483 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:43:54.551483 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:43:54.551483 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:43:54.551483 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:43:54.551483 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:43:54.551483 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:43:54.551483 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:43:54.551483 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:43:54.551483 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:43:54.552402 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:43:54.552402 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:43:54.552402 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:43:54.552402 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:43:54.552402 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:43:54.552402 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:43:54.552402 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:43:54.552402 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:43:54.552402 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:43:54.552402 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:43:54.552402 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:43:54.552402 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:43:54.552402 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:43:54.552402 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:43:54.552402 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:43:54.552402 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:43:54.552402 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:43:54.553252 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:43:54.553252 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:43:54.553252 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:43:54.553252 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 261/512] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:43:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:43:54.553466 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fc3f7c-fe7f-4b2a-a2da-b154dbfac84f None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:54.569185 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:54.583415 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:54.608713 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee995dd7-f233-4cc6-87cb-ddd5a49e7023 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:54.642316 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788814e9-0bc3-488a-99b4-7f490bf985c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:54.642846 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788814e9-0bc3-488a-99b4-7f490bf985c9 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:54.643127 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788814e9-0bc3-488a-99b4-7f490bf985c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:54.643401 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788814e9-0bc3-488a-99b4-7f490bf985c9 None admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:54.644060 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788814e9-0bc3-488a-99b4-7f490bf985c9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:54.644400 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788814e9-0bc3-488a-99b4-7f490bf985c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:54.645772 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788814e9-0bc3-488a-99b4-7f490bf985c9 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:54.653392 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fc3f7c-fe7f-4b2a-a2da-b154dbfac84f None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:54.654344 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 252/513] 10.222.0.72 () {56 vars in 1103 bytes} [Mon Sep 19 14:43:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:54.655137 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788814e9-0bc3-488a-99b4-7f490bf985c9 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:54.687603 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40fce12-ed3a-4e97-ad59-8a811f010701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:54.688198 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40fce12-ed3a-4e97-ad59-8a811f010701 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:54.688526 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40fce12-ed3a-4e97-ad59-8a811f010701 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:54.688867 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40fce12-ed3a-4e97-ad59-8a811f010701 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:54.753852 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788814e9-0bc3-488a-99b4-7f490bf985c9 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:54.757181 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40fce12-ed3a-4e97-ad59-8a811f010701 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:54.758652 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40fce12-ed3a-4e97-ad59-8a811f010701 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:54.773827 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:54.789727 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b509f4a-9969-4158-8cab-124ef7ec3a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:54.790329 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b509f4a-9969-4158-8cab-124ef7ec3a42 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:54.790607 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b509f4a-9969-4158-8cab-124ef7ec3a42 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:54.790877 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b509f4a-9969-4158-8cab-124ef7ec3a42 None admin] PATH_INFO: `/v3/domains` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:54.791505 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b509f4a-9969-4158-8cab-124ef7ec3a42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:54.791805 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b509f4a-9969-4158-8cab-124ef7ec3a42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:54.793471 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b509f4a-9969-4158-8cab-124ef7ec3a42 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:54.795699 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:54.805492 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 253/514] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Sep 19 14:43:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:54.806282 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b509f4a-9969-4158-8cab-124ef7ec3a42 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:54.858862 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 262/515] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Sep 19 14:43:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 14:43:54.859704 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40fce12-ed3a-4e97-ad59-8a811f010701 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:54.913918 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b509f4a-9969-4158-8cab-124ef7ec3a42 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:54.947399 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38d4a86-25b5-45c6-a9da-ca3e9cd60cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:54.947997 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d4a86-25b5-45c6-a9da-ca3e9cd60cb7 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:54.948272 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d4a86-25b5-45c6-a9da-ca3e9cd60cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:54.948568 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d4a86-25b5-45c6-a9da-ca3e9cd60cb7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:54.963646 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40fce12-ed3a-4e97-ad59-8a811f010701 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:54.977759 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:54.998114 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9997687e-aebc-455f-aff1-c9130a75dce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:54.998715 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9997687e-aebc-455f-aff1-c9130a75dce1 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:54.998993 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9997687e-aebc-455f-aff1-c9130a75dce1 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:54.999261 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9997687e-aebc-455f-aff1-c9130a75dce1 None admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:54.999892 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9997687e-aebc-455f-aff1-c9130a75dce1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:55.000192 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9997687e-aebc-455f-aff1-c9130a75dce1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:55.001593 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9997687e-aebc-455f-aff1-c9130a75dce1 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:55.010151 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:55.013170 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 263/516] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Sep 19 14:43:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:55.013906 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9997687e-aebc-455f-aff1-c9130a75dce1 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:55.017962 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38d4a86-25b5-45c6-a9da-ca3e9cd60cb7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:55.019409 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38d4a86-25b5-45c6-a9da-ca3e9cd60cb7 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:55.115538 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9997687e-aebc-455f-aff1-c9130a75dce1 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:55.116504 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 254/517] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Sep 19 14:43:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 14:43:55.117316 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38d4a86-25b5-45c6-a9da-ca3e9cd60cb7 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:55.149711 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23e4129-db1d-4165-8cd6-1742eeddb483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:55.150334 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e4129-db1d-4165-8cd6-1742eeddb483 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:55.150614 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e4129-db1d-4165-8cd6-1742eeddb483 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:55.150886 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e4129-db1d-4165-8cd6-1742eeddb483 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:55.162040 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23e4129-db1d-4165-8cd6-1742eeddb483 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:55.163431 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23e4129-db1d-4165-8cd6-1742eeddb483 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:55.177976 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-e23e4129-db1d-4165-8cd6-1742eeddb483 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:43:55.177976 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:55.177976 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:43:55.177976 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:43:55.177976 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:43:55.177976 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:43:55.177976 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:43:55.177976 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:43:55.177976 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:43:55.177976 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:43:55.177976 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:43:55.177976 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:43:55.177976 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:43:55.177976 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:43:55.177976 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:43:55.177976 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:43:55.179010 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:43:55.179010 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:43:55.179010 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:43:55.179010 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:43:55.179010 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:43:55.179010 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:43:55.179010 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:43:55.179010 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:43:55.179010 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:43:55.179010 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:43:55.179010 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:43:55.179010 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:43:55.179010 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:43:55.179010 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:43:55.179010 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:43:55.179010 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:43:55.179010 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:43:55.180054 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:43:55.180054 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:43:55.180054 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:43:55.180462 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 264/518] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:43:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:43:55.181395 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23e4129-db1d-4165-8cd6-1742eeddb483 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:55.208410 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:55.213546 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:55.220663 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38d4a86-25b5-45c6-a9da-ca3e9cd60cb7 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:55.254289 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e8169a-dee9-4ce1-9830-513a47eaba78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:55.254878 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e8169a-dee9-4ce1-9830-513a47eaba78 None admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:55.255153 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e8169a-dee9-4ce1-9830-513a47eaba78 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:55.255421 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e8169a-dee9-4ce1-9830-513a47eaba78 None admin] PATH_INFO: `/v3/users` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:55.256103 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e8169a-dee9-4ce1-9830-513a47eaba78 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:55.257563 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e8169a-dee9-4ce1-9830-513a47eaba78 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:55.279182 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 255/519] 10.222.0.72 () {60 vars in 1132 bytes} [Mon Sep 19 14:43:55 2022] POST /identity/v3/users => generated 247 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:43:55.280079 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e8169a-dee9-4ce1-9830-513a47eaba78 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:55.283373 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23e4129-db1d-4165-8cd6-1742eeddb483 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:55.322362 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ffd3bb-f244-44e8-b9e9-924ecc97ffd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:55.323188 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ffd3bb-f244-44e8-b9e9-924ecc97ffd6 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:55.323565 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ffd3bb-f244-44e8-b9e9-924ecc97ffd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:55.324473 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ffd3bb-f244-44e8-b9e9-924ecc97ffd6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:55.337716 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ffd3bb-f244-44e8-b9e9-924ecc97ffd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:55.339233 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ffd3bb-f244-44e8-b9e9-924ecc97ffd6 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:55.355477 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-f0ffd3bb-f244-44e8-b9e9-924ecc97ffd6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:43:55.355477 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:55.355477 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:43:55.355477 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:43:55.355477 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:43:55.355477 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:43:55.355477 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:43:55.355477 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:43:55.355477 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:43:55.355477 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:43:55.355477 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:43:55.355477 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:43:55.355477 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:43:55.355477 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:43:55.355477 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:43:55.355477 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:43:55.356512 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:43:55.356512 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:43:55.356512 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:43:55.356512 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:43:55.356512 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:43:55.356512 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:43:55.356512 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:43:55.356512 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:43:55.356512 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:43:55.356512 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:43:55.356512 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:43:55.356512 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:43:55.356512 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:43:55.356512 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:43:55.356512 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:43:55.356512 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:43:55.356512 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:43:55.357370 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:43:55.357370 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:43:55.357370 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:43:55.357370 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 265/520] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:43:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:43:55.358270 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ffd3bb-f244-44e8-b9e9-924ecc97ffd6 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:55.428169 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e8169a-dee9-4ce1-9830-513a47eaba78 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:55.460100 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:55.470371 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42253682-e069-47d0-8b3f-d4b97a2ad9fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:55.470692 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42253682-e069-47d0-8b3f-d4b97a2ad9fa None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:55.470975 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42253682-e069-47d0-8b3f-d4b97a2ad9fa None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:55.471931 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42253682-e069-47d0-8b3f-d4b97a2ad9fa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:55.479063 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42253682-e069-47d0-8b3f-d4b97a2ad9fa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:55.480604 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42253682-e069-47d0-8b3f-d4b97a2ad9fa None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:55.485795 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ffd3bb-f244-44e8-b9e9-924ecc97ffd6 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:55.506121 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-42253682-e069-47d0-8b3f-d4b97a2ad9fa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:43:55.506121 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:55.506121 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:43:55.506121 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:43:55.506121 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:43:55.506121 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:43:55.506121 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:43:55.506121 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:43:55.506121 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:43:55.506121 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:43:55.506121 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:43:55.506121 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:43:55.506121 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 14:43:55.506121 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 14:43:55.506121 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 14:43:55.507005 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 14:43:55.507005 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:43:55.507005 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:43:55.507005 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:43:55.507005 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:43:55.507005 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:43:55.507005 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:43:55.507005 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:43:55.507005 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:43:55.507005 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:43:55.507005 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:43:55.507005 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:43:55.507005 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:43:55.507005 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:43:55.507005 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:43:55.507005 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:43:55.507005 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:43:55.508314 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 14:43:55.508314 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 14:43:55.508314 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:43:55.508314 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:43:55.508314 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:43:55.508314 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:43:55.508314 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:43:55.508314 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:43:55.508314 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 256/521] 10.222.0.72 () {56 vars in 1111 bytes} [Mon Sep 19 14:43:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:43:55.508314 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42253682-e069-47d0-8b3f-d4b97a2ad9fa None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:55.525435 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:55.531848 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04404325-2bc5-4ffd-a11c-39d0fe43b4f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:55.532442 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04404325-2bc5-4ffd-a11c-39d0fe43b4f9 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:55.532720 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04404325-2bc5-4ffd-a11c-39d0fe43b4f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:55.532999 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04404325-2bc5-4ffd-a11c-39d0fe43b4f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:55.543986 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04404325-2bc5-4ffd-a11c-39d0fe43b4f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:55.545465 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04404325-2bc5-4ffd-a11c-39d0fe43b4f9 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:55.560501 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-04404325-2bc5-4ffd-a11c-39d0fe43b4f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:43:55.560501 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:55.560501 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:43:55.560501 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:43:55.560501 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:43:55.560501 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:43:55.560501 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:43:55.560501 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:43:55.560501 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:43:55.560501 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:43:55.560501 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:43:55.560501 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:43:55.560501 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:43:55.560501 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:43:55.560501 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:43:55.560501 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:43:55.561605 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:43:55.561605 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:43:55.561605 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:43:55.561605 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:43:55.561605 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:43:55.561605 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:43:55.561605 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:43:55.561605 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:43:55.561605 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:43:55.561605 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:43:55.561605 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:43:55.561605 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:43:55.561605 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:43:55.561605 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:43:55.561605 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:43:55.561605 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:43:55.561605 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:43:55.562689 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:43:55.562689 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:43:55.562689 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:43:55.566251 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 266/522] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:43:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:43:55.566981 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04404325-2bc5-4ffd-a11c-39d0fe43b4f9 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:55.627194 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42253682-e069-47d0-8b3f-d4b97a2ad9fa None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:55.664592 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2975455a-2a4d-4a72-b4e6-949485e1da97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:55.665194 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2975455a-2a4d-4a72-b4e6-949485e1da97 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:55.665472 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2975455a-2a4d-4a72-b4e6-949485e1da97 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:55.665740 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2975455a-2a4d-4a72-b4e6-949485e1da97 None admin] PATH_INFO: `/v3/domains` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:55.666477 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2975455a-2a4d-4a72-b4e6-949485e1da97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:55.666778 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2975455a-2a4d-4a72-b4e6-949485e1da97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:55.668883 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2975455a-2a4d-4a72-b4e6-949485e1da97 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:55.673987 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04404325-2bc5-4ffd-a11c-39d0fe43b4f9 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:55.686890 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 257/523] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Sep 19 14:43:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:55.686890 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2975455a-2a4d-4a72-b4e6-949485e1da97 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:55.706998 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:55.713313 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b280092-ae89-4210-9f82-4d9591ee66be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:55.713916 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b280092-ae89-4210-9f82-4d9591ee66be None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:55.714198 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b280092-ae89-4210-9f82-4d9591ee66be None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:55.714475 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b280092-ae89-4210-9f82-4d9591ee66be None admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:55.715779 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b280092-ae89-4210-9f82-4d9591ee66be None admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:55.716074 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b280092-ae89-4210-9f82-4d9591ee66be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:55.717489 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b280092-ae89-4210-9f82-4d9591ee66be None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:55.735433 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 267/524] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Sep 19 14:43:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:55.735433 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b280092-ae89-4210-9f82-4d9591ee66be None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:55.769319 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:55.810824 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2975455a-2a4d-4a72-b4e6-949485e1da97 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:55.854846 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaa1fec-6fe9-4916-9fa7-32f9fbcf4f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:55.855992 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa1fec-6fe9-4916-9fa7-32f9fbcf4f3c None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:55.856268 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa1fec-6fe9-4916-9fa7-32f9fbcf4f3c None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:55.856646 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa1fec-6fe9-4916-9fa7-32f9fbcf4f3c None admin] PATH_INFO: `/v3/projects` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:55.857344 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaa1fec-6fe9-4916-9fa7-32f9fbcf4f3c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:55.857656 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaa1fec-6fe9-4916-9fa7-32f9fbcf4f3c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:55.859117 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaa1fec-6fe9-4916-9fa7-32f9fbcf4f3c None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:55.872861 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b280092-ae89-4210-9f82-4d9591ee66be None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:55.883221 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 258/525] 10.222.0.72 () {56 vars in 1148 bytes} [Mon Sep 19 14:43:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:55.884606 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaa1fec-6fe9-4916-9fa7-32f9fbcf4f3c None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:55.921653 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70e4dbd-05df-4e44-a7ec-a28066d4adad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:55.922537 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e4dbd-05df-4e44-a7ec-a28066d4adad None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:55.923218 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e4dbd-05df-4e44-a7ec-a28066d4adad None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:55.923494 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e4dbd-05df-4e44-a7ec-a28066d4adad None admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:55.924432 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70e4dbd-05df-4e44-a7ec-a28066d4adad None admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:55.924769 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70e4dbd-05df-4e44-a7ec-a28066d4adad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:55.927036 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70e4dbd-05df-4e44-a7ec-a28066d4adad None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:55.943051 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 268/526] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Sep 19 14:43:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:55.943829 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70e4dbd-05df-4e44-a7ec-a28066d4adad None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:56.008633 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:56.020775 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaa1fec-6fe9-4916-9fa7-32f9fbcf4f3c None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:56.066437 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:56.071891 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70e4dbd-05df-4e44-a7ec-a28066d4adad None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:56.072514 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91ce9eb-8faf-409d-911b-d4cf1965eec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:56.073159 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91ce9eb-8faf-409d-911b-d4cf1965eec8 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:56.073440 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91ce9eb-8faf-409d-911b-d4cf1965eec8 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:56.073714 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91ce9eb-8faf-409d-911b-d4cf1965eec8 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:56.084715 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91ce9eb-8faf-409d-911b-d4cf1965eec8 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:56.086817 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91ce9eb-8faf-409d-911b-d4cf1965eec8 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:56.112533 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-f91ce9eb-8faf-409d-911b-d4cf1965eec8 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 19 14:43:56.112533 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:56.112533 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:43:56.112533 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:43:56.112533 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:43:56.112533 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:43:56.112533 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:43:56.112533 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:43:56.112533 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:43:56.112533 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:43:56.112533 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:43:56.112533 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:43:56.112533 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 14:43:56.112533 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 14:43:56.112533 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 14:43:56.112533 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 14:43:56.113489 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:43:56.113489 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:43:56.113489 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:43:56.113489 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:43:56.113489 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:43:56.113489 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:43:56.113489 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:43:56.113489 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:43:56.113489 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:43:56.113489 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:43:56.113489 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:43:56.113489 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:43:56.113489 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:43:56.113489 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:43:56.113489 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:43:56.113489 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:43:56.113489 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:43:56.113489 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:43:56.114475 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:43:56.114475 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:43:56.114475 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 14:43:56.114475 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 14:43:56.114475 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 14:43:56.114475 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 14:43:56.114475 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 14:43:56.114475 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 14:43:56.114475 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 19 14:43:56.114475 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:43:56.114475 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 259/527] 10.222.0.72 () {56 vars in 1102 bytes} [Mon Sep 19 14:43:55 2022] GET /identity/v3/users/neutron => generated 85 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:43:56.115941 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91ce9eb-8faf-409d-911b-d4cf1965eec8 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:56.119854 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aacd1dc-9da1-4249-ae19-c9fe8ae40d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:56.120533 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aacd1dc-9da1-4249-ae19-c9fe8ae40d71 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:56.120871 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aacd1dc-9da1-4249-ae19-c9fe8ae40d71 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:56.121149 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aacd1dc-9da1-4249-ae19-c9fe8ae40d71 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:56.128568 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aacd1dc-9da1-4249-ae19-c9fe8ae40d71 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:56.130025 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aacd1dc-9da1-4249-ae19-c9fe8ae40d71 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:56.144034 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-5aacd1dc-9da1-4249-ae19-c9fe8ae40d71 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:43:56.144034 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:56.144034 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:43:56.144034 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:43:56.144034 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:43:56.144034 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:43:56.144034 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:43:56.144034 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:43:56.144034 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:43:56.144034 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:43:56.144034 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:43:56.144034 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:43:56.144034 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 14:43:56.144034 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 14:43:56.144034 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 14:43:56.145060 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 14:43:56.145060 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:43:56.145060 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:43:56.145060 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:43:56.145060 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:43:56.145060 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:43:56.145060 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:43:56.145060 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:43:56.145060 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:43:56.145060 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:43:56.145060 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:43:56.145060 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:43:56.145060 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:43:56.145060 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:43:56.145060 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:43:56.145060 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:43:56.145060 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:43:56.146561 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 14:43:56.146561 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 14:43:56.146561 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:43:56.146561 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:43:56.146561 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:43:56.146561 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:43:56.146561 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:43:56.146561 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:43:56.149755 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 269/528] 10.222.0.72 () {56 vars in 1111 bytes} [Mon Sep 19 14:43:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:43:56.150626 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aacd1dc-9da1-4249-ae19-c9fe8ae40d71 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:56.249829 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91ce9eb-8faf-409d-911b-d4cf1965eec8 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:56.276505 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aacd1dc-9da1-4249-ae19-c9fe8ae40d71 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:56.290093 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:56.300646 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40178883-1001-4234-8bfb-cabdb67efbd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:56.304025 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40178883-1001-4234-8bfb-cabdb67efbd3 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:56.304725 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40178883-1001-4234-8bfb-cabdb67efbd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:56.305012 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40178883-1001-4234-8bfb-cabdb67efbd3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:56.305757 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40178883-1001-4234-8bfb-cabdb67efbd3 None admin] RBAC: Adding query filter params (role.id=537cde5f25284acca3c3ea9ff806d724, scope.project.id=51af3a14d665498c9b7a35b34dac0ef1, user.id=055439dc35e946f4a82535c684f9b60d) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:56.306071 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40178883-1001-4234-8bfb-cabdb67efbd3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:56.308383 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40178883-1001-4234-8bfb-cabdb67efbd3 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:56.324439 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 260/529] 10.222.0.72 () {56 vars in 1374 bytes} [Mon Sep 19 14:43:56 2022] GET /identity/v3/role_assignments?user.id=055439dc35e946f4a82535c684f9b60d&scope.project.id=51af3a14d665498c9b7a35b34dac0ef1&role.id=537cde5f25284acca3c3ea9ff806d724 => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:56.324439 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40178883-1001-4234-8bfb-cabdb67efbd3 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:56.335462 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4fdff1-e5f0-4170-94e3-dad3c2e401cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:56.336220 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4fdff1-e5f0-4170-94e3-dad3c2e401cc None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:56.336558 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4fdff1-e5f0-4170-94e3-dad3c2e401cc None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:56.336860 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4fdff1-e5f0-4170-94e3-dad3c2e401cc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:56.347151 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4fdff1-e5f0-4170-94e3-dad3c2e401cc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:56.350921 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4fdff1-e5f0-4170-94e3-dad3c2e401cc None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:56.368350 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-dd4fdff1-e5f0-4170-94e3-dad3c2e401cc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:43:56.368350 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:56.368350 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:43:56.368350 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:43:56.368350 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:43:56.368350 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:43:56.368350 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:43:56.368350 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:43:56.368350 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:43:56.368350 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:43:56.368350 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:43:56.368350 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:43:56.368350 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 14:43:56.368350 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 14:43:56.368350 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 14:43:56.369261 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 14:43:56.369261 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:43:56.369261 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:43:56.369261 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:43:56.369261 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:43:56.369261 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:43:56.369261 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:43:56.369261 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:43:56.369261 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:43:56.369261 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:43:56.369261 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:43:56.369261 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:43:56.369261 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:43:56.369261 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:43:56.369261 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:43:56.369261 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:43:56.369261 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:43:56.370093 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 14:43:56.370093 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 14:43:56.370093 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:43:56.370093 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:43:56.370093 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:43:56.370093 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:43:56.370093 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:43:56.370093 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:43:56.370093 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 270/530] 10.222.0.72 () {56 vars in 1111 bytes} [Mon Sep 19 14:43:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:43:56.370553 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4fdff1-e5f0-4170-94e3-dad3c2e401cc None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:56.385863 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:56.445384 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40178883-1001-4234-8bfb-cabdb67efbd3 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:56.499546 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c654b3-ca59-41ca-81e6-5db003ac902e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:56.500660 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c654b3-ca59-41ca-81e6-5db003ac902e None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:56.501672 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c654b3-ca59-41ca-81e6-5db003ac902e None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:56.502050 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c654b3-ca59-41ca-81e6-5db003ac902e None admin] PATH_INFO: `/v3/users` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:56.503403 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c654b3-ca59-41ca-81e6-5db003ac902e None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:56.503726 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c654b3-ca59-41ca-81e6-5db003ac902e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:56.505258 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c654b3-ca59-41ca-81e6-5db003ac902e None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:56.524919 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4fdff1-e5f0-4170-94e3-dad3c2e401cc None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:56.539746 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 261/531] 10.222.0.72 () {56 vars in 1139 bytes} [Mon Sep 19 14:43:56 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:56.540780 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c654b3-ca59-41ca-81e6-5db003ac902e None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:56.592752 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f572f6f-c3b9-4bf9-a088-b66ad60e9b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:56.592752 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f572f6f-c3b9-4bf9-a088-b66ad60e9b21 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:56.592752 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f572f6f-c3b9-4bf9-a088-b66ad60e9b21 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:56.592752 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f572f6f-c3b9-4bf9-a088-b66ad60e9b21 None admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:56.593125 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f572f6f-c3b9-4bf9-a088-b66ad60e9b21 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:56.593125 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f572f6f-c3b9-4bf9-a088-b66ad60e9b21 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:56.593125 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f572f6f-c3b9-4bf9-a088-b66ad60e9b21 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:56.616364 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 271/532] 10.222.0.72 () {56 vars in 1148 bytes} [Mon Sep 19 14:43:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:56.617280 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f572f6f-c3b9-4bf9-a088-b66ad60e9b21 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:56.670043 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c654b3-ca59-41ca-81e6-5db003ac902e None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:56.676412 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:56.687699 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:56.711122 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fe1bf6-714c-4114-94ba-212dbfa3fa6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:56.711800 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe1bf6-714c-4114-94ba-212dbfa3fa6b None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:56.712083 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe1bf6-714c-4114-94ba-212dbfa3fa6b None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:56.712425 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe1bf6-714c-4114-94ba-212dbfa3fa6b None admin] PATH_INFO: `/v3/projects` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:56.713290 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fe1bf6-714c-4114-94ba-212dbfa3fa6b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:56.713594 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fe1bf6-714c-4114-94ba-212dbfa3fa6b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:56.716117 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fe1bf6-714c-4114-94ba-212dbfa3fa6b None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:56.734240 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 262/533] 10.222.0.72 () {56 vars in 1148 bytes} [Mon Sep 19 14:43:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:56.735284 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fe1bf6-714c-4114-94ba-212dbfa3fa6b None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:56.757997 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f572f6f-c3b9-4bf9-a088-b66ad60e9b21 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:56.794847 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343857a4-1580-4d75-970b-5546a8b806d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:56.795464 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343857a4-1580-4d75-970b-5546a8b806d8 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:56.795746 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343857a4-1580-4d75-970b-5546a8b806d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:56.796022 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343857a4-1580-4d75-970b-5546a8b806d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:56.848705 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fe1bf6-714c-4114-94ba-212dbfa3fa6b None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:56.866905 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343857a4-1580-4d75-970b-5546a8b806d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:56.868490 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343857a4-1580-4d75-970b-5546a8b806d8 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:56.887829 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b39b74e-d881-4daf-9ef9-218ab8e18e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:56.890915 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b39b74e-d881-4daf-9ef9-218ab8e18e10 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:56.890915 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b39b74e-d881-4daf-9ef9-218ab8e18e10 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:56.890915 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b39b74e-d881-4daf-9ef9-218ab8e18e10 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:56.890915 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b39b74e-d881-4daf-9ef9-218ab8e18e10 None admin] RBAC: Adding query filter params (role.id=537cde5f25284acca3c3ea9ff806d724, scope.project.id=51af3a14d665498c9b7a35b34dac0ef1, user.id=4d6d4ecf8f4849939d6510a6228b29dc) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:56.890915 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b39b74e-d881-4daf-9ef9-218ab8e18e10 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:56.891676 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b39b74e-d881-4daf-9ef9-218ab8e18e10 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:56.898884 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 263/534] 10.222.0.72 () {56 vars in 1374 bytes} [Mon Sep 19 14:43:56 2022] GET /identity/v3/role_assignments?user.id=4d6d4ecf8f4849939d6510a6228b29dc&scope.project.id=51af3a14d665498c9b7a35b34dac0ef1&role.id=537cde5f25284acca3c3ea9ff806d724 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:56.899139 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b39b74e-d881-4daf-9ef9-218ab8e18e10 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:56.913758 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:56.975376 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:57.067125 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b39b74e-d881-4daf-9ef9-218ab8e18e10 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:57.086956 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 272/535] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Sep 19 14:43:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 14:43:57.093878 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343857a4-1580-4d75-970b-5546a8b806d8 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:57.111665 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf770bfc-5541-4033-bbf0-50b8ecc884f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:57.112625 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf770bfc-5541-4033-bbf0-50b8ecc884f6 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:57.113117 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf770bfc-5541-4033-bbf0-50b8ecc884f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:57.113651 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf770bfc-5541-4033-bbf0-50b8ecc884f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:57.114770 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf770bfc-5541-4033-bbf0-50b8ecc884f6 None admin] RBAC: Adding query filter params (role.id=537cde5f25284acca3c3ea9ff806d724, scope.project.id=51af3a14d665498c9b7a35b34dac0ef1, user.id=139dc7a4f1dc48fe8faea848bd1ac0f6) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:57.115270 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf770bfc-5541-4033-bbf0-50b8ecc884f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:57.116981 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf770bfc-5541-4033-bbf0-50b8ecc884f6 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:57.128347 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 264/536] 10.222.0.72 () {56 vars in 1374 bytes} [Mon Sep 19 14:43:56 2022] GET /identity/v3/role_assignments?user.id=139dc7a4f1dc48fe8faea848bd1ac0f6&scope.project.id=51af3a14d665498c9b7a35b34dac0ef1&role.id=537cde5f25284acca3c3ea9ff806d724 => generated 259 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:57.265039 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343857a4-1580-4d75-970b-5546a8b806d8 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:57.312453 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:57.318239 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e8c623-2287-4043-a450-3611527d9413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:57.321084 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8c623-2287-4043-a450-3611527d9413 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:57.321362 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8c623-2287-4043-a450-3611527d9413 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:57.321628 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8c623-2287-4043-a450-3611527d9413 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:57.333004 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e8c623-2287-4043-a450-3611527d9413 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:57.334473 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e8c623-2287-4043-a450-3611527d9413 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:57.355892 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-d2e8c623-2287-4043-a450-3611527d9413 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:43:57.355892 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:57.355892 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:43:57.355892 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:43:57.355892 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:43:57.355892 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:43:57.355892 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:43:57.355892 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:43:57.355892 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:43:57.355892 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:43:57.355892 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:43:57.355892 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:43:57.355892 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:43:57.355892 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:43:57.355892 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:43:57.355892 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:43:57.356895 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:43:57.356895 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:43:57.356895 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:43:57.356895 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:43:57.356895 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:43:57.356895 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:43:57.356895 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:43:57.356895 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:43:57.356895 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:43:57.356895 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:43:57.356895 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:43:57.356895 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:43:57.356895 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:43:57.356895 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:43:57.356895 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:43:57.356895 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:43:57.356895 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:43:57.357810 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:43:57.357810 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:43:57.357810 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:43:57.361000 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 273/537] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:43:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:43:57.366700 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf770bfc-5541-4033-bbf0-50b8ecc884f6 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:57.620259 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf770bfc-5541-4033-bbf0-50b8ecc884f6 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:57.621870 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:57.681100 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bec505-97fd-445c-9514-0c70107954f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:57.682317 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bec505-97fd-445c-9514-0c70107954f0 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:57.682821 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bec505-97fd-445c-9514-0c70107954f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:57.683343 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bec505-97fd-445c-9514-0c70107954f0 None admin] PATH_INFO: `/v3/domains` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:57.684229 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bec505-97fd-445c-9514-0c70107954f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:57.684778 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bec505-97fd-445c-9514-0c70107954f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:57.686349 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bec505-97fd-445c-9514-0c70107954f0 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:57.704212 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 265/538] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Sep 19 14:43:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:57.713709 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bec505-97fd-445c-9514-0c70107954f0 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:57.714369 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1f086f-51bf-4dce-bf02-f8273ce23b1c None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:57.715178 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1f086f-51bf-4dce-bf02-f8273ce23b1c None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:57.715178 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1f086f-51bf-4dce-bf02-f8273ce23b1c None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:57.724770 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 274/539] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:43:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:43:57.734925 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a595859-7258-4055-9981-295f7118acad None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:57.735442 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a595859-7258-4055-9981-295f7118acad None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:57.735816 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a595859-7258-4055-9981-295f7118acad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:57.789439 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-9a595859-7258-4055-9981-295f7118acad None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:43:57.790659 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-9a595859-7258-4055-9981-295f7118acad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:43:57.824655 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bec505-97fd-445c-9514-0c70107954f0 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:57.868831 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2137e9a2-de89-4842-8473-3046df73db85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:57.870341 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2137e9a2-de89-4842-8473-3046df73db85 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:57.870894 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2137e9a2-de89-4842-8473-3046df73db85 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:57.871367 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2137e9a2-de89-4842-8473-3046df73db85 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:57.878725 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2137e9a2-de89-4842-8473-3046df73db85 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:57.880626 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2137e9a2-de89-4842-8473-3046df73db85 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:57.894045 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-2137e9a2-de89-4842-8473-3046df73db85 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:43:57.894045 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:57.894045 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:43:57.894045 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:43:57.894045 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:43:57.894045 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:43:57.894045 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:43:57.894045 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:43:57.894045 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:43:57.894045 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:43:57.894045 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:43:57.894045 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:43:57.894045 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 14:43:57.894045 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 14:43:57.894045 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 14:43:57.894931 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 14:43:57.894931 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:43:57.894931 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:43:57.894931 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:43:57.894931 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:43:57.894931 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:43:57.894931 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:43:57.894931 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:43:57.894931 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:43:57.894931 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:43:57.894931 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:43:57.894931 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:43:57.894931 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:43:57.894931 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:43:57.894931 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:43:57.894931 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:43:57.894931 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:43:57.895759 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 14:43:57.895759 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 14:43:57.895759 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:43:57.895759 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:43:57.895759 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:43:57.895759 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:43:57.895759 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:43:57.895759 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:43:57.897434 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 266/540] 10.222.0.72 () {56 vars in 1111 bytes} [Mon Sep 19 14:43:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:43:57.910436 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2137e9a2-de89-4842-8473-3046df73db85 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:57.988356 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:58.018242 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 275/541] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:43:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 14:43:58.144194 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2137e9a2-de89-4842-8473-3046df73db85 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:58.210729 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162f9eb0-1ae9-4710-a6ea-23baac8d06cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:58.211800 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f9eb0-1ae9-4710-a6ea-23baac8d06cc None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:58.212284 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f9eb0-1ae9-4710-a6ea-23baac8d06cc None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:58.212795 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f9eb0-1ae9-4710-a6ea-23baac8d06cc None admin] PATH_INFO: `/v3/projects` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:58.213693 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162f9eb0-1ae9-4710-a6ea-23baac8d06cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:58.214213 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162f9eb0-1ae9-4710-a6ea-23baac8d06cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:58.216029 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162f9eb0-1ae9-4710-a6ea-23baac8d06cc None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:58.234665 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 267/542] 10.222.0.72 () {56 vars in 1148 bytes} [Mon Sep 19 14:43:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:58.241145 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a595859-7258-4055-9981-295f7118acad None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:58.334400 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162f9eb0-1ae9-4710-a6ea-23baac8d06cc None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:58.390018 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a595859-7258-4055-9981-295f7118acad None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:58.404931 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:58.442609 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4624923-b538-41bd-a6b5-28ddcb1bfaba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:58.444840 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4624923-b538-41bd-a6b5-28ddcb1bfaba None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:58.445390 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4624923-b538-41bd-a6b5-28ddcb1bfaba None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:58.446853 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4624923-b538-41bd-a6b5-28ddcb1bfaba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:58.447775 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4624923-b538-41bd-a6b5-28ddcb1bfaba None admin] RBAC: Adding query filter params (role.id=537cde5f25284acca3c3ea9ff806d724, scope.project.id=51af3a14d665498c9b7a35b34dac0ef1, user.id=f4c2b78646374cb79ded4b7b59ba49c7) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:58.449860 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4624923-b538-41bd-a6b5-28ddcb1bfaba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:58.451514 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4624923-b538-41bd-a6b5-28ddcb1bfaba None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:58.464612 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 276/543] 10.222.0.72 () {56 vars in 1374 bytes} [Mon Sep 19 14:43:58 2022] GET /identity/v3/role_assignments?user.id=f4c2b78646374cb79ded4b7b59ba49c7&scope.project.id=51af3a14d665498c9b7a35b34dac0ef1&role.id=537cde5f25284acca3c3ea9ff806d724 => generated 259 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:58.496519 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:58.518579 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162f9eb0-1ae9-4710-a6ea-23baac8d06cc None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:58.571169 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12920f53-141c-471d-94c5-8cd71bed145b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:58.572191 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12920f53-141c-471d-94c5-8cd71bed145b None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:58.572712 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12920f53-141c-471d-94c5-8cd71bed145b None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:58.573185 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12920f53-141c-471d-94c5-8cd71bed145b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:58.589349 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12920f53-141c-471d-94c5-8cd71bed145b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:43:58.595673 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-12920f53-141c-471d-94c5-8cd71bed145b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:43:58.595673 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:58.595673 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:43:58.595673 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:43:58.595673 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:43:58.595673 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:43:58.595673 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:43:58.595673 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:43:58.595673 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:43:58.595673 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:43:58.595673 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:43:58.595673 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:43:58.595673 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:43:58.595673 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:43:58.595673 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:43:58.595673 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:43:58.596623 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:43:58.596623 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:43:58.596623 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:43:58.596623 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:43:58.596623 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:43:58.596623 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:43:58.596623 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:43:58.596623 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:43:58.596623 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:43:58.596623 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:43:58.596623 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:43:58.596623 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:43:58.596623 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:43:58.596623 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:43:58.596623 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:43:58.596623 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:43:58.597415 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:43:58.597415 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:43:58.597415 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:43:58.597415 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:43:58.597415 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:43:58.597415 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:43:58.597415 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:43:58.597415 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:43:58.597415 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:43:58.597415 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:43:58.597415 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:43:58.597415 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:43:58.605690 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 268/544] 10.222.0.72 () {56 vars in 1102 bytes} [Mon Sep 19 14:43:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:43:58.612024 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4624923-b538-41bd-a6b5-28ddcb1bfaba None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:58.732596 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4624923-b538-41bd-a6b5-28ddcb1bfaba None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:58.770127 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e79a5de-ebc8-4855-8d09-fb4ef057d4c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:58.771083 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e79a5de-ebc8-4855-8d09-fb4ef057d4c3 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:58.771560 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e79a5de-ebc8-4855-8d09-fb4ef057d4c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:58.772029 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e79a5de-ebc8-4855-8d09-fb4ef057d4c3 None admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:58.772936 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e79a5de-ebc8-4855-8d09-fb4ef057d4c3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:58.773435 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e79a5de-ebc8-4855-8d09-fb4ef057d4c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:58.775072 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e79a5de-ebc8-4855-8d09-fb4ef057d4c3 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:58.784103 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 277/545] 10.222.0.72 () {56 vars in 1103 bytes} [Mon Sep 19 14:43:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:58.790161 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12920f53-141c-471d-94c5-8cd71bed145b None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:58.900971 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12920f53-141c-471d-94c5-8cd71bed145b None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:58.937324 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c07bf4-58bc-4386-af43-0fa29847df0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:58.937954 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c07bf4-58bc-4386-af43-0fa29847df0c None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:58.938233 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c07bf4-58bc-4386-af43-0fa29847df0c None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:58.938503 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c07bf4-58bc-4386-af43-0fa29847df0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:58.950037 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c07bf4-58bc-4386-af43-0fa29847df0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:58.951542 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c07bf4-58bc-4386-af43-0fa29847df0c None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:58.953359 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:58.966839 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-23c07bf4-58bc-4386-af43-0fa29847df0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:43:58.966839 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:58.966839 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:43:58.966839 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:43:58.966839 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:43:58.966839 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:43:58.966839 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:43:58.966839 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:43:58.966839 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:43:58.966839 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:43:58.966839 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:43:58.966839 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:43:58.966839 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:43:58.966839 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:43:58.966839 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:43:58.966839 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:43:58.967755 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:43:58.967755 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:43:58.967755 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:43:58.967755 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:43:58.967755 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:43:58.967755 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:43:58.967755 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:43:58.967755 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:43:58.967755 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:43:58.967755 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:43:58.967755 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:43:58.967755 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:43:58.967755 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:43:58.967755 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:43:58.967755 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:43:58.967755 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:43:58.967755 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:43:58.968625 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:43:58.968625 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:43:58.968625 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:43:58.971623 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 269/546] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:43:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:43:58.974040 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e79a5de-ebc8-4855-8d09-fb4ef057d4c3 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:59.020821 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:59.087617 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e79a5de-ebc8-4855-8d09-fb4ef057d4c3 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:59.123198 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc0578b-f11b-45eb-b7a2-1f72991f8cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:59.123808 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc0578b-f11b-45eb-b7a2-1f72991f8cb8 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:59.124137 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc0578b-f11b-45eb-b7a2-1f72991f8cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:59.124440 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc0578b-f11b-45eb-b7a2-1f72991f8cb8 None admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:59.125078 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc0578b-f11b-45eb-b7a2-1f72991f8cb8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:59.125437 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc0578b-f11b-45eb-b7a2-1f72991f8cb8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:59.126811 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc0578b-f11b-45eb-b7a2-1f72991f8cb8 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:59.143744 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 278/547] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Sep 19 14:43:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:59.145152 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c07bf4-58bc-4386-af43-0fa29847df0c None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:59.254690 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c07bf4-58bc-4386-af43-0fa29847df0c None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:59.290575 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a570f37-6e0b-44d9-8b05-c8f10c999d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:59.291129 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a570f37-6e0b-44d9-8b05-c8f10c999d72 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:59.291408 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a570f37-6e0b-44d9-8b05-c8f10c999d72 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:59.291678 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a570f37-6e0b-44d9-8b05-c8f10c999d72 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:59.300604 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a570f37-6e0b-44d9-8b05-c8f10c999d72 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:59.302110 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a570f37-6e0b-44d9-8b05-c8f10c999d72 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:59.314749 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-3a570f37-6e0b-44d9-8b05-c8f10c999d72 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 19 14:43:59.314749 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:59.314749 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:43:59.314749 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:43:59.314749 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:43:59.314749 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:43:59.314749 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:43:59.314749 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:43:59.314749 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:43:59.314749 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:43:59.314749 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:43:59.314749 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:43:59.314749 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 14:43:59.314749 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 14:43:59.314749 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 14:43:59.314749 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 14:43:59.317401 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:43:59.317401 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:43:59.317401 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:43:59.317401 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:43:59.317401 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:43:59.317401 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:43:59.317401 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:43:59.317401 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:43:59.317401 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:43:59.317401 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:43:59.317401 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:43:59.317401 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:43:59.317401 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:43:59.317401 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:43:59.317401 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:43:59.317401 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:43:59.317401 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:43:59.317401 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:43:59.319723 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:43:59.319723 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:43:59.319723 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 14:43:59.319723 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 14:43:59.319723 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 14:43:59.319723 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 14:43:59.319723 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 14:43:59.319723 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 14:43:59.319723 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 19 14:43:59.319723 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:43:59.320983 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 270/548] 10.222.0.72 () {56 vars in 1096 bytes} [Mon Sep 19 14:43:59 2022] GET /identity/v3/users/swift => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:43:59.324349 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc0578b-f11b-45eb-b7a2-1f72991f8cb8 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:59.414896 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0134449-00b2-4b99-b0c8-cbb2441c0b6e None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:59.415222 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0134449-00b2-4b99-b0c8-cbb2441c0b6e None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:59.415430 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0134449-00b2-4b99-b0c8-cbb2441c0b6e None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:59.417048 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 271/549] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:43:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 14:43:59.429699 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88733d74-27d6-4db0-8300-047493dfbb92 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:59.429964 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88733d74-27d6-4db0-8300-047493dfbb92 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:59.430247 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88733d74-27d6-4db0-8300-047493dfbb92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:59.439529 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:59.444029 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc0578b-f11b-45eb-b7a2-1f72991f8cb8 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:59.455787 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-88733d74-27d6-4db0-8300-047493dfbb92 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:43:59.457089 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-88733d74-27d6-4db0-8300-047493dfbb92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:43:59.506839 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046e0709-eda2-4b78-8abd-e9ef0d09ef27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:59.507450 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e0709-eda2-4b78-8abd-e9ef0d09ef27 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:59.507731 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e0709-eda2-4b78-8abd-e9ef0d09ef27 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:59.508000 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e0709-eda2-4b78-8abd-e9ef0d09ef27 None admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:59.508753 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046e0709-eda2-4b78-8abd-e9ef0d09ef27 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:59.509255 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046e0709-eda2-4b78-8abd-e9ef0d09ef27 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:59.511684 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046e0709-eda2-4b78-8abd-e9ef0d09ef27 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:59.550933 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 279/550] 10.222.0.72 () {56 vars in 1135 bytes} [Mon Sep 19 14:43:59 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:43:59.551225 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:59.557760 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046e0709-eda2-4b78-8abd-e9ef0d09ef27 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:59.595499 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 272/551] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:43:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 14:43:59.704980 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046e0709-eda2-4b78-8abd-e9ef0d09ef27 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:59.741879 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69cd038-09f1-4aa1-a4ad-a1c5c710026e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:59.742529 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69cd038-09f1-4aa1-a4ad-a1c5c710026e None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:59.742766 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69cd038-09f1-4aa1-a4ad-a1c5c710026e None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:59.743009 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69cd038-09f1-4aa1-a4ad-a1c5c710026e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:59.762605 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac081a2-346c-4681-9c17-7d62aa7f405c None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:59.762978 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac081a2-346c-4681-9c17-7d62aa7f405c None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:59.763251 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac081a2-346c-4681-9c17-7d62aa7f405c None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:59.764974 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 273/552] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:43:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:43:59.776508 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:59.782638 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b4649-d811-44eb-ab9d-8ef5a6cd5fa3 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:59.782928 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b4649-d811-44eb-ab9d-8ef5a6cd5fa3 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:59.783204 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b4649-d811-44eb-ab9d-8ef5a6cd5fa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:59.825452 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-703b4649-d811-44eb-ab9d-8ef5a6cd5fa3 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:43:59.826569 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-703b4649-d811-44eb-ab9d-8ef5a6cd5fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:43:59.841399 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69cd038-09f1-4aa1-a4ad-a1c5c710026e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:59.842877 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69cd038-09f1-4aa1-a4ad-a1c5c710026e None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:59.911818 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 274/553] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:43:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 14:43:59.914239 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5cbbdc-aef4-435a-9841-9c3cba4efe1d None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:59.914532 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5cbbdc-aef4-435a-9841-9c3cba4efe1d None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:59.914804 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5cbbdc-aef4-435a-9841-9c3cba4efe1d None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:59.916145 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 275/554] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:43:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:43:59.924238 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c96b87e-1223-4623-aa36-af1691bb615a None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:59.924794 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c96b87e-1223-4623-aa36-af1691bb615a None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:59.925272 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c96b87e-1223-4623-aa36-af1691bb615a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:59.948761 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-3c96b87e-1223-4623-aa36-af1691bb615a None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:43:59.950810 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-3c96b87e-1223-4623-aa36-af1691bb615a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:43:59.984442 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 280/555] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Sep 19 14:43:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 19 14:43:59.985617 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69cd038-09f1-4aa1-a4ad-a1c5c710026e None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:00.040363 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 276/556] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:43:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:44:00.040363 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c96b87e-1223-4623-aa36-af1691bb615a None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:00.065431 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:00.085942 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:00.148147 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c96b87e-1223-4623-aa36-af1691bb615a None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:00.150947 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69cd038-09f1-4aa1-a4ad-a1c5c710026e None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:00.190807 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8057c61-d521-4ee7-9116-a8f95bc7670d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:00.191245 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b18995-f187-403f-9767-29c20da78b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:00.191438 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8057c61-d521-4ee7-9116-a8f95bc7670d None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:00.191716 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8057c61-d521-4ee7-9116-a8f95bc7670d None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:00.191988 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8057c61-d521-4ee7-9116-a8f95bc7670d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:00.192911 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b18995-f187-403f-9767-29c20da78b29 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:00.193392 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b18995-f187-403f-9767-29c20da78b29 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:00.193974 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b18995-f187-403f-9767-29c20da78b29 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:00.204151 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8057c61-d521-4ee7-9116-a8f95bc7670d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:00.205632 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8057c61-d521-4ee7-9116-a8f95bc7670d None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:00.206630 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b18995-f187-403f-9767-29c20da78b29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:44:00.212150 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-03b18995-f187-403f-9767-29c20da78b29 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:44:00.212150 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:00.212150 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:00.212150 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:00.212150 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:00.212150 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:00.212150 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:00.212150 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:00.212150 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:00.212150 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:00.212150 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:00.212150 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:00.212150 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:44:00.212150 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:44:00.212150 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:44:00.212150 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:44:00.213110 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:44:00.213110 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:44:00.213110 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:44:00.213110 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:44:00.213110 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:00.213110 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:00.213110 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:00.213110 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:00.213110 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:00.213110 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:00.213110 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:00.213110 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:00.213110 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:00.213110 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:00.213110 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:00.213110 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:00.213990 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:00.213990 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:00.213990 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:00.213990 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:00.213990 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:44:00.213990 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:44:00.213990 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:44:00.213990 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:44:00.213990 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:44:00.213990 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:44:00.213990 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:44:00.213990 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:44:00.217043 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 281/557] 10.222.0.72 () {56 vars in 1102 bytes} [Mon Sep 19 14:43:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:00.218063 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b18995-f187-403f-9767-29c20da78b29 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:00.221274 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-d8057c61-d521-4ee7-9116-a8f95bc7670d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:44:00.221274 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:00.221274 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:00.221274 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:00.221274 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:00.221274 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:00.221274 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:00.221274 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:00.221274 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:00.221274 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:00.221274 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:00.221274 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:00.221274 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:44:00.221274 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:44:00.221274 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:44:00.221274 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:44:00.222194 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:00.222194 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:00.222194 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:00.222194 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:00.222194 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:00.222194 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:00.222194 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:00.222194 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:00.222194 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:00.222194 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:00.222194 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:00.222194 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:00.222194 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:00.222194 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:00.222194 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:00.222194 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:00.222194 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:44:00.223046 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:44:00.223046 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:44:00.223046 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:44:00.223046 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 277/558] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:44:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:00.225114 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8057c61-d521-4ee7-9116-a8f95bc7670d None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:00.334758 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b18995-f187-403f-9767-29c20da78b29 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:00.341200 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:00.348080 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8057c61-d521-4ee7-9116-a8f95bc7670d None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:00.355283 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:00.375980 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b34eedf-0a43-4656-ab9b-aa223ef3a98b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:00.377038 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b34eedf-0a43-4656-ab9b-aa223ef3a98b None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:00.377575 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b34eedf-0a43-4656-ab9b-aa223ef3a98b None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:00.378066 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b34eedf-0a43-4656-ab9b-aa223ef3a98b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:00.389375 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc493df-4e23-4d51-8677-8545b088f8ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:00.390036 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc493df-4e23-4d51-8677-8545b088f8ef None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:00.390321 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc493df-4e23-4d51-8677-8545b088f8ef None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:00.390596 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc493df-4e23-4d51-8677-8545b088f8ef None admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:00.391259 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc493df-4e23-4d51-8677-8545b088f8ef None admin] RBAC: Adding query filter params (name=service) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:00.391562 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc493df-4e23-4d51-8677-8545b088f8ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:00.392722 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b34eedf-0a43-4656-ab9b-aa223ef3a98b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:44:00.393268 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc493df-4e23-4d51-8677-8545b088f8ef None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:00.398582 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-9b34eedf-0a43-4656-ab9b-aa223ef3a98b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:44:00.398582 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:00.398582 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:00.398582 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:00.398582 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:00.398582 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:00.398582 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:00.398582 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:00.398582 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:00.398582 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:00.398582 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:00.398582 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:00.398582 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:44:00.398582 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:44:00.398582 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:44:00.398582 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:44:00.399477 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:44:00.399477 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:44:00.399477 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:44:00.399477 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:44:00.399477 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:00.399477 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:00.399477 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:00.399477 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:00.399477 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:00.399477 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:00.399477 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:00.399477 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:00.399477 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:00.399477 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:00.399477 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:00.399477 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:00.400300 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:00.400300 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:00.400300 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:00.400300 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:00.400300 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:44:00.400300 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:44:00.400300 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:44:00.400300 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:44:00.400300 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:44:00.400300 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:44:00.400300 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:44:00.400300 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:44:00.401834 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 278/559] 10.222.0.72 () {56 vars in 1103 bytes} [Mon Sep 19 14:44:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:00.402814 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc493df-4e23-4d51-8677-8545b088f8ef None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:00.404132 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 282/560] 10.222.0.72 () {56 vars in 1102 bytes} [Mon Sep 19 14:44:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:00.406955 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b34eedf-0a43-4656-ab9b-aa223ef3a98b None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:00.514839 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc493df-4e23-4d51-8677-8545b088f8ef None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:00.515042 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b34eedf-0a43-4656-ab9b-aa223ef3a98b None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:00.552859 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c585ea8-9933-4545-8bdf-231cfaa5cc74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:00.553562 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c585ea8-9933-4545-8bdf-231cfaa5cc74 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:00.554065 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c585ea8-9933-4545-8bdf-231cfaa5cc74 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:00.554351 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c585ea8-9933-4545-8bdf-231cfaa5cc74 None admin] PATH_INFO: `/v3/domains` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:00.555089 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c585ea8-9933-4545-8bdf-231cfaa5cc74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:00.555187 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86d7d7e-2d27-4fe6-bee9-a917a1e396db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:00.555396 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c585ea8-9933-4545-8bdf-231cfaa5cc74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:00.555751 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86d7d7e-2d27-4fe6-bee9-a917a1e396db None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:00.556033 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86d7d7e-2d27-4fe6-bee9-a917a1e396db None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:00.556306 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86d7d7e-2d27-4fe6-bee9-a917a1e396db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:00.556799 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c585ea8-9933-4545-8bdf-231cfaa5cc74 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:00.567587 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86d7d7e-2d27-4fe6-bee9-a917a1e396db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:00.569093 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86d7d7e-2d27-4fe6-bee9-a917a1e396db None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:00.576910 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 279/561] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Sep 19 14:44:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:00.576910 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c585ea8-9933-4545-8bdf-231cfaa5cc74 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:00.584662 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-d86d7d7e-2d27-4fe6-bee9-a917a1e396db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:44:00.584662 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:00.584662 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:00.584662 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:00.584662 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:00.584662 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:00.584662 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:00.584662 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:00.584662 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:00.584662 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:00.584662 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:00.584662 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:00.584662 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:44:00.584662 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:44:00.584662 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:44:00.584662 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:44:00.585579 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:00.585579 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:00.585579 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:00.585579 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:00.585579 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:00.585579 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:00.585579 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:00.585579 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:00.585579 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:00.585579 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:00.585579 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:00.585579 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:00.585579 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:00.585579 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:00.585579 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:00.585579 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:00.585579 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:44:00.586603 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:44:00.586603 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:44:00.586603 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:44:00.586603 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 283/562] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:44:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:00.586603 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86d7d7e-2d27-4fe6-bee9-a917a1e396db None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:00.599754 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:00.617371 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:00.692583 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c585ea8-9933-4545-8bdf-231cfaa5cc74 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:00.702303 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86d7d7e-2d27-4fe6-bee9-a917a1e396db None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:00.728247 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f870598-e52c-4df2-bb00-28bb6115f330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:00.728893 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f870598-e52c-4df2-bb00-28bb6115f330 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:00.729172 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f870598-e52c-4df2-bb00-28bb6115f330 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:00.729447 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f870598-e52c-4df2-bb00-28bb6115f330 None admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:00.730102 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f870598-e52c-4df2-bb00-28bb6115f330 None admin] RBAC: Adding query filter params (name=service) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:00.730952 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f870598-e52c-4df2-bb00-28bb6115f330 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:00.732429 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f870598-e52c-4df2-bb00-28bb6115f330 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:00.738974 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2559ea-fbac-4b4e-9022-965753d1593b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:00.739606 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2559ea-fbac-4b4e-9022-965753d1593b None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:00.739887 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2559ea-fbac-4b4e-9022-965753d1593b None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:00.740162 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2559ea-fbac-4b4e-9022-965753d1593b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:00.745354 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 280/563] 10.222.0.72 () {56 vars in 1103 bytes} [Mon Sep 19 14:44:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:00.745354 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f870598-e52c-4df2-bb00-28bb6115f330 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:00.756673 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2559ea-fbac-4b4e-9022-965753d1593b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:44:00.762166 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-2d2559ea-fbac-4b4e-9022-965753d1593b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:44:00.762166 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:00.762166 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:00.762166 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:00.762166 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:00.762166 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:00.762166 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:00.762166 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:00.762166 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:00.762166 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:00.762166 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:00.762166 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:00.762166 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:44:00.762166 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:44:00.762166 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:44:00.762166 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:44:00.763089 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:44:00.763089 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:44:00.763089 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:44:00.763089 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:44:00.763089 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:00.763089 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:00.763089 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:00.763089 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:00.763089 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:00.763089 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:00.763089 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:00.763089 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:00.763089 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:00.763089 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:00.763089 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:00.763089 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:00.763934 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:00.763934 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:00.763934 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:00.763934 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:00.763934 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:44:00.763934 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:44:00.763934 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:44:00.763934 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:44:00.763934 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:44:00.763934 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:44:00.763934 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:44:00.763934 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:44:00.763934 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 284/564] 10.222.0.72 () {56 vars in 1102 bytes} [Mon Sep 19 14:44:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:00.764656 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2559ea-fbac-4b4e-9022-965753d1593b None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:00.837474 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:00.860752 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f870598-e52c-4df2-bb00-28bb6115f330 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:00.861348 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:00.875153 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2559ea-fbac-4b4e-9022-965753d1593b None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:00.899099 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88784c0-72c2-4e93-ba81-4c082ca595e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:00.900050 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88784c0-72c2-4e93-ba81-4c082ca595e2 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:00.900354 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88784c0-72c2-4e93-ba81-4c082ca595e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:00.900896 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88784c0-72c2-4e93-ba81-4c082ca595e2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:00.909087 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88784c0-72c2-4e93-ba81-4c082ca595e2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:00.910831 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88784c0-72c2-4e93-ba81-4c082ca595e2 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:00.913898 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb953c1b-5f8b-48ae-82c8-2e3041236de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:00.914511 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb953c1b-5f8b-48ae-82c8-2e3041236de2 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:00.914794 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb953c1b-5f8b-48ae-82c8-2e3041236de2 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:00.915072 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb953c1b-5f8b-48ae-82c8-2e3041236de2 None admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:00.915712 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb953c1b-5f8b-48ae-82c8-2e3041236de2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:00.916020 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb953c1b-5f8b-48ae-82c8-2e3041236de2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:00.917605 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb953c1b-5f8b-48ae-82c8-2e3041236de2 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:00.922960 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-c88784c0-72c2-4e93-ba81-4c082ca595e2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:44:00.922960 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:00.922960 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:00.922960 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:00.922960 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:00.922960 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:00.922960 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:00.922960 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:00.922960 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:00.922960 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:00.922960 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:00.922960 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:00.922960 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 14:44:00.922960 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 14:44:00.922960 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 14:44:00.924126 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 14:44:00.924126 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:00.924126 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:00.924126 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:00.924126 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:00.924126 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:00.924126 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:00.924126 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:00.924126 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:00.924126 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:00.924126 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:00.924126 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:00.924126 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:00.924126 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:00.924126 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:00.924126 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:00.924126 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:00.925037 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 14:44:00.925037 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 14:44:00.925037 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:44:00.925037 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:44:00.925037 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:44:00.925037 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:44:00.925037 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:44:00.925037 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:44:00.928794 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 281/565] 10.222.0.72 () {56 vars in 1111 bytes} [Mon Sep 19 14:44:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:00.929617 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88784c0-72c2-4e93-ba81-4c082ca595e2 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:00.935957 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 285/566] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Sep 19 14:44:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:00.935957 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb953c1b-5f8b-48ae-82c8-2e3041236de2 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:01.040992 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb953c1b-5f8b-48ae-82c8-2e3041236de2 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:01.048871 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88784c0-72c2-4e93-ba81-4c082ca595e2 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:01.076711 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b428c3-d9f3-4b8c-83b9-b03e0292876e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:01.077324 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b428c3-d9f3-4b8c-83b9-b03e0292876e None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:01.077601 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b428c3-d9f3-4b8c-83b9-b03e0292876e None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:01.077876 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b428c3-d9f3-4b8c-83b9-b03e0292876e None admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:01.078536 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b428c3-d9f3-4b8c-83b9-b03e0292876e None admin] RBAC: Adding query filter params (name=service) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:01.078839 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b428c3-d9f3-4b8c-83b9-b03e0292876e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:01.080223 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b428c3-d9f3-4b8c-83b9-b03e0292876e None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:01.086275 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b162885-e753-4044-ad42-f8feeaf17272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:01.086902 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b162885-e753-4044-ad42-f8feeaf17272 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:01.087178 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b162885-e753-4044-ad42-f8feeaf17272 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:01.087446 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b162885-e753-4044-ad42-f8feeaf17272 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:01.093088 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 286/567] 10.222.0.72 () {56 vars in 1103 bytes} [Mon Sep 19 14:44:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:01.093088 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b428c3-d9f3-4b8c-83b9-b03e0292876e None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:01.096437 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:01.099586 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b162885-e753-4044-ad42-f8feeaf17272 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:01.101674 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b162885-e753-4044-ad42-f8feeaf17272 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:01.106773 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:01.118333 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-2b162885-e753-4044-ad42-f8feeaf17272 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:44:01.118333 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:01.118333 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:01.118333 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:01.118333 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:01.118333 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:01.118333 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:01.118333 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:01.118333 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:01.118333 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:01.118333 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:01.118333 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:01.118333 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:44:01.118333 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:44:01.118333 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:44:01.118333 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:44:01.119434 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:01.119434 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:01.119434 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:01.119434 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:01.119434 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:01.119434 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:01.119434 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:01.119434 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:01.119434 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:01.119434 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:01.119434 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:01.119434 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:01.119434 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:01.119434 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:01.119434 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:01.119434 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:01.119434 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:44:01.121276 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:44:01.121276 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:44:01.121276 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:44:01.121276 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 282/568] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:44:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:01.121276 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b162885-e753-4044-ad42-f8feeaf17272 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:01.198043 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b428c3-d9f3-4b8c-83b9-b03e0292876e None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:01.220257 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b162885-e753-4044-ad42-f8feeaf17272 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:01.231858 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f027f80-f54e-4dcb-b5d1-8e51627acd24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:01.232492 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f027f80-f54e-4dcb-b5d1-8e51627acd24 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:01.232777 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f027f80-f54e-4dcb-b5d1-8e51627acd24 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:01.233059 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f027f80-f54e-4dcb-b5d1-8e51627acd24 None admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:01.233743 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f027f80-f54e-4dcb-b5d1-8e51627acd24 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:01.234049 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f027f80-f54e-4dcb-b5d1-8e51627acd24 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:01.235484 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f027f80-f54e-4dcb-b5d1-8e51627acd24 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:01.248712 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 287/569] 10.222.0.72 () {56 vars in 1148 bytes} [Mon Sep 19 14:44:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:01.249505 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f027f80-f54e-4dcb-b5d1-8e51627acd24 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:01.258664 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cd0c5a-1e3f-40eb-9166-985413550a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:01.259304 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cd0c5a-1e3f-40eb-9166-985413550a0a None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:01.259570 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cd0c5a-1e3f-40eb-9166-985413550a0a None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:01.259845 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cd0c5a-1e3f-40eb-9166-985413550a0a None admin] PATH_INFO: `/v3/users/nova` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:01.267583 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cd0c5a-1e3f-40eb-9166-985413550a0a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:01.269076 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cd0c5a-1e3f-40eb-9166-985413550a0a None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:01.280053 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-98cd0c5a-1e3f-40eb-9166-985413550a0a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 19 14:44:01.280053 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:01.280053 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:01.280053 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:01.280053 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:01.280053 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:01.280053 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:01.280053 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:01.280053 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:01.280053 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:01.280053 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:01.280053 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:01.280053 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 14:44:01.280053 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 14:44:01.280053 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 14:44:01.280053 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 14:44:01.281210 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:01.281210 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:01.281210 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:44:01.281210 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:44:01.281210 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:44:01.281210 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:44:01.281210 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:01.281210 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:01.281210 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:01.281210 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:01.281210 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:01.281210 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:01.281210 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:01.281210 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:01.281210 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:01.281210 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:01.281210 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:01.281210 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:01.282151 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:01.282151 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:01.282151 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 14:44:01.282151 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 14:44:01.282151 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 14:44:01.282151 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 14:44:01.282151 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 14:44:01.282151 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 14:44:01.282151 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 19 14:44:01.282151 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:44:01.282151 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 283/570] 10.222.0.72 () {56 vars in 1093 bytes} [Mon Sep 19 14:44:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:01.282737 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65b9ad-3cce-4f31-93a4-5f072695817c None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:01.282805 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65b9ad-3cce-4f31-93a4-5f072695817c None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:01.283069 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65b9ad-3cce-4f31-93a4-5f072695817c None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:01.288311 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 284/571] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:44:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:44:01.288311 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d65b9ad-3cce-4f31-93a4-5f072695817c None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:01.322374 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:01.339046 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:01.354006 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f027f80-f54e-4dcb-b5d1-8e51627acd24 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:01.387199 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d65b9ad-3cce-4f31-93a4-5f072695817c None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:01.388206 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6628451-231e-4820-8c5a-402fa9c1d0cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:01.388864 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6628451-231e-4820-8c5a-402fa9c1d0cf None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:01.389139 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6628451-231e-4820-8c5a-402fa9c1d0cf None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:01.389417 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6628451-231e-4820-8c5a-402fa9c1d0cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:01.399298 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6628451-231e-4820-8c5a-402fa9c1d0cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:01.400790 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6628451-231e-4820-8c5a-402fa9c1d0cf None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:01.415219 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-c6628451-231e-4820-8c5a-402fa9c1d0cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:44:01.415219 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:01.415219 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:01.415219 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:01.415219 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:01.415219 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:01.415219 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:01.415219 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:01.415219 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:01.415219 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:01.415219 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:01.415219 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:01.415219 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:44:01.415219 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:44:01.415219 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:44:01.415219 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:44:01.416366 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:01.416366 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:01.416366 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:01.416366 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:01.416366 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:01.416366 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:01.416366 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:01.416366 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:01.416366 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:01.416366 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:01.416366 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:01.416366 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:01.416366 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:01.416366 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:01.416366 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:01.416366 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:01.416366 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:44:01.417465 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:44:01.417465 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:44:01.417465 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:44:01.417465 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 288/572] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:44:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:01.417465 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6628451-231e-4820-8c5a-402fa9c1d0cf None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:01.424511 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19793244-9c96-4132-8b81-e3882073aec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:01.425125 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19793244-9c96-4132-8b81-e3882073aec3 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:01.425401 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19793244-9c96-4132-8b81-e3882073aec3 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:01.425672 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19793244-9c96-4132-8b81-e3882073aec3 None admin] PATH_INFO: `/v3/domains` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:01.426307 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19793244-9c96-4132-8b81-e3882073aec3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:01.426608 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19793244-9c96-4132-8b81-e3882073aec3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:01.427951 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19793244-9c96-4132-8b81-e3882073aec3 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:01.440583 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 285/573] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Sep 19 14:44:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:01.441378 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19793244-9c96-4132-8b81-e3882073aec3 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:01.523224 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6628451-231e-4820-8c5a-402fa9c1d0cf None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:01.537745 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19793244-9c96-4132-8b81-e3882073aec3 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:01.545859 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:01.552415 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:01.557957 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204a33d8-b554-4d7a-9af0-068d15804b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:01.559314 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204a33d8-b554-4d7a-9af0-068d15804b3c None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:01.559596 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204a33d8-b554-4d7a-9af0-068d15804b3c None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:01.559867 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204a33d8-b554-4d7a-9af0-068d15804b3c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:01.560611 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204a33d8-b554-4d7a-9af0-068d15804b3c None admin] RBAC: Adding query filter params (role.id=537cde5f25284acca3c3ea9ff806d724, scope.project.id=51af3a14d665498c9b7a35b34dac0ef1, user.id=8504425c3a414608b030d0cf1af78af5) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:01.560916 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204a33d8-b554-4d7a-9af0-068d15804b3c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:01.562333 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204a33d8-b554-4d7a-9af0-068d15804b3c None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:01.567529 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 289/574] 10.222.0.72 () {56 vars in 1374 bytes} [Mon Sep 19 14:44:01 2022] GET /identity/v3/role_assignments?user.id=8504425c3a414608b030d0cf1af78af5&scope.project.id=51af3a14d665498c9b7a35b34dac0ef1&role.id=537cde5f25284acca3c3ea9ff806d724 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:01.568756 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553b94a8-c0f1-47cd-8ac2-90195351d600 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:01.569046 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553b94a8-c0f1-47cd-8ac2-90195351d600 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:01.569320 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553b94a8-c0f1-47cd-8ac2-90195351d600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:01.574168 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45b15d6-80d4-48dc-95ff-851382ca06c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:01.574793 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45b15d6-80d4-48dc-95ff-851382ca06c1 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:01.575074 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45b15d6-80d4-48dc-95ff-851382ca06c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:01.575347 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45b15d6-80d4-48dc-95ff-851382ca06c1 None admin] PATH_INFO: `/v3/users` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:01.576104 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45b15d6-80d4-48dc-95ff-851382ca06c1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:01.576450 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45b15d6-80d4-48dc-95ff-851382ca06c1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:01.577935 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45b15d6-80d4-48dc-95ff-851382ca06c1 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:01.589476 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-553b94a8-c0f1-47cd-8ac2-90195351d600 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:44:01.590938 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-553b94a8-c0f1-47cd-8ac2-90195351d600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:44:01.603618 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 286/575] 10.222.0.72 () {56 vars in 1133 bytes} [Mon Sep 19 14:44:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:01.603618 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45b15d6-80d4-48dc-95ff-851382ca06c1 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:01.673294 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 290/576] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:44:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:44:01.674099 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553b94a8-c0f1-47cd-8ac2-90195351d600 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:01.732012 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45b15d6-80d4-48dc-95ff-851382ca06c1 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:01.784223 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717d3f97-9e01-4485-bf08-cb850f732880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:01.785397 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d3f97-9e01-4485-bf08-cb850f732880 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:01.786299 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d3f97-9e01-4485-bf08-cb850f732880 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:01.786852 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d3f97-9e01-4485-bf08-cb850f732880 None admin] PATH_INFO: `/v3/domains` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:01.787794 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717d3f97-9e01-4485-bf08-cb850f732880 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:01.788541 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717d3f97-9e01-4485-bf08-cb850f732880 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:01.790496 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717d3f97-9e01-4485-bf08-cb850f732880 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:01.804886 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553b94a8-c0f1-47cd-8ac2-90195351d600 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:01.812555 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 287/577] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Sep 19 14:44:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:01.812555 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717d3f97-9e01-4485-bf08-cb850f732880 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:01.829384 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:01.849748 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194def6b-a832-4d12-b0b9-b00a0987f212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:01.850373 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194def6b-a832-4d12-b0b9-b00a0987f212 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:01.850650 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194def6b-a832-4d12-b0b9-b00a0987f212 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:01.850922 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194def6b-a832-4d12-b0b9-b00a0987f212 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:01.855832 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:01.859385 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194def6b-a832-4d12-b0b9-b00a0987f212 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:01.860911 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194def6b-a832-4d12-b0b9-b00a0987f212 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:01.874000 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-194def6b-a832-4d12-b0b9-b00a0987f212 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 19 14:44:01.874000 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:01.874000 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:01.874000 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:01.874000 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:01.874000 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:01.874000 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:01.874000 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:01.874000 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:01.874000 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:01.874000 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:01.874000 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:01.874000 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 14:44:01.874000 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 14:44:01.874000 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 14:44:01.874000 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 14:44:01.874934 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:01.874934 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:01.874934 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:44:01.874934 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:44:01.874934 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:44:01.874934 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:44:01.874934 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:01.874934 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:01.874934 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:01.874934 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:01.874934 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:01.874934 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:01.874934 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:01.874934 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:01.874934 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:01.874934 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:01.874934 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:01.874934 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:01.875879 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:01.875879 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:01.875879 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 14:44:01.875879 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 14:44:01.875879 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 14:44:01.875879 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 14:44:01.875879 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 14:44:01.875879 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 14:44:01.875879 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 19 14:44:01.875879 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:44:01.875879 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 291/578] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Sep 19 14:44:01 2022] GET /identity/v3/users/glance => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:01.877120 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194def6b-a832-4d12-b0b9-b00a0987f212 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:01.957029 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717d3f97-9e01-4485-bf08-cb850f732880 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:01.997262 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fa7ebe-e144-4953-ae51-4f5d482deeef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:01.997899 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fa7ebe-e144-4953-ae51-4f5d482deeef None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:01.998182 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fa7ebe-e144-4953-ae51-4f5d482deeef None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:01.998454 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fa7ebe-e144-4953-ae51-4f5d482deeef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:02.004762 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194def6b-a832-4d12-b0b9-b00a0987f212 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:02.009922 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fa7ebe-e144-4953-ae51-4f5d482deeef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:02.011364 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fa7ebe-e144-4953-ae51-4f5d482deeef None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:02.028200 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-b8fa7ebe-e144-4953-ae51-4f5d482deeef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:44:02.028200 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:02.028200 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:02.028200 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:02.028200 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:02.028200 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:02.028200 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:02.028200 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:02.028200 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:02.028200 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:02.028200 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:02.028200 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:02.028200 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:44:02.028200 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:44:02.028200 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:44:02.028200 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:44:02.029364 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:02.029364 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:02.029364 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:02.029364 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:02.029364 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:02.029364 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:02.029364 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:02.029364 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:02.029364 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:02.029364 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:02.029364 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:02.029364 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:02.029364 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:02.029364 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:02.029364 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:02.029364 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:02.029364 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:44:02.030328 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:44:02.030328 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:44:02.030328 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:44:02.031762 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 288/579] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:44:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:02.032718 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fa7ebe-e144-4953-ae51-4f5d482deeef None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:02.049074 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de73f75-89ad-4b7f-9e1e-2a9cdd9c060f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:02.049980 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de73f75-89ad-4b7f-9e1e-2a9cdd9c060f None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:02.050263 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de73f75-89ad-4b7f-9e1e-2a9cdd9c060f None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:02.050534 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de73f75-89ad-4b7f-9e1e-2a9cdd9c060f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:02.058708 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de73f75-89ad-4b7f-9e1e-2a9cdd9c060f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:02.060365 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de73f75-89ad-4b7f-9e1e-2a9cdd9c060f None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:02.072010 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-5de73f75-89ad-4b7f-9e1e-2a9cdd9c060f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 19 14:44:02.072010 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:02.072010 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:02.072010 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:02.072010 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:02.072010 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:02.072010 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:02.072010 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:02.072010 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:02.072010 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:02.072010 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:02.072010 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:02.072010 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 14:44:02.072010 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 14:44:02.072010 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 14:44:02.072010 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 14:44:02.073129 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:02.073129 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:02.073129 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:44:02.073129 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:44:02.073129 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:44:02.073129 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:44:02.073129 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:02.073129 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:02.073129 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:02.073129 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:02.073129 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:02.073129 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:02.073129 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:02.073129 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:02.073129 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:02.073129 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:02.073129 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:02.073129 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:02.074647 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:02.074647 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:02.074647 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 14:44:02.074647 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 14:44:02.074647 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 14:44:02.074647 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 14:44:02.074647 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 14:44:02.074647 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 14:44:02.074647 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 19 14:44:02.074647 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:44:02.074647 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 292/580] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Sep 19 14:44:01 2022] GET /identity/v3/users/cinder => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:02.074647 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de73f75-89ad-4b7f-9e1e-2a9cdd9c060f None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:02.114740 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:02.130344 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:02.150148 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fa7ebe-e144-4953-ae51-4f5d482deeef None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:02.185824 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506bd5a9-8b41-4065-a731-8b2bfb04e98f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:02.186432 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506bd5a9-8b41-4065-a731-8b2bfb04e98f None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:02.186716 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506bd5a9-8b41-4065-a731-8b2bfb04e98f None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:02.186998 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506bd5a9-8b41-4065-a731-8b2bfb04e98f None admin] PATH_INFO: `/v3/users` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:02.187732 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506bd5a9-8b41-4065-a731-8b2bfb04e98f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:02.188040 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506bd5a9-8b41-4065-a731-8b2bfb04e98f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:02.189492 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506bd5a9-8b41-4065-a731-8b2bfb04e98f None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:02.190288 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de73f75-89ad-4b7f-9e1e-2a9cdd9c060f None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:02.213982 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 289/581] 10.222.0.72 () {56 vars in 1137 bytes} [Mon Sep 19 14:44:02 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:02.213982 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506bd5a9-8b41-4065-a731-8b2bfb04e98f None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:02.233527 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58495665-5d02-4fee-b1c7-586996861ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:02.234207 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58495665-5d02-4fee-b1c7-586996861ade None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:02.234493 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58495665-5d02-4fee-b1c7-586996861ade None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:02.235028 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58495665-5d02-4fee-b1c7-586996861ade None admin] PATH_INFO: `/v3/roles/service` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:02.245424 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58495665-5d02-4fee-b1c7-586996861ade None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:44:02.250809 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-58495665-5d02-4fee-b1c7-586996861ade None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:44:02.250809 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:02.250809 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:02.250809 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:02.250809 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:02.250809 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:02.250809 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:02.250809 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:02.250809 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:02.250809 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:02.250809 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:02.250809 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:02.250809 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:44:02.250809 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:44:02.250809 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:44:02.250809 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:44:02.251791 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:44:02.251791 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:44:02.251791 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:44:02.251791 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:44:02.251791 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:02.251791 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:02.251791 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:02.251791 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:02.251791 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:02.251791 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:02.251791 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:02.251791 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:02.251791 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:02.251791 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:02.251791 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:02.251791 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:02.252675 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:02.252675 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:02.252675 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:02.252675 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:02.252675 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:44:02.252675 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:44:02.252675 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:44:02.252675 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:44:02.252675 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:44:02.252675 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:44:02.252675 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:44:02.252675 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:44:02.252675 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 293/582] 10.222.0.72 () {56 vars in 1102 bytes} [Mon Sep 19 14:44:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:02.253346 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58495665-5d02-4fee-b1c7-586996861ade None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:02.323341 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506bd5a9-8b41-4065-a731-8b2bfb04e98f None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:02.352976 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:02.360032 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58495665-5d02-4fee-b1c7-586996861ade None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:02.363949 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a2415f-7da5-49e4-a51b-c41a2ee8b4b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:02.364592 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a2415f-7da5-49e4-a51b-c41a2ee8b4b0 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:02.364879 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a2415f-7da5-49e4-a51b-c41a2ee8b4b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:02.365156 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a2415f-7da5-49e4-a51b-c41a2ee8b4b0 None admin] PATH_INFO: `/v3/domains` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:02.365793 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a2415f-7da5-49e4-a51b-c41a2ee8b4b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:02.366100 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a2415f-7da5-49e4-a51b-c41a2ee8b4b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:02.367884 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a2415f-7da5-49e4-a51b-c41a2ee8b4b0 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:02.377255 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:02.385698 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 290/583] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Sep 19 14:44:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:02.386774 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a2415f-7da5-49e4-a51b-c41a2ee8b4b0 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:02.397635 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44824b89-8e16-4a58-aa42-4159ec0d2b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:02.398247 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44824b89-8e16-4a58-aa42-4159ec0d2b0d None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:02.398530 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44824b89-8e16-4a58-aa42-4159ec0d2b0d None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:02.398804 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44824b89-8e16-4a58-aa42-4159ec0d2b0d None admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:02.399525 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44824b89-8e16-4a58-aa42-4159ec0d2b0d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:02.399834 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44824b89-8e16-4a58-aa42-4159ec0d2b0d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:02.401286 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44824b89-8e16-4a58-aa42-4159ec0d2b0d None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:02.424372 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 294/584] 10.222.0.72 () {56 vars in 1137 bytes} [Mon Sep 19 14:44:02 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:02.424372 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44824b89-8e16-4a58-aa42-4159ec0d2b0d None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:02.508043 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a2415f-7da5-49e4-a51b-c41a2ee8b4b0 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:02.530809 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44824b89-8e16-4a58-aa42-4159ec0d2b0d None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:02.544684 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec582c3-8811-4b91-8b09-af05e4ebfd72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:02.545320 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec582c3-8811-4b91-8b09-af05e4ebfd72 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:02.545601 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec582c3-8811-4b91-8b09-af05e4ebfd72 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:02.545891 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec582c3-8811-4b91-8b09-af05e4ebfd72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:02.556469 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec582c3-8811-4b91-8b09-af05e4ebfd72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:02.559304 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec582c3-8811-4b91-8b09-af05e4ebfd72 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:02.566744 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af1650e-56de-460f-9127-9bb126b24b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:02.567345 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af1650e-56de-460f-9127-9bb126b24b3b None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:02.567628 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af1650e-56de-460f-9127-9bb126b24b3b None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:02.567903 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af1650e-56de-460f-9127-9bb126b24b3b None admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:02.568585 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af1650e-56de-460f-9127-9bb126b24b3b None admin] RBAC: Adding query filter params (name=service) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:02.568890 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af1650e-56de-460f-9127-9bb126b24b3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:02.570249 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af1650e-56de-460f-9127-9bb126b24b3b None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:02.579976 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 295/585] 10.222.0.72 () {56 vars in 1103 bytes} [Mon Sep 19 14:44:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:02.581008 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af1650e-56de-460f-9127-9bb126b24b3b None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:02.581233 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-0ec582c3-8811-4b91-8b09-af05e4ebfd72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:44:02.581233 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:02.581233 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:02.581233 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:02.581233 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:02.581233 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:02.581233 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:02.581233 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:02.581233 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:02.581233 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:02.581233 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:02.581233 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:02.581233 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:44:02.581233 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:44:02.581233 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:44:02.581233 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:44:02.582122 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:02.582122 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:02.582122 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:02.582122 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:02.582122 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:02.582122 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:02.582122 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:02.582122 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:02.582122 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:02.582122 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:02.582122 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:02.582122 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:02.582122 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:02.582122 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:02.582122 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:02.582122 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:02.582122 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:44:02.582999 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:44:02.582999 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:44:02.582999 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:44:02.586995 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 291/586] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:44:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:02.587853 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec582c3-8811-4b91-8b09-af05e4ebfd72 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:02.602713 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:02.642728 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:02.694313 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec582c3-8811-4b91-8b09-af05e4ebfd72 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:02.696471 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af1650e-56de-460f-9127-9bb126b24b3b None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:02.729400 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e07c4c5-c49f-44d8-bee0-de2ac87f1b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:02.730021 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e07c4c5-c49f-44d8-bee0-de2ac87f1b70 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:02.730838 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e07c4c5-c49f-44d8-bee0-de2ac87f1b70 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:02.731111 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e07c4c5-c49f-44d8-bee0-de2ac87f1b70 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:02.732597 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662dbbee-5ba4-420d-bd38-af458d89afdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:02.733601 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662dbbee-5ba4-420d-bd38-af458d89afdd None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:02.734024 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662dbbee-5ba4-420d-bd38-af458d89afdd None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:02.734439 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662dbbee-5ba4-420d-bd38-af458d89afdd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:02.737667 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e07c4c5-c49f-44d8-bee0-de2ac87f1b70 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:02.739109 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e07c4c5-c49f-44d8-bee0-de2ac87f1b70 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:02.745903 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662dbbee-5ba4-420d-bd38-af458d89afdd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:02.747473 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662dbbee-5ba4-420d-bd38-af458d89afdd None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:02.751434 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-2e07c4c5-c49f-44d8-bee0-de2ac87f1b70 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:44:02.751434 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:02.751434 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:02.751434 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:02.751434 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:02.751434 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:02.751434 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:02.751434 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:02.751434 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:02.751434 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:02.751434 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:02.751434 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:02.751434 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 14:44:02.751434 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 14:44:02.751434 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 14:44:02.752497 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 14:44:02.752497 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:02.752497 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:02.752497 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:02.752497 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:02.752497 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:02.752497 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:02.752497 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:02.752497 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:02.752497 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:02.752497 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:02.752497 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:02.752497 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:02.752497 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:02.752497 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:02.752497 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:02.752497 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:02.753401 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 14:44:02.753401 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 14:44:02.753401 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:44:02.753401 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:44:02.753401 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:44:02.753401 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:44:02.753401 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:44:02.753401 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:44:02.753401 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 296/587] 10.222.0.72 () {56 vars in 1111 bytes} [Mon Sep 19 14:44:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:02.753874 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e07c4c5-c49f-44d8-bee0-de2ac87f1b70 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:02.767188 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-662dbbee-5ba4-420d-bd38-af458d89afdd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:44:02.767188 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:02.767188 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:02.767188 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:02.767188 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:02.767188 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:02.767188 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:02.767188 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:02.767188 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:02.767188 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:02.767188 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:02.767188 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:02.767188 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:44:02.767188 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:44:02.767188 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:44:02.767188 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:44:02.768320 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:02.768320 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:02.768320 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:02.768320 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:02.768320 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:02.768320 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:02.768320 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:02.768320 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:02.768320 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:02.768320 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:02.768320 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:02.768320 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:02.768320 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:02.768320 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:02.768320 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:02.768320 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:02.768320 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:44:02.769393 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:44:02.769393 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:44:02.769393 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:44:02.770839 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 292/588] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:44:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:02.772006 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662dbbee-5ba4-420d-bd38-af458d89afdd None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:02.842423 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:02.872538 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e07c4c5-c49f-44d8-bee0-de2ac87f1b70 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:02.883689 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662dbbee-5ba4-420d-bd38-af458d89afdd None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:02.887450 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:02.916725 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74036fe-235f-4fbd-8463-9b64266a5e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:02.917361 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74036fe-235f-4fbd-8463-9b64266a5e14 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:02.917678 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74036fe-235f-4fbd-8463-9b64266a5e14 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:02.918147 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74036fe-235f-4fbd-8463-9b64266a5e14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:02.927205 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b4c76a-74cf-4530-afc4-b98d4a7367b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:02.927573 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4c76a-74cf-4530-afc4-b98d4a7367b3 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:02.927854 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4c76a-74cf-4530-afc4-b98d4a7367b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:02.928130 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4c76a-74cf-4530-afc4-b98d4a7367b3 None admin] PATH_INFO: `/v3/domains` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:02.928805 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b4c76a-74cf-4530-afc4-b98d4a7367b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:02.929111 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b4c76a-74cf-4530-afc4-b98d4a7367b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:02.929468 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74036fe-235f-4fbd-8463-9b64266a5e14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:02.930473 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b4c76a-74cf-4530-afc4-b98d4a7367b3 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:02.930985 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74036fe-235f-4fbd-8463-9b64266a5e14 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:02.947644 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 293/589] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Sep 19 14:44:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:02.947644 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b4c76a-74cf-4530-afc4-b98d4a7367b3 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:02.948363 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-e74036fe-235f-4fbd-8463-9b64266a5e14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:44:02.948363 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:02.948363 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:02.948363 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:02.948363 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:02.948363 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:02.948363 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:02.948363 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:02.948363 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:02.948363 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:02.948363 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:02.948363 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:02.948363 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:44:02.948363 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:44:02.948363 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:44:02.948363 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:44:02.949755 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:02.949755 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:02.949755 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:02.949755 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:02.949755 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:02.949755 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:02.949755 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:02.949755 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:02.949755 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:02.949755 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:02.949755 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:02.949755 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:02.949755 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:02.949755 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:02.949755 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:02.949755 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:02.949755 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:44:02.950639 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:44:02.950639 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:44:02.950639 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:44:02.950639 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 297/590] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:44:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:02.950639 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74036fe-235f-4fbd-8463-9b64266a5e14 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:03.057155 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b4c76a-74cf-4530-afc4-b98d4a7367b3 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:03.057997 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74036fe-235f-4fbd-8463-9b64266a5e14 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:03.084018 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:03.093589 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f263707-2c4f-4bb5-b25c-0d8c2664faa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:03.094197 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f263707-2c4f-4bb5-b25c-0d8c2664faa9 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:03.094489 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f263707-2c4f-4bb5-b25c-0d8c2664faa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:03.094752 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f263707-2c4f-4bb5-b25c-0d8c2664faa9 None admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:03.095388 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f263707-2c4f-4bb5-b25c-0d8c2664faa9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:03.095694 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f263707-2c4f-4bb5-b25c-0d8c2664faa9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:03.097099 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f263707-2c4f-4bb5-b25c-0d8c2664faa9 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:03.098462 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b19dec-f1d2-4b79-b7fd-2456dad8f73d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:03.099047 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b19dec-f1d2-4b79-b7fd-2456dad8f73d None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:03.099331 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b19dec-f1d2-4b79-b7fd-2456dad8f73d None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:03.099886 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b19dec-f1d2-4b79-b7fd-2456dad8f73d None admin] PATH_INFO: `/v3/projects` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:03.100284 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b19dec-f1d2-4b79-b7fd-2456dad8f73d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:03.100619 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b19dec-f1d2-4b79-b7fd-2456dad8f73d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:03.102019 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b19dec-f1d2-4b79-b7fd-2456dad8f73d None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:03.109821 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 298/591] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Sep 19 14:44:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:03.110443 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f263707-2c4f-4bb5-b25c-0d8c2664faa9 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:03.123418 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 294/592] 10.222.0.72 () {56 vars in 1148 bytes} [Mon Sep 19 14:44:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:03.123418 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b19dec-f1d2-4b79-b7fd-2456dad8f73d None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:03.151113 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:03.222741 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f263707-2c4f-4bb5-b25c-0d8c2664faa9 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:03.233403 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b19dec-f1d2-4b79-b7fd-2456dad8f73d None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:03.262375 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e7133d-d7b1-48c9-993c-65c1f6a76b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:03.263207 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e7133d-d7b1-48c9-993c-65c1f6a76b2b None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:03.263591 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e7133d-d7b1-48c9-993c-65c1f6a76b2b None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:03.263931 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e7133d-d7b1-48c9-993c-65c1f6a76b2b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:03.268416 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f05e84-eded-4615-9816-572ef2f8ed08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:03.269095 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f05e84-eded-4615-9816-572ef2f8ed08 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:03.269446 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f05e84-eded-4615-9816-572ef2f8ed08 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:03.269786 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f05e84-eded-4615-9816-572ef2f8ed08 None admin] PATH_INFO: `/v3/domains` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:03.270563 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f05e84-eded-4615-9816-572ef2f8ed08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:03.270864 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f05e84-eded-4615-9816-572ef2f8ed08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:03.271303 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e7133d-d7b1-48c9-993c-65c1f6a76b2b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:03.272395 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f05e84-eded-4615-9816-572ef2f8ed08 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:03.272914 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e7133d-d7b1-48c9-993c-65c1f6a76b2b None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:03.289181 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 295/593] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Sep 19 14:44:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:03.289380 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-b3e7133d-d7b1-48c9-993c-65c1f6a76b2b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:44:03.289380 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:03.289380 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:03.289380 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:03.289380 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:03.289380 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:03.289380 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:03.289380 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:03.289380 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:03.289380 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:03.289380 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:03.289380 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:03.289380 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 14:44:03.289380 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 14:44:03.289380 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 14:44:03.290938 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 14:44:03.290938 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:03.290938 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:03.290938 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:03.290938 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:03.290938 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:03.290938 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:03.290938 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:03.290938 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:03.290938 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:03.290938 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:03.290938 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:03.290938 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:03.290938 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:03.290938 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:03.290938 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:03.290938 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:03.292021 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 14:44:03.292021 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 14:44:03.292021 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:44:03.292021 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:44:03.292021 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:44:03.292021 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:44:03.292021 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:44:03.292021 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:44:03.292638 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f05e84-eded-4615-9816-572ef2f8ed08 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:03.292766 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 299/594] 10.222.0.72 () {56 vars in 1111 bytes} [Mon Sep 19 14:44:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:03.292766 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e7133d-d7b1-48c9-993c-65c1f6a76b2b None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:03.345532 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:03.384523 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:03.398412 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e7133d-d7b1-48c9-993c-65c1f6a76b2b None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:03.406841 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f05e84-eded-4615-9816-572ef2f8ed08 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:03.433845 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66c9183-ff8c-41a8-853e-a37a39197d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:03.434606 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66c9183-ff8c-41a8-853e-a37a39197d91 None admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:03.434886 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66c9183-ff8c-41a8-853e-a37a39197d91 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:03.435515 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66c9183-ff8c-41a8-853e-a37a39197d91 None admin] PATH_INFO: `/v3/projects/51af3a14d665498c9b7a35b34dac0ef1/users/055439dc35e946f4a82535c684f9b60d/roles/537cde5f25284acca3c3ea9ff806d724` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:03.448122 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c26bae2-b3a7-410a-9c43-0bedd196429c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:03.448776 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c26bae2-b3a7-410a-9c43-0bedd196429c None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:03.449083 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c26bae2-b3a7-410a-9c43-0bedd196429c None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:03.449358 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c26bae2-b3a7-410a-9c43-0bedd196429c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:03.452317 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66c9183-ff8c-41a8-853e-a37a39197d91 None admin] RBAC: Authorizing `identity:create_grant(project_id=51af3a14d665498c9b7a35b34dac0ef1, user_id=055439dc35e946f4a82535c684f9b60d, role_id=537cde5f25284acca3c3ea9ff806d724)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:03.453834 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66c9183-ff8c-41a8-853e-a37a39197d91 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:03.456161 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c26bae2-b3a7-410a-9c43-0bedd196429c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:03.457590 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c26bae2-b3a7-410a-9c43-0bedd196429c None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:03.466926 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 300/595] 10.222.0.72 () {58 vars in 1439 bytes} [Mon Sep 19 14:44:03 2022] PUT /identity/v3/projects/51af3a14d665498c9b7a35b34dac0ef1/users/055439dc35e946f4a82535c684f9b60d/roles/537cde5f25284acca3c3ea9ff806d724 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:44:03.467905 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66c9183-ff8c-41a8-853e-a37a39197d91 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:03.469689 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-5c26bae2-b3a7-410a-9c43-0bedd196429c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:44:03.469689 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:03.469689 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:03.469689 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:03.469689 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:03.469689 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:03.469689 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:03.469689 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:03.469689 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:03.469689 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:03.469689 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:03.469689 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:03.469689 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 14:44:03.469689 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 14:44:03.469689 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 14:44:03.470555 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 14:44:03.470555 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:03.470555 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:03.470555 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:03.470555 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:03.470555 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:03.470555 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:03.470555 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:03.470555 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:03.470555 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:03.470555 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:03.470555 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:03.470555 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:03.470555 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:03.470555 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:03.470555 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:03.470555 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:03.471424 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 14:44:03.471424 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 14:44:03.471424 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:44:03.471424 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:44:03.471424 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:44:03.471424 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:44:03.471424 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:44:03.471424 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:44:03.475809 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 296/596] 10.222.0.72 () {56 vars in 1111 bytes} [Mon Sep 19 14:44:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:03.477775 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c26bae2-b3a7-410a-9c43-0bedd196429c None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:03.598460 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:03.604664 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66c9183-ff8c-41a8-853e-a37a39197d91 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:03.611203 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c26bae2-b3a7-410a-9c43-0bedd196429c None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:03.652385 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642b3eb2-6c3d-4460-9c34-56792d572742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:03.652809 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faae4c69-7d3c-4979-89c6-b41b171f2629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:03.653060 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b3eb2-6c3d-4460-9c34-56792d572742 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:03.653343 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b3eb2-6c3d-4460-9c34-56792d572742 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:03.653788 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b3eb2-6c3d-4460-9c34-56792d572742 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:03.654135 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae4c69-7d3c-4979-89c6-b41b171f2629 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:03.654563 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae4c69-7d3c-4979-89c6-b41b171f2629 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:03.655087 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae4c69-7d3c-4979-89c6-b41b171f2629 None admin] PATH_INFO: `/v3/projects` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:03.655978 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faae4c69-7d3c-4979-89c6-b41b171f2629 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:03.656475 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faae4c69-7d3c-4979-89c6-b41b171f2629 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:03.658213 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faae4c69-7d3c-4979-89c6-b41b171f2629 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:03.662558 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642b3eb2-6c3d-4460-9c34-56792d572742 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:03.664030 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642b3eb2-6c3d-4460-9c34-56792d572742 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:03.674362 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 297/597] 10.222.0.72 () {56 vars in 1148 bytes} [Mon Sep 19 14:44:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:03.675469 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faae4c69-7d3c-4979-89c6-b41b171f2629 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:03.679613 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:03.680485 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-642b3eb2-6c3d-4460-9c34-56792d572742 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 19 14:44:03.680485 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:03.680485 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:03.680485 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:03.680485 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:03.680485 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:03.680485 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:03.680485 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:03.680485 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:03.680485 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:03.680485 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:03.680485 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:03.680485 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 14:44:03.680485 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 14:44:03.680485 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 14:44:03.680485 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 14:44:03.681480 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:03.681480 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:03.681480 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:44:03.681480 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:44:03.681480 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:44:03.681480 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:44:03.681480 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:03.681480 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:03.681480 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:03.681480 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:03.681480 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:03.681480 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:03.681480 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:03.681480 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:03.681480 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:03.681480 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:03.681480 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:03.681480 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:03.682718 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:03.682718 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:03.682718 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 14:44:03.682718 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 14:44:03.682718 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 14:44:03.682718 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 14:44:03.682718 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 14:44:03.682718 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 14:44:03.682718 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 19 14:44:03.682718 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:44:03.688475 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 301/598] 10.222.0.72 () {56 vars in 1102 bytes} [Mon Sep 19 14:44:03 2022] GET /identity/v3/users/neutron => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:03.689406 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642b3eb2-6c3d-4460-9c34-56792d572742 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:03.801317 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faae4c69-7d3c-4979-89c6-b41b171f2629 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:03.804230 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642b3eb2-6c3d-4460-9c34-56792d572742 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:03.836279 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a33e5ce-153a-4c0d-aafa-428f64921aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:03.836911 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a33e5ce-153a-4c0d-aafa-428f64921aac None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:03.837189 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a33e5ce-153a-4c0d-aafa-428f64921aac None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:03.837466 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a33e5ce-153a-4c0d-aafa-428f64921aac None admin] PATH_INFO: `/v3/projects` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:03.838142 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a33e5ce-153a-4c0d-aafa-428f64921aac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:03.838498 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a33e5ce-153a-4c0d-aafa-428f64921aac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:03.840653 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a33e5ce-153a-4c0d-aafa-428f64921aac None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:03.841600 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93014c94-2205-4a90-85ab-b1c383da9a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:03.842465 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93014c94-2205-4a90-85ab-b1c383da9a65 None admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:03.842997 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93014c94-2205-4a90-85ab-b1c383da9a65 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:03.843171 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93014c94-2205-4a90-85ab-b1c383da9a65 None admin] PATH_INFO: `/v3/projects/51af3a14d665498c9b7a35b34dac0ef1/users/4d6d4ecf8f4849939d6510a6228b29dc/roles/537cde5f25284acca3c3ea9ff806d724` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:03.857634 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 298/599] 10.222.0.72 () {56 vars in 1148 bytes} [Mon Sep 19 14:44:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:03.857634 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a33e5ce-153a-4c0d-aafa-428f64921aac None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:03.863310 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93014c94-2205-4a90-85ab-b1c383da9a65 None admin] RBAC: Authorizing `identity:create_grant(project_id=51af3a14d665498c9b7a35b34dac0ef1, user_id=4d6d4ecf8f4849939d6510a6228b29dc, role_id=537cde5f25284acca3c3ea9ff806d724)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:03.864781 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93014c94-2205-4a90-85ab-b1c383da9a65 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:03.884444 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 302/600] 10.222.0.72 () {58 vars in 1439 bytes} [Mon Sep 19 14:44:03 2022] PUT /identity/v3/projects/51af3a14d665498c9b7a35b34dac0ef1/users/4d6d4ecf8f4849939d6510a6228b29dc/roles/537cde5f25284acca3c3ea9ff806d724 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:44:03.888527 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9084f3a-dc70-4c6d-8924-46ad300244c0 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:03.889676 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9084f3a-dc70-4c6d-8924-46ad300244c0 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:03.890175 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9084f3a-dc70-4c6d-8924-46ad300244c0 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:03.896616 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 303/601] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:44:03 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:44:03.897916 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9084f3a-dc70-4c6d-8924-46ad300244c0 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:03.913837 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:03.960036 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:04.018142 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a33e5ce-153a-4c0d-aafa-428f64921aac None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:04.056035 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9084f3a-dc70-4c6d-8924-46ad300244c0 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:04.062974 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b33ec7-60d6-4ede-afa6-7862489b1e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:04.063596 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b33ec7-60d6-4ede-afa6-7862489b1e84 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:04.063872 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b33ec7-60d6-4ede-afa6-7862489b1e84 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:04.064141 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b33ec7-60d6-4ede-afa6-7862489b1e84 None admin] PATH_INFO: `/v3/users` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:04.064966 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b33ec7-60d6-4ede-afa6-7862489b1e84 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:04.065197 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b33ec7-60d6-4ede-afa6-7862489b1e84 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:04.066619 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b33ec7-60d6-4ede-afa6-7862489b1e84 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:04.088260 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 299/602] 10.222.0.72 () {56 vars in 1139 bytes} [Mon Sep 19 14:44:03 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:04.090143 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3243b13-3069-44bd-81f3-6e08e4bc52c6 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:04.090143 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3243b13-3069-44bd-81f3-6e08e4bc52c6 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:04.090143 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3243b13-3069-44bd-81f3-6e08e4bc52c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:04.106564 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4003a5aa-0049-43ec-a226-46ac71b3a8dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:04.107232 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4003a5aa-0049-43ec-a226-46ac71b3a8dd None admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:04.107510 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4003a5aa-0049-43ec-a226-46ac71b3a8dd None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:04.107827 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4003a5aa-0049-43ec-a226-46ac71b3a8dd None admin] PATH_INFO: `/v3/projects/51af3a14d665498c9b7a35b34dac0ef1/users/139dc7a4f1dc48fe8faea848bd1ac0f6/roles/537cde5f25284acca3c3ea9ff806d724` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:04.110167 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-c3243b13-3069-44bd-81f3-6e08e4bc52c6 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:44:04.111349 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-c3243b13-3069-44bd-81f3-6e08e4bc52c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:44:04.124073 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4003a5aa-0049-43ec-a226-46ac71b3a8dd None admin] RBAC: Authorizing `identity:create_grant(project_id=51af3a14d665498c9b7a35b34dac0ef1, user_id=139dc7a4f1dc48fe8faea848bd1ac0f6, role_id=537cde5f25284acca3c3ea9ff806d724)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:04.125998 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4003a5aa-0049-43ec-a226-46ac71b3a8dd None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:04.143765 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 304/603] 10.222.0.72 () {58 vars in 1439 bytes} [Mon Sep 19 14:44:03 2022] PUT /identity/v3/projects/51af3a14d665498c9b7a35b34dac0ef1/users/139dc7a4f1dc48fe8faea848bd1ac0f6/roles/537cde5f25284acca3c3ea9ff806d724 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:44:04.144627 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4003a5aa-0049-43ec-a226-46ac71b3a8dd None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:04.257598 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:04.262052 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 300/604] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:44:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:44:04.334140 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4003a5aa-0049-43ec-a226-46ac71b3a8dd None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:04.380234 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ddaf8f-383d-40d6-a91e-c6e7d2286cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:04.380817 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ddaf8f-383d-40d6-a91e-c6e7d2286cd1 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:04.381095 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ddaf8f-383d-40d6-a91e-c6e7d2286cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:04.381362 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ddaf8f-383d-40d6-a91e-c6e7d2286cd1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:04.395078 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ddaf8f-383d-40d6-a91e-c6e7d2286cd1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:04.396557 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ddaf8f-383d-40d6-a91e-c6e7d2286cd1 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:04.412661 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-14ddaf8f-383d-40d6-a91e-c6e7d2286cd1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:44:04.412661 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:04.412661 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:04.412661 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:04.412661 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:04.412661 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:04.412661 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:04.412661 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:04.412661 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:04.412661 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:04.412661 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:04.412661 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:04.412661 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:44:04.412661 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:44:04.412661 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:44:04.412661 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:44:04.413862 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:04.413862 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:04.413862 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:04.413862 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:04.413862 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:04.413862 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:04.413862 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:04.413862 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:04.413862 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:04.413862 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:04.413862 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:04.413862 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:04.413862 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:04.413862 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:04.413862 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:04.413862 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:04.413862 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:44:04.415266 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:44:04.415266 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:44:04.415266 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:44:04.415266 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 305/605] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:44:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:04.420235 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3243b13-3069-44bd-81f3-6e08e4bc52c6 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:04.475515 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:04.525479 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3243b13-3069-44bd-81f3-6e08e4bc52c6 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:04.561207 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c8f6f2-4b65-4ba6-bb75-eda1340129d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:04.561963 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c8f6f2-4b65-4ba6-bb75-eda1340129d9 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:04.562338 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c8f6f2-4b65-4ba6-bb75-eda1340129d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:04.562701 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c8f6f2-4b65-4ba6-bb75-eda1340129d9 None admin] PATH_INFO: `/v3/domains` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:04.563433 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c8f6f2-4b65-4ba6-bb75-eda1340129d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:04.563845 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c8f6f2-4b65-4ba6-bb75-eda1340129d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:04.565320 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c8f6f2-4b65-4ba6-bb75-eda1340129d9 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:04.577276 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 301/606] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Sep 19 14:44:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:04.585392 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ddaf8f-383d-40d6-a91e-c6e7d2286cd1 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:04.697769 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ddaf8f-383d-40d6-a91e-c6e7d2286cd1 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:04.709025 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:04.726231 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c8f6f2-4b65-4ba6-bb75-eda1340129d9 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:04.744187 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17788d42-4c02-4358-a016-24198bf30004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:04.744919 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17788d42-4c02-4358-a016-24198bf30004 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:04.745208 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17788d42-4c02-4358-a016-24198bf30004 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:04.745485 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17788d42-4c02-4358-a016-24198bf30004 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:04.759278 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17788d42-4c02-4358-a016-24198bf30004 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:04.760785 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17788d42-4c02-4358-a016-24198bf30004 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:04.789010 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-17788d42-4c02-4358-a016-24198bf30004 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:44:04.789010 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:04.789010 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:04.789010 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:04.789010 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:04.789010 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:04.789010 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:04.789010 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:04.789010 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:04.789010 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:04.789010 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:04.789010 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:04.789010 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 14:44:04.789010 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 14:44:04.789010 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 14:44:04.789949 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 14:44:04.789949 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:04.789949 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:04.789949 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:04.789949 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:04.789949 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:04.789949 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:04.789949 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:04.789949 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:04.789949 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:04.789949 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:04.789949 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:04.789949 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:04.789949 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:04.789949 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:04.789949 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:04.789949 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:04.790818 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 14:44:04.790818 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 14:44:04.790818 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:44:04.790818 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:44:04.790818 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:44:04.790818 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:44:04.790818 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:44:04.790818 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:44:04.791241 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 306/607] 10.222.0.72 () {56 vars in 1111 bytes} [Mon Sep 19 14:44:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:04.797619 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17788d42-4c02-4358-a016-24198bf30004 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:04.928638 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c8f6f2-4b65-4ba6-bb75-eda1340129d9 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:04.931780 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17788d42-4c02-4358-a016-24198bf30004 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:04.956567 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:05.002333 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e159bd-60d6-4c4b-9c55-cc4d7038d90a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:05.002972 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e159bd-60d6-4c4b-9c55-cc4d7038d90a None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:05.003257 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e159bd-60d6-4c4b-9c55-cc4d7038d90a None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:05.003533 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e159bd-60d6-4c4b-9c55-cc4d7038d90a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:05.004652 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7841ba1a-026a-43e5-8f89-c5d6206d4f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:05.005282 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7841ba1a-026a-43e5-8f89-c5d6206d4f19 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:05.005558 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7841ba1a-026a-43e5-8f89-c5d6206d4f19 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:05.005879 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7841ba1a-026a-43e5-8f89-c5d6206d4f19 None admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:05.006573 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7841ba1a-026a-43e5-8f89-c5d6206d4f19 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:05.006876 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7841ba1a-026a-43e5-8f89-c5d6206d4f19 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:05.008312 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7841ba1a-026a-43e5-8f89-c5d6206d4f19 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:05.026694 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e159bd-60d6-4c4b-9c55-cc4d7038d90a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:44:05.032198 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-54e159bd-60d6-4c4b-9c55-cc4d7038d90a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:44:05.032198 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:05.032198 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:05.032198 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:05.032198 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:05.032198 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:05.032198 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:05.032198 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:05.032198 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:05.032198 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:05.032198 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:05.032198 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:05.032198 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:44:05.032198 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:44:05.032198 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:44:05.032198 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:44:05.033230 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:44:05.033230 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:44:05.033230 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:44:05.033230 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:44:05.033230 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:05.033230 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:05.033230 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:05.033230 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:05.033230 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:05.033230 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:05.033230 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:05.033230 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:05.033230 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:05.033230 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:05.033230 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:05.033230 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:05.034057 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:05.034057 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:05.034057 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:05.034057 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:05.034057 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:44:05.034057 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:44:05.034057 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:44:05.034057 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:44:05.034057 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:44:05.034057 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:44:05.034057 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:44:05.034057 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:44:05.034057 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 302/608] 10.222.0.72 () {56 vars in 1102 bytes} [Mon Sep 19 14:44:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:44:05.037110 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 307/609] 10.222.0.72 () {56 vars in 1148 bytes} [Mon Sep 19 14:44:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:05.043340 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7841ba1a-026a-43e5-8f89-c5d6206d4f19 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:05.046609 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e159bd-60d6-4c4b-9c55-cc4d7038d90a None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:05.101029 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:05.213166 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7841ba1a-026a-43e5-8f89-c5d6206d4f19 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:05.250703 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e159bd-60d6-4c4b-9c55-cc4d7038d90a None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:05.252077 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deba8960-3995-4c5f-be74-f1b004f19c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:05.253013 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba8960-3995-4c5f-be74-f1b004f19c5b None admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:05.253296 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba8960-3995-4c5f-be74-f1b004f19c5b None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:05.253578 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba8960-3995-4c5f-be74-f1b004f19c5b None admin] PATH_INFO: `/v3/projects/51af3a14d665498c9b7a35b34dac0ef1/users/f4c2b78646374cb79ded4b7b59ba49c7/roles/537cde5f25284acca3c3ea9ff806d724` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:05.275512 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deba8960-3995-4c5f-be74-f1b004f19c5b None admin] RBAC: Authorizing `identity:create_grant(project_id=51af3a14d665498c9b7a35b34dac0ef1, user_id=f4c2b78646374cb79ded4b7b59ba49c7, role_id=537cde5f25284acca3c3ea9ff806d724)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:05.277872 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deba8960-3995-4c5f-be74-f1b004f19c5b None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:05.297146 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 308/610] 10.222.0.72 () {58 vars in 1439 bytes} [Mon Sep 19 14:44:05 2022] PUT /identity/v3/projects/51af3a14d665498c9b7a35b34dac0ef1/users/f4c2b78646374cb79ded4b7b59ba49c7/roles/537cde5f25284acca3c3ea9ff806d724 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:44:05.310508 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1d2634-7e67-4378-b06c-e429c63ce68d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:05.311140 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d2634-7e67-4378-b06c-e429c63ce68d None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:05.311428 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d2634-7e67-4378-b06c-e429c63ce68d None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:05.311706 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d2634-7e67-4378-b06c-e429c63ce68d None admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:05.312481 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1d2634-7e67-4378-b06c-e429c63ce68d None admin] RBAC: Adding query filter params (name=service) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:05.312791 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1d2634-7e67-4378-b06c-e429c63ce68d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:05.314324 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1d2634-7e67-4378-b06c-e429c63ce68d None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:05.325210 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 303/611] 10.222.0.72 () {56 vars in 1103 bytes} [Mon Sep 19 14:44:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:44:05.331054 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deba8960-3995-4c5f-be74-f1b004f19c5b None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:05.442339 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:05.469805 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deba8960-3995-4c5f-be74-f1b004f19c5b None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:05.508206 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aacd27-4258-454d-8ea1-befe5c93a2ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:05.508978 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aacd27-4258-454d-8ea1-befe5c93a2ec None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:05.509354 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aacd27-4258-454d-8ea1-befe5c93a2ec None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:05.509695 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aacd27-4258-454d-8ea1-befe5c93a2ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:05.522237 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aacd27-4258-454d-8ea1-befe5c93a2ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:05.524188 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aacd27-4258-454d-8ea1-befe5c93a2ec None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:05.542196 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-51aacd27-4258-454d-8ea1-befe5c93a2ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:44:05.542196 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:05.542196 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:05.542196 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:05.542196 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:05.542196 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:05.542196 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:05.542196 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:05.542196 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:05.542196 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:05.542196 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:05.542196 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:05.542196 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:44:05.542196 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:44:05.542196 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:44:05.542196 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:44:05.544945 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:05.544945 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:05.544945 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:05.544945 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:05.544945 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:05.544945 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:05.544945 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:05.544945 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:05.544945 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:05.544945 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:05.544945 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:05.544945 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:05.544945 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:05.544945 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:05.544945 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:05.544945 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:05.544945 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:44:05.546291 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:44:05.546291 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:44:05.546291 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:44:05.546291 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 309/612] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:44:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:05.553550 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1d2634-7e67-4378-b06c-e429c63ce68d None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:05.608931 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:05.703041 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1d2634-7e67-4378-b06c-e429c63ce68d None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:05.749204 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465b4492-a692-4328-9260-4dd247c72b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:05.749736 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465b4492-a692-4328-9260-4dd247c72b3f None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:05.750014 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465b4492-a692-4328-9260-4dd247c72b3f None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:05.750303 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465b4492-a692-4328-9260-4dd247c72b3f None admin] PATH_INFO: `/v3/domains` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:05.750919 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465b4492-a692-4328-9260-4dd247c72b3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:05.751230 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465b4492-a692-4328-9260-4dd247c72b3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:05.752590 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465b4492-a692-4328-9260-4dd247c72b3f None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:05.773576 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 304/613] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Sep 19 14:44:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:05.779977 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aacd27-4258-454d-8ea1-befe5c93a2ec None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:05.906060 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c72c9-582a-4e6c-868f-1d9f8be6a46b None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:05.906291 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c72c9-582a-4e6c-868f-1d9f8be6a46b None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:05.906434 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c72c9-582a-4e6c-868f-1d9f8be6a46b None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:05.908931 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 305/614] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:44:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:44:05.909065 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aacd27-4258-454d-8ea1-befe5c93a2ec None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:05.921767 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ce5a9-9cb7-4e5c-b025-32f92ae756a9 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:05.922052 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ce5a9-9cb7-4e5c-b025-32f92ae756a9 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:05.922315 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ce5a9-9cb7-4e5c-b025-32f92ae756a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:05.941170 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:05.957238 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-957ce5a9-9cb7-4e5c-b025-32f92ae756a9 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:44:05.958669 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a0ede5-cd7d-458b-a8f5-816555bcb994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:05.959308 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a0ede5-cd7d-458b-a8f5-816555bcb994 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:05.959585 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a0ede5-cd7d-458b-a8f5-816555bcb994 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:05.959851 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a0ede5-cd7d-458b-a8f5-816555bcb994 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:05.960815 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-957ce5a9-9cb7-4e5c-b025-32f92ae756a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:44:05.976783 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a0ede5-cd7d-458b-a8f5-816555bcb994 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:05.978315 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a0ede5-cd7d-458b-a8f5-816555bcb994 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:06.005390 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-f6a0ede5-cd7d-458b-a8f5-816555bcb994 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 19 14:44:06.005390 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:06.005390 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:06.005390 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:06.005390 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:06.005390 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:06.005390 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:06.005390 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:06.005390 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:06.005390 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:06.005390 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:06.005390 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:06.005390 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 14:44:06.005390 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 14:44:06.005390 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 14:44:06.005390 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 14:44:06.006373 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:06.006373 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:06.006373 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:44:06.006373 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:44:06.006373 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:44:06.006373 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:44:06.006373 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:06.006373 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:06.006373 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:06.006373 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:06.006373 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:06.006373 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:06.006373 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:06.006373 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:06.006373 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:06.006373 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:06.006373 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:06.006373 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:06.007945 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:06.007945 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:06.007945 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 14:44:06.007945 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 14:44:06.007945 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 14:44:06.007945 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 14:44:06.007945 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 14:44:06.007945 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 14:44:06.007945 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 19 14:44:06.007945 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:44:06.007945 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 310/615] 10.222.0.72 () {56 vars in 1096 bytes} [Mon Sep 19 14:44:05 2022] GET /identity/v3/users/swift => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:06.012290 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a0ede5-cd7d-458b-a8f5-816555bcb994 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:06.122835 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a0ede5-cd7d-458b-a8f5-816555bcb994 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:06.130928 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 306/616] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:44:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:44:06.188208 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf6afd5-a9fa-456b-862c-be1ba5e45274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:06.188845 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf6afd5-a9fa-456b-862c-be1ba5e45274 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:06.189124 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf6afd5-a9fa-456b-862c-be1ba5e45274 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:06.189397 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf6afd5-a9fa-456b-862c-be1ba5e45274 None admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:06.190173 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf6afd5-a9fa-456b-862c-be1ba5e45274 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:06.190529 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf6afd5-a9fa-456b-862c-be1ba5e45274 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:06.191944 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf6afd5-a9fa-456b-862c-be1ba5e45274 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:06.210296 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 311/617] 10.222.0.72 () {56 vars in 1135 bytes} [Mon Sep 19 14:44:06 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:44:06.216673 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957ce5a9-9cb7-4e5c-b025-32f92ae756a9 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:06.243345 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:06.320669 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957ce5a9-9cb7-4e5c-b025-32f92ae756a9 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:06.355567 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b745106-bb5d-4597-9180-4210c35964a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:06.356196 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b745106-bb5d-4597-9180-4210c35964a4 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:06.356497 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b745106-bb5d-4597-9180-4210c35964a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:06.356768 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b745106-bb5d-4597-9180-4210c35964a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:06.366941 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b745106-bb5d-4597-9180-4210c35964a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:06.368380 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b745106-bb5d-4597-9180-4210c35964a4 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:06.383972 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-2b745106-bb5d-4597-9180-4210c35964a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:44:06.383972 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:06.383972 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:06.383972 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:06.383972 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:06.383972 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:06.383972 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:06.383972 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:06.383972 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:06.383972 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:06.383972 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:06.383972 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:06.383972 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:44:06.383972 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:44:06.383972 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:44:06.383972 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:44:06.386321 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:06.386321 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:06.386321 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:06.386321 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:06.386321 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:06.386321 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:06.386321 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:06.386321 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:06.386321 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:06.386321 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:06.386321 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:06.386321 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:06.386321 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:06.386321 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:06.386321 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:06.386321 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:06.386321 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:44:06.389037 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:44:06.389037 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:44:06.389037 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:44:06.389037 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 307/618] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:44:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:44:06.391373 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf6afd5-a9fa-456b-862c-be1ba5e45274 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:06.457748 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:06.494620 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b745106-bb5d-4597-9180-4210c35964a4 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:06.543466 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf6afd5-a9fa-456b-862c-be1ba5e45274 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:06.615575 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:06.645354 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b745106-bb5d-4597-9180-4210c35964a4 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:06.646583 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdbaabd-0554-4fc0-a73d-de112b9c546c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:06.647267 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdbaabd-0554-4fc0-a73d-de112b9c546c None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:06.647551 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdbaabd-0554-4fc0-a73d-de112b9c546c None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:06.647824 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdbaabd-0554-4fc0-a73d-de112b9c546c None admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:06.648505 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdbaabd-0554-4fc0-a73d-de112b9c546c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:06.648810 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdbaabd-0554-4fc0-a73d-de112b9c546c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:06.650184 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdbaabd-0554-4fc0-a73d-de112b9c546c None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:06.678640 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 312/619] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Sep 19 14:44:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:06.684392 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdbaabd-0554-4fc0-a73d-de112b9c546c None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:06.690791 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05518c3-6122-4891-862f-187d02b06d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:06.691432 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05518c3-6122-4891-862f-187d02b06d03 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:06.691710 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05518c3-6122-4891-862f-187d02b06d03 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:06.692022 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05518c3-6122-4891-862f-187d02b06d03 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:06.712951 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05518c3-6122-4891-862f-187d02b06d03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:44:06.721128 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-a05518c3-6122-4891-862f-187d02b06d03 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:44:06.721128 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:06.721128 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:06.721128 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:06.721128 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:06.721128 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:06.721128 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:06.721128 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:06.721128 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:06.721128 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:06.721128 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:06.721128 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:06.721128 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:44:06.721128 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:44:06.721128 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:44:06.721128 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:44:06.722990 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:44:06.722990 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:44:06.722990 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:44:06.722990 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:44:06.722990 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:06.722990 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:06.722990 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:06.722990 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:06.722990 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:06.722990 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:06.722990 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:06.722990 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:06.722990 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:06.722990 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:06.722990 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:06.722990 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:06.723881 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:06.723881 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:06.723881 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:06.723881 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:06.723881 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:44:06.723881 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:44:06.723881 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:44:06.723881 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:44:06.723881 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:44:06.723881 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:44:06.723881 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:44:06.723881 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:44:06.723881 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 308/620] 10.222.0.72 () {56 vars in 1102 bytes} [Mon Sep 19 14:44:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:44:06.729999 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05518c3-6122-4891-862f-187d02b06d03 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:06.826854 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdbaabd-0554-4fc0-a73d-de112b9c546c None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:06.839038 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:06.861120 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05518c3-6122-4891-862f-187d02b06d03 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:06.879313 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfea39d8-26be-4652-a39a-3a42f775ce13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:06.880226 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfea39d8-26be-4652-a39a-3a42f775ce13 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:06.880548 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfea39d8-26be-4652-a39a-3a42f775ce13 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:06.880827 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfea39d8-26be-4652-a39a-3a42f775ce13 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:06.890583 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfea39d8-26be-4652-a39a-3a42f775ce13 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:06.892200 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfea39d8-26be-4652-a39a-3a42f775ce13 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:06.904145 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e674d0-e9cc-42c9-9dab-edad488e24bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:06.904783 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e674d0-e9cc-42c9-9dab-edad488e24bc None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:06.905683 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-cfea39d8-26be-4652-a39a-3a42f775ce13 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:44:06.905683 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:06.905683 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:06.905683 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:06.905683 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:06.905683 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:06.905683 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:06.905683 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:06.905683 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:06.905683 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:06.905683 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:06.905683 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:06.905683 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 14:44:06.905683 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 14:44:06.905683 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 14:44:06.906733 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 14:44:06.906733 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:06.906733 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:06.906733 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:06.906733 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:06.906733 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:06.906733 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:06.906733 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:06.906733 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:06.906733 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:06.906733 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:06.906733 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:06.906733 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:06.906733 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:06.906733 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:06.906733 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:06.906733 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:06.907795 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 14:44:06.907795 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 14:44:06.907795 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:44:06.907795 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:44:06.907795 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:44:06.907795 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:44:06.907795 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:44:06.907795 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:44:06.907795 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 313/621] 10.222.0.72 () {56 vars in 1111 bytes} [Mon Sep 19 14:44:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:44:06.908420 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e674d0-e9cc-42c9-9dab-edad488e24bc None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:06.908420 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e674d0-e9cc-42c9-9dab-edad488e24bc None admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:06.908591 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e4bbe5-5af6-4088-8755-70c0efe2cd13 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:06.908591 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e4bbe5-5af6-4088-8755-70c0efe2cd13 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:06.908752 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e674d0-e9cc-42c9-9dab-edad488e24bc None admin] RBAC: Adding query filter params (name=service) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:06.908835 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e4bbe5-5af6-4088-8755-70c0efe2cd13 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:06.913724 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e674d0-e9cc-42c9-9dab-edad488e24bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:06.914544 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 314/622] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:44:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:44:06.914706 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e674d0-e9cc-42c9-9dab-edad488e24bc None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:06.916704 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:06.919871 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e4bbe5-5af6-4088-8755-70c0efe2cd13 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:06.927132 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 309/623] 10.222.0.72 () {56 vars in 1103 bytes} [Mon Sep 19 14:44:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:06.928403 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c6a970-7e23-46ef-b410-03739210b345 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:06.928691 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c6a970-7e23-46ef-b410-03739210b345 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:06.928961 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c6a970-7e23-46ef-b410-03739210b345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:06.953806 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-27c6a970-7e23-46ef-b410-03739210b345 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:44:06.955605 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-27c6a970-7e23-46ef-b410-03739210b345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:44:07.032710 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e4bbe5-5af6-4088-8755-70c0efe2cd13 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:07.035981 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 310/624] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:44:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:44:07.036852 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c6a970-7e23-46ef-b410-03739210b345 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:07.073785 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2bf266-46f3-4390-bdcf-7550b6c31efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:07.074606 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2bf266-46f3-4390-bdcf-7550b6c31efe None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:07.074892 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2bf266-46f3-4390-bdcf-7550b6c31efe None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:07.075165 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2bf266-46f3-4390-bdcf-7550b6c31efe None admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:07.075849 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2bf266-46f3-4390-bdcf-7550b6c31efe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:07.076159 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2bf266-46f3-4390-bdcf-7550b6c31efe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:07.077812 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2bf266-46f3-4390-bdcf-7550b6c31efe None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:07.091308 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 315/625] 10.222.0.72 () {56 vars in 1148 bytes} [Mon Sep 19 14:44:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:07.092765 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b755387-3db4-43e3-bc95-d77142cae46c None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:07.093048 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b755387-3db4-43e3-bc95-d77142cae46c None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:07.093318 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b755387-3db4-43e3-bc95-d77142cae46c None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:07.098963 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 316/626] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:44:07 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:44:07.099709 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b755387-3db4-43e3-bc95-d77142cae46c None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:07.137578 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:07.155271 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c6a970-7e23-46ef-b410-03739210b345 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:07.186020 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:07.196047 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839c01ef-8289-4963-bfbb-c45a97c6125f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:07.196890 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839c01ef-8289-4963-bfbb-c45a97c6125f None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:07.197346 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839c01ef-8289-4963-bfbb-c45a97c6125f None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:07.197764 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839c01ef-8289-4963-bfbb-c45a97c6125f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:07.209419 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839c01ef-8289-4963-bfbb-c45a97c6125f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:07.211242 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839c01ef-8289-4963-bfbb-c45a97c6125f None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:07.227264 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-839c01ef-8289-4963-bfbb-c45a97c6125f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:44:07.227264 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:07.227264 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:07.227264 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:07.227264 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:07.227264 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:07.227264 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:07.227264 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:07.227264 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:07.227264 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:07.227264 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:07.227264 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:07.227264 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:44:07.227264 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:44:07.227264 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:44:07.227264 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:44:07.228464 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:07.228464 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:07.228464 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:07.228464 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:07.228464 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:07.228464 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:07.228464 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:07.228464 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:07.228464 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:07.228464 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:07.228464 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:07.228464 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:07.228464 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:07.228464 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:07.228464 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:07.228464 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:07.228464 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:44:07.229571 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:44:07.229571 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:44:07.229571 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:44:07.229778 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b755387-3db4-43e3-bc95-d77142cae46c None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:07.231975 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 311/627] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:44:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:07.233531 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ad477-dfc2-4058-84b1-a8f44f3d72fc None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:07.233816 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ad477-dfc2-4058-84b1-a8f44f3d72fc None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:07.234085 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ad477-dfc2-4058-84b1-a8f44f3d72fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:07.253389 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-a49ad477-dfc2-4058-84b1-a8f44f3d72fc None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:44:07.254582 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-a49ad477-dfc2-4058-84b1-a8f44f3d72fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:44:07.273276 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de85d3d-f2cf-4aed-9d25-97353ed7a727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:07.274737 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de85d3d-f2cf-4aed-9d25-97353ed7a727 None admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:07.275232 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de85d3d-f2cf-4aed-9d25-97353ed7a727 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:07.275704 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de85d3d-f2cf-4aed-9d25-97353ed7a727 None admin] PATH_INFO: `/v3/projects/51af3a14d665498c9b7a35b34dac0ef1/users/8504425c3a414608b030d0cf1af78af5/roles/537cde5f25284acca3c3ea9ff806d724` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:07.296129 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de85d3d-f2cf-4aed-9d25-97353ed7a727 None admin] RBAC: Authorizing `identity:create_grant(project_id=51af3a14d665498c9b7a35b34dac0ef1, user_id=8504425c3a414608b030d0cf1af78af5, role_id=537cde5f25284acca3c3ea9ff806d724)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:07.297973 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de85d3d-f2cf-4aed-9d25-97353ed7a727 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:07.316915 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 317/628] 10.222.0.72 () {58 vars in 1439 bytes} [Mon Sep 19 14:44:07 2022] PUT /identity/v3/projects/51af3a14d665498c9b7a35b34dac0ef1/users/8504425c3a414608b030d0cf1af78af5/roles/537cde5f25284acca3c3ea9ff806d724 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:44:07.318538 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de85d3d-f2cf-4aed-9d25-97353ed7a727 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:07.331964 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 312/629] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:44:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:44:07.359890 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49ad477-dfc2-4058-84b1-a8f44f3d72fc None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:07.428175 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:07.455652 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de85d3d-f2cf-4aed-9d25-97353ed7a727 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:07.498590 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53d2537-25ab-4f62-b95b-cab82ebab4cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:07.499578 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d2537-25ab-4f62-b95b-cab82ebab4cc None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:07.500078 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d2537-25ab-4f62-b95b-cab82ebab4cc None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:07.500572 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d2537-25ab-4f62-b95b-cab82ebab4cc None admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:07.501446 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53d2537-25ab-4f62-b95b-cab82ebab4cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:07.501956 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53d2537-25ab-4f62-b95b-cab82ebab4cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:07.503526 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53d2537-25ab-4f62-b95b-cab82ebab4cc None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:07.518951 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 318/630] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Sep 19 14:44:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:07.525575 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53d2537-25ab-4f62-b95b-cab82ebab4cc None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:07.553019 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49ad477-dfc2-4058-84b1-a8f44f3d72fc None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:07.565940 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:07.595909 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c8a7d2-3b94-47db-ac6b-252b1878c096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:07.596769 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c8a7d2-3b94-47db-ac6b-252b1878c096 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:07.597050 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c8a7d2-3b94-47db-ac6b-252b1878c096 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:07.598110 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c8a7d2-3b94-47db-ac6b-252b1878c096 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:07.613376 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c8a7d2-3b94-47db-ac6b-252b1878c096 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:44:07.618329 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-44c8a7d2-3b94-47db-ac6b-252b1878c096 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:44:07.618329 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:07.618329 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:07.618329 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:07.618329 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:07.618329 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:07.618329 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:07.618329 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:07.618329 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:07.618329 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:07.618329 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:07.618329 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:07.618329 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:44:07.618329 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:44:07.618329 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:44:07.618329 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:44:07.619234 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:44:07.619234 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:44:07.619234 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:44:07.619234 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:44:07.619234 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:07.619234 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:07.619234 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:07.619234 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:07.619234 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:07.619234 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:07.619234 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:07.619234 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:07.619234 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:07.619234 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:07.619234 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:07.619234 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:07.620065 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:07.620065 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:07.620065 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:07.620065 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:07.620065 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:44:07.620065 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:44:07.620065 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:44:07.620065 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:44:07.620065 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:44:07.620065 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:44:07.620065 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:44:07.620065 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:44:07.620065 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 313/631] 10.222.0.72 () {56 vars in 1102 bytes} [Mon Sep 19 14:44:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:44:07.629306 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c8a7d2-3b94-47db-ac6b-252b1878c096 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:07.658125 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53d2537-25ab-4f62-b95b-cab82ebab4cc None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:07.702099 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b594e8-ffd1-468b-81d7-79e306a9b26d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:07.703121 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b594e8-ffd1-468b-81d7-79e306a9b26d None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:07.703603 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b594e8-ffd1-468b-81d7-79e306a9b26d None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:07.704070 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b594e8-ffd1-468b-81d7-79e306a9b26d None admin] PATH_INFO: `/v3/users/nova` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:07.714257 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b594e8-ffd1-468b-81d7-79e306a9b26d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:07.724696 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b594e8-ffd1-468b-81d7-79e306a9b26d None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:07.728037 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:07.738656 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c8a7d2-3b94-47db-ac6b-252b1878c096 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:07.739618 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-b3b594e8-ffd1-468b-81d7-79e306a9b26d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 19 14:44:07.739618 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:07.739618 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:07.739618 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:07.739618 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:07.739618 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:07.739618 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:07.739618 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:07.739618 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:07.739618 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:07.739618 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:07.739618 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:07.739618 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 14:44:07.739618 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 14:44:07.739618 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 14:44:07.739618 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 14:44:07.740587 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:07.740587 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:07.740587 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:44:07.740587 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:44:07.740587 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:44:07.740587 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:44:07.740587 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:07.740587 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:07.740587 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:07.740587 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:07.740587 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:07.740587 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:07.740587 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:07.740587 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:07.740587 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:07.740587 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:07.740587 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:07.740587 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:07.741528 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:07.741528 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:07.741528 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 14:44:07.741528 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 14:44:07.741528 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 14:44:07.741528 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 14:44:07.741528 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 14:44:07.741528 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 14:44:07.741528 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 19 14:44:07.741528 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:44:07.744026 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 319/632] 10.222.0.72 () {56 vars in 1093 bytes} [Mon Sep 19 14:44:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:07.749163 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b594e8-ffd1-468b-81d7-79e306a9b26d None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:07.775010 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d2d994-848d-4521-a03e-bbc53c52c01c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:07.775526 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d2d994-848d-4521-a03e-bbc53c52c01c None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:07.775812 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d2d994-848d-4521-a03e-bbc53c52c01c None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:07.776083 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d2d994-848d-4521-a03e-bbc53c52c01c None admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:07.777574 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d2d994-848d-4521-a03e-bbc53c52c01c None admin] RBAC: Adding query filter params (name=service) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:07.777736 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d2d994-848d-4521-a03e-bbc53c52c01c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:07.779054 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d2d994-848d-4521-a03e-bbc53c52c01c None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:07.788516 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 314/633] 10.222.0.72 () {56 vars in 1103 bytes} [Mon Sep 19 14:44:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:07.788965 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d2d994-848d-4521-a03e-bbc53c52c01c None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:07.823145 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:07.857682 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b594e8-ffd1-468b-81d7-79e306a9b26d None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:07.897886 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844ec114-6bee-4953-8713-a76baa5d3002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:07.898385 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d2d994-848d-4521-a03e-bbc53c52c01c None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:07.898770 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844ec114-6bee-4953-8713-a76baa5d3002 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:07.899145 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844ec114-6bee-4953-8713-a76baa5d3002 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:07.899515 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844ec114-6bee-4953-8713-a76baa5d3002 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:07.921611 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844ec114-6bee-4953-8713-a76baa5d3002 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:44:07.929484 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-844ec114-6bee-4953-8713-a76baa5d3002 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:44:07.929484 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:07.929484 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:07.929484 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:07.929484 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:07.929484 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:07.929484 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:07.929484 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:07.929484 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:07.929484 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:07.929484 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:07.929484 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:07.929484 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:44:07.929484 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:44:07.929484 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:44:07.929484 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:44:07.930504 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:44:07.930504 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:44:07.930504 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:44:07.930504 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:44:07.930504 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:07.930504 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:07.930504 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:07.930504 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:07.930504 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:07.930504 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:07.930504 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:07.930504 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:07.930504 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:07.930504 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:07.930504 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:07.930504 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:07.931341 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:07.931341 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:07.931341 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:07.931341 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:07.931341 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:44:07.931341 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:44:07.931341 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:44:07.931341 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:44:07.931341 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:44:07.931341 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:44:07.931341 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:44:07.931341 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:44:07.935278 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 320/634] 10.222.0.72 () {56 vars in 1102 bytes} [Mon Sep 19 14:44:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:07.936506 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844ec114-6bee-4953-8713-a76baa5d3002 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:07.951372 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2d7cb2-4305-49fc-824f-1790ff54a984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:07.952071 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d7cb2-4305-49fc-824f-1790ff54a984 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:07.952496 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d7cb2-4305-49fc-824f-1790ff54a984 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:07.952784 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d7cb2-4305-49fc-824f-1790ff54a984 None admin] PATH_INFO: `/v3/users` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:07.953641 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2d7cb2-4305-49fc-824f-1790ff54a984 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:07.953939 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2d7cb2-4305-49fc-824f-1790ff54a984 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:07.955425 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2d7cb2-4305-49fc-824f-1790ff54a984 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:07.978629 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 315/635] 10.222.0.72 () {56 vars in 1133 bytes} [Mon Sep 19 14:44:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:07.979630 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2d7cb2-4305-49fc-824f-1790ff54a984 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:08.033302 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:08.050607 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844ec114-6bee-4953-8713-a76baa5d3002 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:08.087530 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bb749f-850d-408e-8838-b6e12916978d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:08.088122 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:08.088466 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bb749f-850d-408e-8838-b6e12916978d None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:08.088750 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bb749f-850d-408e-8838-b6e12916978d None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:08.089032 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bb749f-850d-408e-8838-b6e12916978d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:08.100628 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2d7cb2-4305-49fc-824f-1790ff54a984 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:08.101039 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bb749f-850d-408e-8838-b6e12916978d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:08.102500 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bb749f-850d-408e-8838-b6e12916978d None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:08.117551 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-44bb749f-850d-408e-8838-b6e12916978d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:44:08.117551 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:08.117551 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:08.117551 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:08.117551 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:08.117551 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:08.117551 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:08.117551 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:08.117551 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:08.117551 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:08.117551 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:08.117551 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:08.117551 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:44:08.117551 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:44:08.117551 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:44:08.117551 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:44:08.118723 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:08.118723 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:08.118723 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:08.118723 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:08.118723 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:08.118723 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:08.118723 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:08.118723 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:08.118723 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:08.118723 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:08.118723 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:08.118723 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:08.118723 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:08.118723 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:08.118723 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:08.118723 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:08.118723 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:44:08.119616 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:44:08.119616 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:44:08.119616 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:44:08.119616 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 321/636] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:44:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:08.119616 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bb749f-850d-408e-8838-b6e12916978d None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:08.145535 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f01384-eb8c-4cd8-b55c-2f103e8c4290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:08.146145 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f01384-eb8c-4cd8-b55c-2f103e8c4290 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:08.146416 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f01384-eb8c-4cd8-b55c-2f103e8c4290 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:08.146867 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f01384-eb8c-4cd8-b55c-2f103e8c4290 None admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:08.147342 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f01384-eb8c-4cd8-b55c-2f103e8c4290 None admin] RBAC: Adding query filter params (name=service) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:08.147650 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f01384-eb8c-4cd8-b55c-2f103e8c4290 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:08.149026 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f01384-eb8c-4cd8-b55c-2f103e8c4290 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:08.163346 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 316/637] 10.222.0.72 () {56 vars in 1103 bytes} [Mon Sep 19 14:44:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:08.163346 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2cb08b-9aab-44be-91e3-19c10c9106d2 None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:08.163346 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2cb08b-9aab-44be-91e3-19c10c9106d2 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:08.163346 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2cb08b-9aab-44be-91e3-19c10c9106d2 None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:08.163346 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 317/638] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:44:08 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:44:08.163346 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2cb08b-9aab-44be-91e3-19c10c9106d2 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:08.229203 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bb749f-850d-408e-8838-b6e12916978d None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:08.242705 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:08.265345 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb7d797-44ae-442f-82d5-85703a30f1f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:08.265947 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb7d797-44ae-442f-82d5-85703a30f1f6 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:08.266224 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb7d797-44ae-442f-82d5-85703a30f1f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:08.266490 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb7d797-44ae-442f-82d5-85703a30f1f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:08.274263 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2cb08b-9aab-44be-91e3-19c10c9106d2 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:08.311623 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d74e51-8dae-43ef-beba-a8a2ab75bd08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:08.312229 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d74e51-8dae-43ef-beba-a8a2ab75bd08 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:08.312534 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d74e51-8dae-43ef-beba-a8a2ab75bd08 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:08.312803 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d74e51-8dae-43ef-beba-a8a2ab75bd08 None admin] PATH_INFO: `/v3/domains` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:08.313435 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d74e51-8dae-43ef-beba-a8a2ab75bd08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:08.313732 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d74e51-8dae-43ef-beba-a8a2ab75bd08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:08.315221 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d74e51-8dae-43ef-beba-a8a2ab75bd08 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:08.332735 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 318/639] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Sep 19 14:44:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:08.333641 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d74e51-8dae-43ef-beba-a8a2ab75bd08 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:08.339194 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb7d797-44ae-442f-82d5-85703a30f1f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:08.340719 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb7d797-44ae-442f-82d5-85703a30f1f6 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:08.348776 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:08.450465 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 322/640] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Sep 19 14:44:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 14:44:08.450931 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d74e51-8dae-43ef-beba-a8a2ab75bd08 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:08.452094 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd4564c-ea44-4d3d-a79d-67857153993d None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:08.452563 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd4564c-ea44-4d3d-a79d-67857153993d None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:08.452831 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd4564c-ea44-4d3d-a79d-67857153993d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:08.470607 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-ccd4564c-ea44-4d3d-a79d-67857153993d None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:44:08.471774 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-ccd4564c-ea44-4d3d-a79d-67857153993d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:44:08.479190 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:08.490808 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603850fb-d35a-4983-8608-c5ef9c4ac034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:08.491379 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603850fb-d35a-4983-8608-c5ef9c4ac034 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:08.491653 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603850fb-d35a-4983-8608-c5ef9c4ac034 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:08.491927 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603850fb-d35a-4983-8608-c5ef9c4ac034 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:08.502312 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603850fb-d35a-4983-8608-c5ef9c4ac034 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:08.503733 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603850fb-d35a-4983-8608-c5ef9c4ac034 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:08.518155 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-603850fb-d35a-4983-8608-c5ef9c4ac034 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:44:08.518155 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:08.518155 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:08.518155 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:08.518155 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:08.518155 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:08.518155 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:08.518155 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:08.518155 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:08.518155 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:08.518155 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:08.518155 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:08.518155 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:44:08.518155 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:44:08.518155 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:44:08.518155 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:44:08.519246 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:08.519246 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:08.519246 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:08.519246 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:08.519246 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:08.519246 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:08.519246 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:08.519246 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:08.519246 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:08.519246 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:08.519246 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:08.519246 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:08.519246 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:08.519246 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:08.519246 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:08.519246 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:08.519246 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:44:08.520121 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:44:08.520121 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:44:08.520121 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:44:08.520121 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 319/641] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:44:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:08.520389 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603850fb-d35a-4983-8608-c5ef9c4ac034 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:08.550023 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 323/642] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:44:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:44:08.551095 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd4564c-ea44-4d3d-a79d-67857153993d None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:08.598322 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:08.640453 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603850fb-d35a-4983-8608-c5ef9c4ac034 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:08.674551 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd4564c-ea44-4d3d-a79d-67857153993d None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:08.678061 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a35725c-7d30-4d70-9b82-fc49983ca35e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:08.678967 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a35725c-7d30-4d70-9b82-fc49983ca35e None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:08.679420 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a35725c-7d30-4d70-9b82-fc49983ca35e None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:08.679898 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a35725c-7d30-4d70-9b82-fc49983ca35e None admin] PATH_INFO: `/v3/users/glance` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:08.688860 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a35725c-7d30-4d70-9b82-fc49983ca35e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:08.690620 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a35725c-7d30-4d70-9b82-fc49983ca35e None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:08.703462 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-1a35725c-7d30-4d70-9b82-fc49983ca35e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 19 14:44:08.703462 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:08.703462 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:08.703462 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:08.703462 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:08.703462 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:08.703462 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:08.703462 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:08.703462 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:08.703462 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:08.703462 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:08.703462 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:08.703462 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 14:44:08.703462 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 14:44:08.703462 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 14:44:08.703462 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 14:44:08.704491 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:08.704491 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:08.704491 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:44:08.704491 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:44:08.704491 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:44:08.704491 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:44:08.704491 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:08.704491 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:08.704491 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:08.704491 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:08.704491 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:08.704491 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:08.704491 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:08.704491 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:08.704491 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:08.704491 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:08.704491 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:08.704491 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:08.705419 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:08.705419 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:08.705419 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 14:44:08.705419 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 14:44:08.705419 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 14:44:08.705419 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 14:44:08.705419 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 14:44:08.705419 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 14:44:08.705419 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 19 14:44:08.705419 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:44:08.707907 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 320/643] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Sep 19 14:44:08 2022] GET /identity/v3/users/glance => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:08.708905 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a35725c-7d30-4d70-9b82-fc49983ca35e None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:08.715163 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc54396-f873-4eca-a65d-e7e0512b52ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:08.715884 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc54396-f873-4eca-a65d-e7e0512b52ca None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:08.716227 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc54396-f873-4eca-a65d-e7e0512b52ca None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:08.716588 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc54396-f873-4eca-a65d-e7e0512b52ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:08.727192 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc54396-f873-4eca-a65d-e7e0512b52ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:08.728956 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc54396-f873-4eca-a65d-e7e0512b52ca None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:08.732668 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:08.746972 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-bcc54396-f873-4eca-a65d-e7e0512b52ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:44:08.746972 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:08.746972 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:08.746972 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:08.746972 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:08.746972 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:08.746972 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:08.746972 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:08.746972 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:08.746972 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:08.746972 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:08.746972 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:08.746972 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:44:08.746972 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:44:08.746972 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:44:08.746972 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:44:08.747895 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:08.747895 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:08.747895 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:08.747895 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:08.747895 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:08.747895 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:08.747895 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:08.747895 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:08.747895 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:08.747895 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:08.747895 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:08.747895 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:08.747895 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:08.747895 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:08.747895 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:08.747895 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:08.747895 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:44:08.748978 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:44:08.748978 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:44:08.748978 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:44:08.751299 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 324/644] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:44:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:08.752480 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc54396-f873-4eca-a65d-e7e0512b52ca None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:08.816246 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a35725c-7d30-4d70-9b82-fc49983ca35e None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:08.841696 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:08.853588 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90078dd-54dd-4f8f-9449-d17ff1ccc7aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:08.854542 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90078dd-54dd-4f8f-9449-d17ff1ccc7aa None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:08.854886 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90078dd-54dd-4f8f-9449-d17ff1ccc7aa None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:08.855331 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90078dd-54dd-4f8f-9449-d17ff1ccc7aa None admin] PATH_INFO: `/v3/domains` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:08.856114 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90078dd-54dd-4f8f-9449-d17ff1ccc7aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:08.856446 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90078dd-54dd-4f8f-9449-d17ff1ccc7aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:08.857803 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90078dd-54dd-4f8f-9449-d17ff1ccc7aa None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:08.869623 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 321/645] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Sep 19 14:44:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:08.870422 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90078dd-54dd-4f8f-9449-d17ff1ccc7aa None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:08.883787 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc54396-f873-4eca-a65d-e7e0512b52ca None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:08.922150 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ede1899-6389-465d-889b-fcc140cf5d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:08.922759 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ede1899-6389-465d-889b-fcc140cf5d58 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:08.923032 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ede1899-6389-465d-889b-fcc140cf5d58 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:08.923296 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ede1899-6389-465d-889b-fcc140cf5d58 None admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:08.924126 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ede1899-6389-465d-889b-fcc140cf5d58 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:08.924463 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ede1899-6389-465d-889b-fcc140cf5d58 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:08.925874 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ede1899-6389-465d-889b-fcc140cf5d58 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:08.945449 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 325/646] 10.222.0.72 () {56 vars in 1137 bytes} [Mon Sep 19 14:44:08 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:08.946089 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ede1899-6389-465d-889b-fcc140cf5d58 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:08.987136 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90078dd-54dd-4f8f-9449-d17ff1ccc7aa None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:09.001909 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:09.025608 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e2025a-c039-4935-ac5a-69edadec34e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:09.026214 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e2025a-c039-4935-ac5a-69edadec34e7 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:09.026636 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e2025a-c039-4935-ac5a-69edadec34e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:09.026908 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e2025a-c039-4935-ac5a-69edadec34e7 None admin] PATH_INFO: `/v3/domains` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:09.027592 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e2025a-c039-4935-ac5a-69edadec34e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:09.028058 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e2025a-c039-4935-ac5a-69edadec34e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:09.029527 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e2025a-c039-4935-ac5a-69edadec34e7 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:09.041331 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 322/647] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Sep 19 14:44:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:09.042147 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e2025a-c039-4935-ac5a-69edadec34e7 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:09.053875 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ede1899-6389-465d-889b-fcc140cf5d58 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:09.090693 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3249148-bf62-464d-8994-7f3a4da1a30e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:09.091318 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3249148-bf62-464d-8994-7f3a4da1a30e None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:09.091601 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3249148-bf62-464d-8994-7f3a4da1a30e None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:09.091875 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3249148-bf62-464d-8994-7f3a4da1a30e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:09.096167 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:09.102140 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3249148-bf62-464d-8994-7f3a4da1a30e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:44:09.107233 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-b3249148-bf62-464d-8994-7f3a4da1a30e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:44:09.107233 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:09.107233 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:09.107233 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:09.107233 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:09.107233 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:09.107233 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:09.107233 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:09.107233 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:09.107233 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:09.107233 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:09.107233 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:09.107233 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:44:09.107233 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:44:09.107233 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:44:09.107233 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:44:09.108127 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:44:09.108127 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:44:09.108127 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:44:09.108127 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:44:09.108127 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:09.108127 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:09.108127 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:09.108127 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:09.108127 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:09.108127 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:09.108127 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:09.108127 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:09.108127 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:09.108127 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:09.108127 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:09.108127 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:09.109593 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:09.109593 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:09.109593 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:09.109593 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:09.109593 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:44:09.109593 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:44:09.109593 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:44:09.109593 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:44:09.109593 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:44:09.109593 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:44:09.109593 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:44:09.109593 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:44:09.109593 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 326/648] 10.222.0.72 () {56 vars in 1102 bytes} [Mon Sep 19 14:44:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:09.109593 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3249148-bf62-464d-8994-7f3a4da1a30e None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:09.162984 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e2025a-c039-4935-ac5a-69edadec34e7 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:09.202101 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14a7379-4e09-486d-9fd4-d8f80fd6dfbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:09.202739 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a7379-4e09-486d-9fd4-d8f80fd6dfbe None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:09.203016 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a7379-4e09-486d-9fd4-d8f80fd6dfbe None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:09.203286 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a7379-4e09-486d-9fd4-d8f80fd6dfbe None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:09.210780 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14a7379-4e09-486d-9fd4-d8f80fd6dfbe None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:09.212215 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14a7379-4e09-486d-9fd4-d8f80fd6dfbe None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:09.223474 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-c14a7379-4e09-486d-9fd4-d8f80fd6dfbe None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 19 14:44:09.223474 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:09.223474 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:09.223474 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:09.223474 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:09.223474 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:09.223474 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:09.223474 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:09.223474 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:09.223474 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:09.223474 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:09.223474 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:09.223474 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 14:44:09.223474 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 14:44:09.223474 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 14:44:09.223474 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 14:44:09.224640 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:09.224640 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:09.224640 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:44:09.224640 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:44:09.224640 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:44:09.224640 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:44:09.224640 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:09.224640 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:09.224640 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:09.224640 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:09.224640 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:09.224640 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:09.224640 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:09.224640 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:09.224640 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:09.224640 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:09.224640 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:09.224640 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:09.225774 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:09.225774 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:09.225774 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 14:44:09.225774 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 14:44:09.225774 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 14:44:09.225774 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 14:44:09.225774 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 14:44:09.225774 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 14:44:09.225774 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 19 14:44:09.225774 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:44:09.229259 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 323/649] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Sep 19 14:44:09 2022] GET /identity/v3/users/cinder => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:09.229986 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14a7379-4e09-486d-9fd4-d8f80fd6dfbe None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:09.231755 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3249148-bf62-464d-8994-7f3a4da1a30e None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:09.250160 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:09.277763 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed4529f-1f75-4c9e-9083-a15ffa8ccb78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:09.278707 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed4529f-1f75-4c9e-9083-a15ffa8ccb78 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:09.279288 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed4529f-1f75-4c9e-9083-a15ffa8ccb78 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:09.279534 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed4529f-1f75-4c9e-9083-a15ffa8ccb78 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:09.334557 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14a7379-4e09-486d-9fd4-d8f80fd6dfbe None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:09.337493 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:09.358221 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed4529f-1f75-4c9e-9083-a15ffa8ccb78 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:09.359675 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed4529f-1f75-4c9e-9083-a15ffa8ccb78 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:09.369675 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64695ebd-41ad-4363-ab39-36fc29ed00a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:09.370307 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64695ebd-41ad-4363-ab39-36fc29ed00a7 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:09.370591 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64695ebd-41ad-4363-ab39-36fc29ed00a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:09.371429 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64695ebd-41ad-4363-ab39-36fc29ed00a7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:09.378235 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64695ebd-41ad-4363-ab39-36fc29ed00a7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:09.379738 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64695ebd-41ad-4363-ab39-36fc29ed00a7 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:09.392440 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-64695ebd-41ad-4363-ab39-36fc29ed00a7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:44:09.392440 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:09.392440 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:09.392440 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:09.392440 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:09.392440 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:09.392440 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:09.392440 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:09.392440 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:09.392440 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:09.392440 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:09.392440 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:09.392440 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 14:44:09.392440 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 14:44:09.392440 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 14:44:09.393546 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 14:44:09.393546 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:09.393546 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:09.393546 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:09.393546 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:09.393546 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:09.393546 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:09.393546 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:09.393546 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:09.393546 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:09.393546 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:09.393546 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:09.393546 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:09.393546 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:09.393546 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:09.393546 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:09.393546 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:09.394433 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 14:44:09.394433 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 14:44:09.394433 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:44:09.394433 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:44:09.394433 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:44:09.394433 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:44:09.394433 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:44:09.394433 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:44:09.394433 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 324/650] 10.222.0.72 () {56 vars in 1111 bytes} [Mon Sep 19 14:44:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:09.394909 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64695ebd-41ad-4363-ab39-36fc29ed00a7 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:09.465333 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 327/651] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Sep 19 14:44:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 14:44:09.466531 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed4529f-1f75-4c9e-9083-a15ffa8ccb78 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:09.482447 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:09.508855 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64695ebd-41ad-4363-ab39-36fc29ed00a7 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:09.545759 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cce303d-0167-473b-9641-5b3eae6d4ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:09.546400 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cce303d-0167-473b-9641-5b3eae6d4ad7 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:09.546681 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cce303d-0167-473b-9641-5b3eae6d4ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:09.546951 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cce303d-0167-473b-9641-5b3eae6d4ad7 None admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:09.547618 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cce303d-0167-473b-9641-5b3eae6d4ad7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:09.547929 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cce303d-0167-473b-9641-5b3eae6d4ad7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:09.549405 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cce303d-0167-473b-9641-5b3eae6d4ad7 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:09.560310 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 325/652] 10.222.0.72 () {56 vars in 1103 bytes} [Mon Sep 19 14:44:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:09.561239 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cce303d-0167-473b-9641-5b3eae6d4ad7 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:09.581717 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed4529f-1f75-4c9e-9083-a15ffa8ccb78 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:09.592412 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:09.621790 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b34e37-58d5-452a-b4b3-c848525108fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:09.622396 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b34e37-58d5-452a-b4b3-c848525108fe None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:09.622741 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b34e37-58d5-452a-b4b3-c848525108fe None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:09.623022 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b34e37-58d5-452a-b4b3-c848525108fe None admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:09.623750 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b34e37-58d5-452a-b4b3-c848525108fe None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:09.624060 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b34e37-58d5-452a-b4b3-c848525108fe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:09.625538 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b34e37-58d5-452a-b4b3-c848525108fe None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:09.648168 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 328/653] 10.222.0.72 () {56 vars in 1137 bytes} [Mon Sep 19 14:44:09 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:09.648168 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b34e37-58d5-452a-b4b3-c848525108fe None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:09.680596 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cce303d-0167-473b-9641-5b3eae6d4ad7 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:09.718166 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:09.725166 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058c5483-af00-4fe9-b26c-d4248a1b82fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:09.725779 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058c5483-af00-4fe9-b26c-d4248a1b82fc None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:09.726063 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058c5483-af00-4fe9-b26c-d4248a1b82fc None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:09.726344 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058c5483-af00-4fe9-b26c-d4248a1b82fc None admin] PATH_INFO: `/v3/projects` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:09.727032 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058c5483-af00-4fe9-b26c-d4248a1b82fc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:09.727340 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058c5483-af00-4fe9-b26c-d4248a1b82fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:09.728806 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058c5483-af00-4fe9-b26c-d4248a1b82fc None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:09.741671 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 326/654] 10.222.0.72 () {56 vars in 1148 bytes} [Mon Sep 19 14:44:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:09.742471 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058c5483-af00-4fe9-b26c-d4248a1b82fc None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:09.748961 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b34e37-58d5-452a-b4b3-c848525108fe None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:09.782851 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dca402a-192f-49cb-8c59-8fd1540348e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:09.783473 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca402a-192f-49cb-8c59-8fd1540348e8 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:09.783772 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca402a-192f-49cb-8c59-8fd1540348e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:09.784026 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca402a-192f-49cb-8c59-8fd1540348e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:09.793976 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dca402a-192f-49cb-8c59-8fd1540348e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:09.795403 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dca402a-192f-49cb-8c59-8fd1540348e8 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:09.809779 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-0dca402a-192f-49cb-8c59-8fd1540348e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:44:09.809779 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:09.809779 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:09.809779 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:09.809779 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:09.809779 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:09.809779 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:09.809779 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:09.809779 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:09.809779 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:09.809779 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:09.809779 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:09.809779 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:44:09.809779 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:44:09.809779 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:44:09.809779 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:44:09.810742 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:09.810742 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:09.810742 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:09.810742 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:09.810742 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:09.810742 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:09.810742 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:09.810742 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:09.810742 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:09.810742 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:09.810742 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:09.810742 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:09.810742 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:09.810742 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:09.810742 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:09.810742 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:09.810742 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:44:09.811652 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:44:09.811652 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:44:09.811652 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:44:09.811652 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 329/655] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:44:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:09.812107 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dca402a-192f-49cb-8c59-8fd1540348e8 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:09.830654 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:09.846123 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058c5483-af00-4fe9-b26c-d4248a1b82fc None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:09.880616 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bc4926-d4f4-4033-a990-67b88e630e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:09.881243 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bc4926-d4f4-4033-a990-67b88e630e02 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:09.881526 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bc4926-d4f4-4033-a990-67b88e630e02 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:09.881798 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bc4926-d4f4-4033-a990-67b88e630e02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:09.894543 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bc4926-d4f4-4033-a990-67b88e630e02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:09.895980 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bc4926-d4f4-4033-a990-67b88e630e02 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:09.910990 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-c7bc4926-d4f4-4033-a990-67b88e630e02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:44:09.910990 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:09.910990 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:09.910990 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:09.910990 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:09.910990 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:09.910990 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:09.910990 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:09.910990 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:09.910990 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:09.910990 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:09.910990 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:09.910990 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:44:09.910990 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:44:09.910990 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:44:09.910990 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:44:09.912100 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:09.912100 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:09.912100 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:09.912100 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:09.912100 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:09.912100 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:09.912100 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:09.912100 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:09.912100 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:09.912100 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:09.912100 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:09.912100 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:09.912100 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:09.912100 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:09.912100 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:09.912100 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:09.912100 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:44:09.913116 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:44:09.913116 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:44:09.913116 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:44:09.913116 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 327/656] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:44:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:09.913367 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dca402a-192f-49cb-8c59-8fd1540348e8 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:09.913633 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab5405-ef32-46d1-b082-432b7efc7069 None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:09.913919 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab5405-ef32-46d1-b082-432b7efc7069 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:09.914197 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab5405-ef32-46d1-b082-432b7efc7069 None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:09.915414 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 328/657] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:44:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:44:09.916094 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ab5405-ef32-46d1-b082-432b7efc7069 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:09.938740 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:09.950971 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4661e6a7-0da7-4958-8a14-4f3e2b39c004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:09.951568 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4661e6a7-0da7-4958-8a14-4f3e2b39c004 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:09.951843 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4661e6a7-0da7-4958-8a14-4f3e2b39c004 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:09.952109 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4661e6a7-0da7-4958-8a14-4f3e2b39c004 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:10.017602 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4661e6a7-0da7-4958-8a14-4f3e2b39c004 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:10.017794 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ab5405-ef32-46d1-b082-432b7efc7069 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:10.019075 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4661e6a7-0da7-4958-8a14-4f3e2b39c004 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:10.051840 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6a0d8a-72f3-4652-a448-c0451bc92d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:10.052474 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a0d8a-72f3-4652-a448-c0451bc92d26 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:10.052758 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a0d8a-72f3-4652-a448-c0451bc92d26 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:10.053032 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a0d8a-72f3-4652-a448-c0451bc92d26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:10.053751 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6a0d8a-72f3-4652-a448-c0451bc92d26 None admin] RBAC: Adding query filter params (role.id=537cde5f25284acca3c3ea9ff806d724, scope.project.id=51af3a14d665498c9b7a35b34dac0ef1, user.id=055439dc35e946f4a82535c684f9b60d) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:10.054060 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6a0d8a-72f3-4652-a448-c0451bc92d26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:10.055570 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6a0d8a-72f3-4652-a448-c0451bc92d26 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:10.061643 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 329/658] 10.222.0.72 () {56 vars in 1374 bytes} [Mon Sep 19 14:44:09 2022] GET /identity/v3/role_assignments?user.id=055439dc35e946f4a82535c684f9b60d&scope.project.id=51af3a14d665498c9b7a35b34dac0ef1&role.id=537cde5f25284acca3c3ea9ff806d724 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:10.062357 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6a0d8a-72f3-4652-a448-c0451bc92d26 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:10.065001 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:10.140672 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 330/659] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Sep 19 14:44:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 14:44:10.141668 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4661e6a7-0da7-4958-8a14-4f3e2b39c004 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:10.168183 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:10.191957 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6a0d8a-72f3-4652-a448-c0451bc92d26 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:10.228362 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809e87de-1a5f-4dcc-8b0d-504a8c3dd2dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:10.228988 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809e87de-1a5f-4dcc-8b0d-504a8c3dd2dc None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:10.229268 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809e87de-1a5f-4dcc-8b0d-504a8c3dd2dc None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:10.229540 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809e87de-1a5f-4dcc-8b0d-504a8c3dd2dc None admin] PATH_INFO: `/v3/domains` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:10.230715 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809e87de-1a5f-4dcc-8b0d-504a8c3dd2dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:10.231016 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809e87de-1a5f-4dcc-8b0d-504a8c3dd2dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:10.232614 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809e87de-1a5f-4dcc-8b0d-504a8c3dd2dc None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:10.245130 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 330/660] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Sep 19 14:44:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:10.246938 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e978117-d410-4d72-bbd4-a051f5f0ede5 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:10.247253 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e978117-d410-4d72-bbd4-a051f5f0ede5 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:10.247587 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e978117-d410-4d72-bbd4-a051f5f0ede5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:10.262494 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4661e6a7-0da7-4958-8a14-4f3e2b39c004 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:10.268916 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-4e978117-d410-4d72-bbd4-a051f5f0ede5 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:44:10.270773 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-4e978117-d410-4d72-bbd4-a051f5f0ede5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:44:10.303049 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed31717a-57fc-45b4-8726-e7088917d286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:10.303774 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed31717a-57fc-45b4-8726-e7088917d286 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:10.304053 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed31717a-57fc-45b4-8726-e7088917d286 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:10.304972 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed31717a-57fc-45b4-8726-e7088917d286 None admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:10.305099 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed31717a-57fc-45b4-8726-e7088917d286 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:10.305397 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed31717a-57fc-45b4-8726-e7088917d286 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:10.306753 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed31717a-57fc-45b4-8726-e7088917d286 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:10.320560 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 331/661] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Sep 19 14:44:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:10.321315 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed31717a-57fc-45b4-8726-e7088917d286 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:10.339074 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:10.350874 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 331/662] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:44:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:44:10.351635 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e978117-d410-4d72-bbd4-a051f5f0ede5 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:10.434125 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:10.456712 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed31717a-57fc-45b4-8726-e7088917d286 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:10.469933 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e978117-d410-4d72-bbd4-a051f5f0ede5 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:10.492640 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937645da-394c-446e-867d-29d0d7e69cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:10.493332 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937645da-394c-446e-867d-29d0d7e69cc0 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:10.493615 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937645da-394c-446e-867d-29d0d7e69cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:10.493887 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937645da-394c-446e-867d-29d0d7e69cc0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:10.505009 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937645da-394c-446e-867d-29d0d7e69cc0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:10.506493 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937645da-394c-446e-867d-29d0d7e69cc0 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:10.516536 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4854f313-ee98-4c12-8622-cb8de685bf1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:10.517730 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4854f313-ee98-4c12-8622-cb8de685bf1b None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:10.518234 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4854f313-ee98-4c12-8622-cb8de685bf1b None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:10.518706 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4854f313-ee98-4c12-8622-cb8de685bf1b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:10.523131 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-937645da-394c-446e-867d-29d0d7e69cc0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:44:10.523131 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:10.523131 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:10.523131 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:10.523131 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:10.523131 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:10.523131 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:10.523131 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:10.523131 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:10.523131 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:10.523131 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:10.523131 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:10.523131 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:44:10.523131 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:44:10.523131 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:44:10.523131 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:44:10.524045 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:10.524045 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:10.524045 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:10.524045 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:10.524045 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:10.524045 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:10.524045 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:10.524045 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:10.524045 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:10.524045 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:10.524045 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:10.524045 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:10.524045 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:10.524045 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:10.524045 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:10.524045 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:10.524045 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:44:10.524949 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:44:10.524949 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:44:10.524949 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:44:10.529279 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4854f313-ee98-4c12-8622-cb8de685bf1b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:10.530102 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 332/663] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:44:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:10.530979 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937645da-394c-446e-867d-29d0d7e69cc0 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:10.531518 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4854f313-ee98-4c12-8622-cb8de685bf1b None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:10.547399 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-4854f313-ee98-4c12-8622-cb8de685bf1b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:44:10.547399 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:10.547399 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:10.547399 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:10.547399 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:10.547399 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:10.547399 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:10.547399 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:10.547399 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:10.547399 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:10.547399 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:10.547399 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:10.547399 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 14:44:10.547399 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 14:44:10.547399 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 14:44:10.548434 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 14:44:10.548434 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:10.548434 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:10.548434 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:10.548434 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:10.548434 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:10.548434 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:10.548434 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:10.548434 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:10.548434 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:10.548434 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:10.548434 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:10.548434 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:10.548434 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:10.548434 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:10.548434 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:10.548434 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:10.549312 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 14:44:10.549312 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 14:44:10.549312 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:44:10.549312 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:44:10.549312 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:44:10.549312 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:44:10.549312 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:44:10.549312 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:44:10.550579 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 332/664] 10.222.0.72 () {56 vars in 1111 bytes} [Mon Sep 19 14:44:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:10.550752 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4854f313-ee98-4c12-8622-cb8de685bf1b None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:10.621322 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:10.657805 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937645da-394c-446e-867d-29d0d7e69cc0 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:10.667518 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4854f313-ee98-4c12-8622-cb8de685bf1b None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:10.693424 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11155088-5c35-4196-8dad-1f5861bb06ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:10.694048 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11155088-5c35-4196-8dad-1f5861bb06ae None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:10.694324 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11155088-5c35-4196-8dad-1f5861bb06ae None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:10.694593 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11155088-5c35-4196-8dad-1f5861bb06ae None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:10.696633 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:10.703270 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233d1b94-61fe-4ca1-9779-1987dafbd663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:10.703806 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d1b94-61fe-4ca1-9779-1987dafbd663 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:10.703924 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11155088-5c35-4196-8dad-1f5861bb06ae None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:10.704085 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d1b94-61fe-4ca1-9779-1987dafbd663 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:10.704419 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d1b94-61fe-4ca1-9779-1987dafbd663 None admin] PATH_INFO: `/v3/domains` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:10.705021 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233d1b94-61fe-4ca1-9779-1987dafbd663 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:10.705301 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11155088-5c35-4196-8dad-1f5861bb06ae None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:10.705416 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233d1b94-61fe-4ca1-9779-1987dafbd663 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:10.706651 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233d1b94-61fe-4ca1-9779-1987dafbd663 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:10.723510 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 333/665] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Sep 19 14:44:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:10.723686 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-11155088-5c35-4196-8dad-1f5861bb06ae None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 19 14:44:10.723686 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:10.723686 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:10.723686 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:10.723686 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:10.723686 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:10.723686 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:10.723686 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:10.723686 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:10.723686 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:10.723686 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:10.723686 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:10.723686 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 14:44:10.723686 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 14:44:10.723686 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 14:44:10.723686 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 14:44:10.725511 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:10.725511 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:10.725511 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:44:10.725511 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:44:10.725511 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:44:10.725511 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:44:10.725511 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:10.725511 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:10.725511 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:10.725511 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:10.725511 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:10.725511 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:10.725511 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:10.725511 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:10.725511 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:10.725511 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:10.725511 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:10.725511 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:10.726458 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:10.726458 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:10.726458 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 14:44:10.726458 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 14:44:10.726458 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 14:44:10.726458 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 14:44:10.726458 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 14:44:10.726458 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 14:44:10.726458 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 19 14:44:10.726458 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:44:10.727011 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233d1b94-61fe-4ca1-9779-1987dafbd663 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:10.727082 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 333/666] 10.222.0.72 () {56 vars in 1102 bytes} [Mon Sep 19 14:44:10 2022] GET /identity/v3/users/neutron => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:10.727082 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11155088-5c35-4196-8dad-1f5861bb06ae None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:10.829989 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233d1b94-61fe-4ca1-9779-1987dafbd663 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:10.832508 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11155088-5c35-4196-8dad-1f5861bb06ae None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:10.845431 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:10.868029 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891fd562-e0e3-4879-a5e3-6d328beb5a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:10.868723 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891fd562-e0e3-4879-a5e3-6d328beb5a67 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:10.869004 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891fd562-e0e3-4879-a5e3-6d328beb5a67 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:10.869277 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891fd562-e0e3-4879-a5e3-6d328beb5a67 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:10.870197 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc50deb7-ffc1-4062-b66e-ee6cf179c065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:10.871405 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc50deb7-ffc1-4062-b66e-ee6cf179c065 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:10.871746 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc50deb7-ffc1-4062-b66e-ee6cf179c065 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:10.872040 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc50deb7-ffc1-4062-b66e-ee6cf179c065 None admin] PATH_INFO: `/v3/projects` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:10.872715 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc50deb7-ffc1-4062-b66e-ee6cf179c065 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:10.873014 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc50deb7-ffc1-4062-b66e-ee6cf179c065 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:10.874486 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc50deb7-ffc1-4062-b66e-ee6cf179c065 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:10.881056 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891fd562-e0e3-4879-a5e3-6d328beb5a67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:44:10.887015 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-891fd562-e0e3-4879-a5e3-6d328beb5a67 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:44:10.887015 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:10.887015 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:10.887015 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:10.887015 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:10.887015 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:10.887015 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:10.887015 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:10.887015 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:10.887015 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:10.887015 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:10.887015 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:10.887015 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:44:10.887015 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:44:10.887015 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:44:10.887015 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:44:10.893209 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:44:10.893209 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:44:10.893209 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:44:10.893209 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:44:10.893209 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:10.893209 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:10.893209 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:10.893209 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:10.893209 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:10.893209 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:10.893209 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:10.893209 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:10.893209 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:10.893209 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:10.893209 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:10.893209 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:10.894046 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:10.894046 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:10.894046 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:10.894046 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:10.894046 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:44:10.894046 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:44:10.894046 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:44:10.894046 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:44:10.894046 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:44:10.894046 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:44:10.894046 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:44:10.894046 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:44:10.894668 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 334/667] 10.222.0.72 () {56 vars in 1148 bytes} [Mon Sep 19 14:44:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:10.894668 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc50deb7-ffc1-4062-b66e-ee6cf179c065 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:10.895673 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 334/668] 10.222.0.72 () {56 vars in 1102 bytes} [Mon Sep 19 14:44:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:10.896539 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891fd562-e0e3-4879-a5e3-6d328beb5a67 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:10.959411 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:11.004024 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc50deb7-ffc1-4062-b66e-ee6cf179c065 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:11.006228 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891fd562-e0e3-4879-a5e3-6d328beb5a67 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:11.040128 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7b01f2-7b48-4d2f-8cc2-e2680b7b2b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:11.040819 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7b01f2-7b48-4d2f-8cc2-e2680b7b2b88 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:11.041119 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7b01f2-7b48-4d2f-8cc2-e2680b7b2b88 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:11.041372 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7b01f2-7b48-4d2f-8cc2-e2680b7b2b88 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:11.044382 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceefc7b-1c2a-47d1-aef1-7aa98c162204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:11.045091 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceefc7b-1c2a-47d1-aef1-7aa98c162204 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:11.045386 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceefc7b-1c2a-47d1-aef1-7aa98c162204 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:11.045671 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceefc7b-1c2a-47d1-aef1-7aa98c162204 None admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:11.046421 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceefc7b-1c2a-47d1-aef1-7aa98c162204 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:11.046733 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceefc7b-1c2a-47d1-aef1-7aa98c162204 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:11.048188 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceefc7b-1c2a-47d1-aef1-7aa98c162204 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:11.050394 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7b01f2-7b48-4d2f-8cc2-e2680b7b2b88 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:11.051845 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7b01f2-7b48-4d2f-8cc2-e2680b7b2b88 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:11.064887 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-6b7b01f2-7b48-4d2f-8cc2-e2680b7b2b88 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:44:11.064887 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:11.064887 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:11.064887 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:11.064887 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:11.064887 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:11.064887 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:11.064887 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:11.064887 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:11.064887 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:11.064887 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:11.064887 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:11.064887 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 14:44:11.064887 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 14:44:11.064887 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 14:44:11.065816 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 14:44:11.065816 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:11.065816 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:11.065816 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:11.065816 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:11.065816 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:11.065816 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:11.065816 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:11.065816 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:11.065816 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:11.065816 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:11.065816 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:11.065816 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:11.065816 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:11.065816 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:11.065816 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:11.065816 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:11.066687 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 14:44:11.066687 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 14:44:11.066687 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:44:11.066687 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:44:11.066687 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:44:11.066687 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:44:11.066687 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:44:11.066687 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:44:11.066687 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 335/669] 10.222.0.72 () {56 vars in 1111 bytes} [Mon Sep 19 14:44:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:11.067768 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7b01f2-7b48-4d2f-8cc2-e2680b7b2b88 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:11.077725 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 335/670] 10.222.0.72 () {56 vars in 1139 bytes} [Mon Sep 19 14:44:10 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:11.077725 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceefc7b-1c2a-47d1-aef1-7aa98c162204 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:11.102045 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:11.178229 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7b01f2-7b48-4d2f-8cc2-e2680b7b2b88 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:11.183114 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceefc7b-1c2a-47d1-aef1-7aa98c162204 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:11.197762 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:11.214634 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd25a1c-5776-4774-857d-c21f910be87c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:11.215246 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd25a1c-5776-4774-857d-c21f910be87c None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:11.215527 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd25a1c-5776-4774-857d-c21f910be87c None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:11.215807 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd25a1c-5776-4774-857d-c21f910be87c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:11.216617 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd25a1c-5776-4774-857d-c21f910be87c None admin] RBAC: Adding query filter params (role.id=537cde5f25284acca3c3ea9ff806d724, scope.project.id=51af3a14d665498c9b7a35b34dac0ef1, user.id=4d6d4ecf8f4849939d6510a6228b29dc) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:11.216931 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd25a1c-5776-4774-857d-c21f910be87c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:11.218349 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd25a1c-5776-4774-857d-c21f910be87c None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:11.222036 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7e1018-c2e2-4f3f-9c53-5269f0e63f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:11.222637 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e1018-c2e2-4f3f-9c53-5269f0e63f75 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:11.222908 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e1018-c2e2-4f3f-9c53-5269f0e63f75 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:11.223179 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e1018-c2e2-4f3f-9c53-5269f0e63f75 None admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:11.223828 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7e1018-c2e2-4f3f-9c53-5269f0e63f75 None admin] RBAC: Adding query filter params (name=service) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:11.224128 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7e1018-c2e2-4f3f-9c53-5269f0e63f75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:11.225592 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7e1018-c2e2-4f3f-9c53-5269f0e63f75 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:11.232763 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 336/671] 10.222.0.72 () {56 vars in 1374 bytes} [Mon Sep 19 14:44:11 2022] GET /identity/v3/role_assignments?user.id=4d6d4ecf8f4849939d6510a6228b29dc&scope.project.id=51af3a14d665498c9b7a35b34dac0ef1&role.id=537cde5f25284acca3c3ea9ff806d724 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:11.234387 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd25a1c-5776-4774-857d-c21f910be87c None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:11.240109 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 336/672] 10.222.0.72 () {56 vars in 1103 bytes} [Mon Sep 19 14:44:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:11.240109 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7e1018-c2e2-4f3f-9c53-5269f0e63f75 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:11.351233 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:11.361645 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd25a1c-5776-4774-857d-c21f910be87c None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:11.387715 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7e1018-c2e2-4f3f-9c53-5269f0e63f75 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:11.414412 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bbb134-0ec7-4445-a1f5-b12eddbfb481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:11.415217 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bbb134-0ec7-4445-a1f5-b12eddbfb481 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:11.415510 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bbb134-0ec7-4445-a1f5-b12eddbfb481 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:11.415790 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bbb134-0ec7-4445-a1f5-b12eddbfb481 None admin] PATH_INFO: `/v3/projects` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:11.416907 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bbb134-0ec7-4445-a1f5-b12eddbfb481 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:11.417476 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bbb134-0ec7-4445-a1f5-b12eddbfb481 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:11.419774 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bbb134-0ec7-4445-a1f5-b12eddbfb481 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:11.428799 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1814f73-a02d-43d2-ae22-99c7a1f9603b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:11.429335 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1814f73-a02d-43d2-ae22-99c7a1f9603b None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:11.429611 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1814f73-a02d-43d2-ae22-99c7a1f9603b None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:11.429877 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1814f73-a02d-43d2-ae22-99c7a1f9603b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:11.436149 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 337/673] 10.222.0.72 () {56 vars in 1148 bytes} [Mon Sep 19 14:44:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:11.436848 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bbb134-0ec7-4445-a1f5-b12eddbfb481 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:11.493379 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:11.530376 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1814f73-a02d-43d2-ae22-99c7a1f9603b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:11.531863 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1814f73-a02d-43d2-ae22-99c7a1f9603b None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:11.567782 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bbb134-0ec7-4445-a1f5-b12eddbfb481 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:11.604514 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a2230a-7577-4756-bd2a-54db01749cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:11.604964 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a2230a-7577-4756-bd2a-54db01749cde None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:11.605872 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a2230a-7577-4756-bd2a-54db01749cde None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:11.606157 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a2230a-7577-4756-bd2a-54db01749cde None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:11.617818 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a2230a-7577-4756-bd2a-54db01749cde None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:11.620222 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a2230a-7577-4756-bd2a-54db01749cde None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:11.637836 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-04a2230a-7577-4756-bd2a-54db01749cde None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:44:11.637836 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:11.637836 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:11.637836 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:11.637836 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:11.637836 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:11.637836 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:11.637836 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:11.637836 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:11.637836 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:11.637836 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:11.637836 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:11.637836 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:44:11.637836 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:44:11.637836 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:44:11.637836 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:44:11.638854 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:11.638854 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:11.638854 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:11.638854 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:11.638854 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:11.638854 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:11.638854 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:11.638854 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:11.638854 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:11.638854 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:11.638854 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:11.638854 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:11.638854 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:11.638854 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:11.638854 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:11.638854 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:11.638854 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:44:11.639729 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:44:11.639729 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:44:11.639729 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:44:11.643965 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 338/674] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:44:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:11.644851 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a2230a-7577-4756-bd2a-54db01749cde None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:11.658605 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:11.666573 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 337/675] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Sep 19 14:44:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 14:44:11.669160 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1814f73-a02d-43d2-ae22-99c7a1f9603b None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:11.759233 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:11.769657 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a2230a-7577-4756-bd2a-54db01749cde None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:11.787790 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1814f73-a02d-43d2-ae22-99c7a1f9603b None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:11.814540 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09c0923-1b1d-4d77-b9d7-34fd583fcc8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:11.815541 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09c0923-1b1d-4d77-b9d7-34fd583fcc8d None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:11.816205 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09c0923-1b1d-4d77-b9d7-34fd583fcc8d None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:11.817102 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09c0923-1b1d-4d77-b9d7-34fd583fcc8d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:11.818286 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09c0923-1b1d-4d77-b9d7-34fd583fcc8d None admin] RBAC: Adding query filter params (role.id=537cde5f25284acca3c3ea9ff806d724, scope.project.id=51af3a14d665498c9b7a35b34dac0ef1, user.id=139dc7a4f1dc48fe8faea848bd1ac0f6) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:11.818784 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09c0923-1b1d-4d77-b9d7-34fd583fcc8d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:11.820634 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09c0923-1b1d-4d77-b9d7-34fd583fcc8d None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:11.825442 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b340893-9c3c-4644-bb7c-419eee562323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:11.826142 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b340893-9c3c-4644-bb7c-419eee562323 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:11.826329 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b340893-9c3c-4644-bb7c-419eee562323 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:11.826606 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b340893-9c3c-4644-bb7c-419eee562323 None admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:11.827240 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b340893-9c3c-4644-bb7c-419eee562323 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:11.827541 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b340893-9c3c-4644-bb7c-419eee562323 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:11.828911 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 339/676] 10.222.0.72 () {56 vars in 1374 bytes} [Mon Sep 19 14:44:11 2022] GET /identity/v3/role_assignments?user.id=139dc7a4f1dc48fe8faea848bd1ac0f6&scope.project.id=51af3a14d665498c9b7a35b34dac0ef1&role.id=537cde5f25284acca3c3ea9ff806d724 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:11.829858 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09c0923-1b1d-4d77-b9d7-34fd583fcc8d None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:11.830578 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b340893-9c3c-4644-bb7c-419eee562323 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:11.844193 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 338/677] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Sep 19 14:44:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:11.849948 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b340893-9c3c-4644-bb7c-419eee562323 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:11.966727 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:12.031729 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09c0923-1b1d-4d77-b9d7-34fd583fcc8d None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:12.051761 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b340893-9c3c-4644-bb7c-419eee562323 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:12.093022 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154bbbc4-1e40-4518-b677-74ddba4ebd50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:12.093789 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154bbbc4-1e40-4518-b677-74ddba4ebd50 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:12.094191 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154bbbc4-1e40-4518-b677-74ddba4ebd50 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:12.094468 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154bbbc4-1e40-4518-b677-74ddba4ebd50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:12.102616 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869b0299-0da9-4086-84f2-4f666452c94b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:12.103484 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869b0299-0da9-4086-84f2-4f666452c94b None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:12.103965 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869b0299-0da9-4086-84f2-4f666452c94b None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:12.104446 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869b0299-0da9-4086-84f2-4f666452c94b None admin] PATH_INFO: `/v3/users/swift` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:12.107484 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:12.109936 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154bbbc4-1e40-4518-b677-74ddba4ebd50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:12.111417 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154bbbc4-1e40-4518-b677-74ddba4ebd50 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:12.115537 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869b0299-0da9-4086-84f2-4f666452c94b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:12.117249 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869b0299-0da9-4086-84f2-4f666452c94b None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:12.131398 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-154bbbc4-1e40-4518-b677-74ddba4ebd50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:44:12.131398 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:12.131398 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:12.131398 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:12.131398 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:12.131398 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:12.131398 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:12.131398 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:12.131398 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:12.131398 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:12.131398 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:12.131398 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:12.131398 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:44:12.131398 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:44:12.131398 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:44:12.131398 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:44:12.132702 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:12.132702 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:12.132702 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:12.132702 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:12.132702 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:12.132702 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:12.132702 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:12.132702 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:12.132702 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:12.132702 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:12.132702 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:12.132702 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:12.132702 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:12.132702 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:12.132702 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:12.132702 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:12.132702 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:44:12.133849 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:44:12.133849 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:44:12.133849 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:44:12.133849 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 340/678] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:44:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:12.135047 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-869b0299-0da9-4086-84f2-4f666452c94b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 19 14:44:12.135047 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:12.135047 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:12.135047 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:12.135047 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:12.135047 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:12.135047 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:12.135047 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:12.135047 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:12.135047 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:12.135047 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:12.135047 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:12.135047 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 14:44:12.135047 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 14:44:12.135047 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 14:44:12.135047 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 14:44:12.135936 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:12.135936 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:12.135936 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:44:12.135936 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:44:12.135936 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:44:12.135936 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:44:12.135936 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:12.135936 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:12.135936 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:12.135936 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:12.135936 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:12.135936 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:12.135936 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:12.135936 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:12.135936 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:12.135936 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:12.135936 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:12.135936 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:12.137413 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:12.137413 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:12.137413 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 14:44:12.137413 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 14:44:12.137413 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 14:44:12.137413 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 14:44:12.137413 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 14:44:12.137413 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 14:44:12.137413 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 19 14:44:12.137413 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:44:12.137954 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154bbbc4-1e40-4518-b677-74ddba4ebd50 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:12.140828 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 339/679] 10.222.0.72 () {56 vars in 1096 bytes} [Mon Sep 19 14:44:11 2022] GET /identity/v3/users/swift => generated 83 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:12.153404 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869b0299-0da9-4086-84f2-4f666452c94b None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:12.250788 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154bbbc4-1e40-4518-b677-74ddba4ebd50 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:12.275451 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:12.276614 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869b0299-0da9-4086-84f2-4f666452c94b None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:12.287676 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c4e415-98e8-4328-9c0e-e34a7fee5b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:12.288231 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c4e415-98e8-4328-9c0e-e34a7fee5b15 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:12.288540 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c4e415-98e8-4328-9c0e-e34a7fee5b15 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:12.288815 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c4e415-98e8-4328-9c0e-e34a7fee5b15 None admin] PATH_INFO: `/v3/domains` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:12.289462 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c4e415-98e8-4328-9c0e-e34a7fee5b15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:12.289766 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c4e415-98e8-4328-9c0e-e34a7fee5b15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:12.291190 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c4e415-98e8-4328-9c0e-e34a7fee5b15 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:12.304222 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 341/680] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Sep 19 14:44:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:12.312107 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c4e415-98e8-4328-9c0e-e34a7fee5b15 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:12.335687 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af1d265-0120-4d81-9beb-fc02bbd4fc0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:12.336985 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af1d265-0120-4d81-9beb-fc02bbd4fc0e None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:12.337460 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af1d265-0120-4d81-9beb-fc02bbd4fc0e None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:12.338183 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af1d265-0120-4d81-9beb-fc02bbd4fc0e None admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:12.340210 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af1d265-0120-4d81-9beb-fc02bbd4fc0e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:12.340893 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af1d265-0120-4d81-9beb-fc02bbd4fc0e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:12.343286 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af1d265-0120-4d81-9beb-fc02bbd4fc0e None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:12.371780 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 340/681] 10.222.0.72 () {56 vars in 1135 bytes} [Mon Sep 19 14:44:12 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:12.374164 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696cd30d-7aa1-4423-9eae-1ad38521f301 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:12.374637 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696cd30d-7aa1-4423-9eae-1ad38521f301 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:12.375094 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696cd30d-7aa1-4423-9eae-1ad38521f301 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:12.377775 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 341/682] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:44:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:44:12.378676 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696cd30d-7aa1-4423-9eae-1ad38521f301 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:12.443219 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c4e415-98e8-4328-9c0e-e34a7fee5b15 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:12.456646 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:12.481697 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64429bd5-2353-4e51-bd11-e205350d039c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:12.483100 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64429bd5-2353-4e51-bd11-e205350d039c None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:12.483100 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64429bd5-2353-4e51-bd11-e205350d039c None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:12.483100 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64429bd5-2353-4e51-bd11-e205350d039c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:12.492062 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64429bd5-2353-4e51-bd11-e205350d039c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:12.493691 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64429bd5-2353-4e51-bd11-e205350d039c None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:12.506344 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-64429bd5-2353-4e51-bd11-e205350d039c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:44:12.506344 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:12.506344 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:12.506344 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:12.506344 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:12.506344 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:12.506344 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:12.506344 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:12.506344 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:12.506344 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:12.506344 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:12.506344 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:12.506344 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 14:44:12.506344 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 14:44:12.506344 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 14:44:12.507452 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 14:44:12.507452 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:12.507452 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:12.507452 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:12.507452 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:12.507452 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:12.507452 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:12.507452 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:12.507452 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:12.507452 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:12.507452 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:12.507452 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:12.507452 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:12.507452 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:12.507452 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:12.507452 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:12.507452 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:12.508458 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 14:44:12.508458 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 14:44:12.508458 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:44:12.508458 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:44:12.508458 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:44:12.508458 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:44:12.508458 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:44:12.508458 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:44:12.512218 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 342/683] 10.222.0.72 () {56 vars in 1111 bytes} [Mon Sep 19 14:44:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:44:12.513691 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7462a80-7888-4b99-b2da-7eb0f8dabb94 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:12.513975 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7462a80-7888-4b99-b2da-7eb0f8dabb94 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:12.514243 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7462a80-7888-4b99-b2da-7eb0f8dabb94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:12.521948 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696cd30d-7aa1-4423-9eae-1ad38521f301 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:12.540021 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-a7462a80-7888-4b99-b2da-7eb0f8dabb94 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:44:12.541876 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-a7462a80-7888-4b99-b2da-7eb0f8dabb94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:44:12.560914 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea33bf3-b3da-43b9-ada6-fd0ee6aaf27c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:12.561600 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea33bf3-b3da-43b9-ada6-fd0ee6aaf27c None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:12.561962 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea33bf3-b3da-43b9-ada6-fd0ee6aaf27c None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:12.562408 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea33bf3-b3da-43b9-ada6-fd0ee6aaf27c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:12.596237 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:12.632508 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 343/684] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:44:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:44:12.633611 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7462a80-7888-4b99-b2da-7eb0f8dabb94 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:12.649485 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea33bf3-b3da-43b9-ada6-fd0ee6aaf27c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:12.651174 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea33bf3-b3da-43b9-ada6-fd0ee6aaf27c None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:12.755368 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7462a80-7888-4b99-b2da-7eb0f8dabb94 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:12.765117 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:12.795784 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeb2c4d-971c-4b48-91fb-215b5ecd3c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:12.796759 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeb2c4d-971c-4b48-91fb-215b5ecd3c3d None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:12.797501 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeb2c4d-971c-4b48-91fb-215b5ecd3c3d None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:12.797975 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeb2c4d-971c-4b48-91fb-215b5ecd3c3d None admin] PATH_INFO: `/v3/projects` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:12.798864 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeb2c4d-971c-4b48-91fb-215b5ecd3c3d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:12.799399 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeb2c4d-971c-4b48-91fb-215b5ecd3c3d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:12.801201 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeb2c4d-971c-4b48-91fb-215b5ecd3c3d None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:12.815801 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 344/685] 10.222.0.72 () {56 vars in 1148 bytes} [Mon Sep 19 14:44:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:12.825239 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeb2c4d-971c-4b48-91fb-215b5ecd3c3d None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:12.864770 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:12.882431 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 342/686] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Sep 19 14:44:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 14:44:12.888225 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea33bf3-b3da-43b9-ada6-fd0ee6aaf27c None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:12.944603 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeb2c4d-971c-4b48-91fb-215b5ecd3c3d None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:12.984847 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6fb268-2f29-45e7-8446-ece1f73a778b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:12.985814 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6fb268-2f29-45e7-8446-ece1f73a778b None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:12.986337 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6fb268-2f29-45e7-8446-ece1f73a778b None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:12.986812 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6fb268-2f29-45e7-8446-ece1f73a778b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:12.987732 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6fb268-2f29-45e7-8446-ece1f73a778b None admin] RBAC: Adding query filter params (role.id=537cde5f25284acca3c3ea9ff806d724, scope.project.id=51af3a14d665498c9b7a35b34dac0ef1, user.id=f4c2b78646374cb79ded4b7b59ba49c7) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:12.988254 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6fb268-2f29-45e7-8446-ece1f73a778b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:12.990369 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6fb268-2f29-45e7-8446-ece1f73a778b None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:12.998280 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 345/687] 10.222.0.72 () {56 vars in 1374 bytes} [Mon Sep 19 14:44:12 2022] GET /identity/v3/role_assignments?user.id=f4c2b78646374cb79ded4b7b59ba49c7&scope.project.id=51af3a14d665498c9b7a35b34dac0ef1&role.id=537cde5f25284acca3c3ea9ff806d724 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:13.064863 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6fb268-2f29-45e7-8446-ece1f73a778b None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:13.140635 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea33bf3-b3da-43b9-ada6-fd0ee6aaf27c None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:13.223788 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5981b1-0024-44af-9273-83a0bebd415f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:13.225902 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5981b1-0024-44af-9273-83a0bebd415f None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:13.226420 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5981b1-0024-44af-9273-83a0bebd415f None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:13.226894 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5981b1-0024-44af-9273-83a0bebd415f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:13.240829 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5981b1-0024-44af-9273-83a0bebd415f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:13.243429 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5981b1-0024-44af-9273-83a0bebd415f None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:13.258232 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:13.262941 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6fb268-2f29-45e7-8446-ece1f73a778b None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:13.265931 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-fd5981b1-0024-44af-9273-83a0bebd415f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:44:13.265931 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:13.265931 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:13.265931 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:13.265931 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:13.265931 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:13.265931 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:13.265931 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:13.265931 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:13.265931 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:13.265931 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:13.265931 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:13.265931 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:44:13.265931 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:44:13.265931 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:44:13.265931 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:44:13.266859 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:13.266859 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:13.266859 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:13.266859 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:13.266859 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:13.266859 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:13.266859 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:13.266859 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:13.266859 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:13.266859 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:13.266859 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:13.266859 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:13.266859 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:13.266859 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:13.266859 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:13.266859 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:13.266859 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:44:13.267778 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:44:13.267778 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:44:13.267778 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:44:13.270766 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 343/688] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:44:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 383 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:13.275833 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5981b1-0024-44af-9273-83a0bebd415f None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:13.281916 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:13.310734 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50905d33-6b2b-473b-8ae8-a979cf457331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:13.311787 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50905d33-6b2b-473b-8ae8-a979cf457331 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:13.312413 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50905d33-6b2b-473b-8ae8-a979cf457331 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:13.312979 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50905d33-6b2b-473b-8ae8-a979cf457331 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:13.325681 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50905d33-6b2b-473b-8ae8-a979cf457331 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:44:13.331534 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-50905d33-6b2b-473b-8ae8-a979cf457331 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:44:13.331534 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:13.331534 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:13.331534 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:13.331534 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:13.331534 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:13.331534 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:13.331534 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:13.331534 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:13.331534 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:13.331534 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:13.331534 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:13.331534 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:44:13.331534 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:44:13.331534 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:44:13.331534 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:44:13.332765 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:44:13.332765 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:44:13.332765 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:44:13.332765 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:44:13.332765 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:13.332765 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:13.332765 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:13.332765 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:13.332765 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:13.332765 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:13.332765 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:13.332765 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:13.332765 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:13.332765 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:13.332765 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:13.332765 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:13.333621 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:13.333621 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:13.333621 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:13.333621 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:13.333621 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:44:13.333621 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:44:13.333621 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:44:13.333621 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:44:13.333621 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:44:13.333621 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:44:13.333621 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:44:13.333621 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:44:13.336136 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 346/689] 10.222.0.72 () {56 vars in 1096 bytes} [Mon Sep 19 14:44:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:13.345256 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50905d33-6b2b-473b-8ae8-a979cf457331 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:13.417088 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5981b1-0024-44af-9273-83a0bebd415f None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:13.456939 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a2a698-cb94-4ea0-93e3-a7e7492db00d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:13.457551 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a2a698-cb94-4ea0-93e3-a7e7492db00d None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:13.457830 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a2a698-cb94-4ea0-93e3-a7e7492db00d None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:13.458105 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a2a698-cb94-4ea0-93e3-a7e7492db00d None admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:13.458860 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a2a698-cb94-4ea0-93e3-a7e7492db00d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:13.459165 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a2a698-cb94-4ea0-93e3-a7e7492db00d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:13.460598 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a2a698-cb94-4ea0-93e3-a7e7492db00d None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:13.472956 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50905d33-6b2b-473b-8ae8-a979cf457331 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:13.475592 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 344/690] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Sep 19 14:44:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:13.480781 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a2a698-cb94-4ea0-93e3-a7e7492db00d None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:13.510302 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2b452a-ee13-4743-a03f-ffdba79dccb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:13.511249 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b452a-ee13-4743-a03f-ffdba79dccb7 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:13.512273 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b452a-ee13-4743-a03f-ffdba79dccb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:13.512761 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b452a-ee13-4743-a03f-ffdba79dccb7 None admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:13.513630 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2b452a-ee13-4743-a03f-ffdba79dccb7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:13.514114 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2b452a-ee13-4743-a03f-ffdba79dccb7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:13.515867 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2b452a-ee13-4743-a03f-ffdba79dccb7 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:13.525635 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 347/691] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Sep 19 14:44:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:13.532711 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2b452a-ee13-4743-a03f-ffdba79dccb7 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:13.559002 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:13.570896 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:13.625866 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a2a698-cb94-4ea0-93e3-a7e7492db00d None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:13.647899 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2b452a-ee13-4743-a03f-ffdba79dccb7 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:13.686045 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8b2698-deef-4a58-9a69-0af8803b12f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:13.686689 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b2698-deef-4a58-9a69-0af8803b12f6 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:13.686966 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b2698-deef-4a58-9a69-0af8803b12f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:13.687236 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b2698-deef-4a58-9a69-0af8803b12f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:13.699853 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8b2698-deef-4a58-9a69-0af8803b12f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:13.701379 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8b2698-deef-4a58-9a69-0af8803b12f6 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:13.709045 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de92c1f-3831-4660-968d-6dcdb2ba2b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:13.709702 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de92c1f-3831-4660-968d-6dcdb2ba2b6d None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:13.709983 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de92c1f-3831-4660-968d-6dcdb2ba2b6d None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:13.710260 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de92c1f-3831-4660-968d-6dcdb2ba2b6d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:13.716495 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-1b8b2698-deef-4a58-9a69-0af8803b12f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:44:13.716495 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:13.716495 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:13.716495 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:13.716495 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:13.716495 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:13.716495 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:13.716495 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:13.716495 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:13.716495 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:13.716495 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:13.716495 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:13.716495 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:44:13.716495 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:44:13.716495 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:44:13.716495 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:44:13.717426 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:13.717426 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:13.717426 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:13.717426 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:13.717426 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:13.717426 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:13.717426 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:13.717426 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:13.717426 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:13.717426 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:13.717426 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:13.717426 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:13.717426 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:13.717426 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:13.717426 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:13.717426 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:13.717426 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:44:13.718309 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:44:13.718309 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:44:13.718309 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:44:13.718309 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 348/692] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:44:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:13.721402 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de92c1f-3831-4660-968d-6dcdb2ba2b6d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:13.722845 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de92c1f-3831-4660-968d-6dcdb2ba2b6d None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:13.725150 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8b2698-deef-4a58-9a69-0af8803b12f6 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:13.743503 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-1de92c1f-3831-4660-968d-6dcdb2ba2b6d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:44:13.743503 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:13.743503 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:13.743503 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:13.743503 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:13.743503 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:13.743503 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:13.743503 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:13.743503 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:13.743503 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:13.743503 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:13.743503 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:13.743503 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 14:44:13.743503 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 14:44:13.743503 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 14:44:13.744464 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 14:44:13.744464 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:13.744464 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:13.744464 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:13.744464 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:13.744464 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:13.744464 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:13.744464 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:13.744464 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:13.744464 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:13.744464 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:13.744464 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:13.744464 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:13.744464 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:13.744464 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:13.744464 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:13.744464 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:13.745385 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 14:44:13.745385 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 14:44:13.745385 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:44:13.745385 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:44:13.745385 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:44:13.745385 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:44:13.745385 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:44:13.745385 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:44:13.748690 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 345/693] 10.222.0.72 () {56 vars in 1111 bytes} [Mon Sep 19 14:44:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:44:13.750176 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ade31a-a815-4586-8d81-16cd1a48fae8 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:13.750783 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ade31a-a815-4586-8d81-16cd1a48fae8 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:13.751256 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ade31a-a815-4586-8d81-16cd1a48fae8 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:13.756820 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 346/694] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:44:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:44:13.757840 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ade31a-a815-4586-8d81-16cd1a48fae8 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:13.816761 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:13.858047 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8b2698-deef-4a58-9a69-0af8803b12f6 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:13.866549 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ade31a-a815-4586-8d81-16cd1a48fae8 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:13.894785 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:13.907544 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14353c10-77d6-4d40-8e83-0c1f6ed5ec34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:13.908726 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14353c10-77d6-4d40-8e83-0c1f6ed5ec34 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:13.909272 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14353c10-77d6-4d40-8e83-0c1f6ed5ec34 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:13.909745 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14353c10-77d6-4d40-8e83-0c1f6ed5ec34 None admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:13.911273 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14353c10-77d6-4d40-8e83-0c1f6ed5ec34 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:13.911802 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14353c10-77d6-4d40-8e83-0c1f6ed5ec34 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:13.913567 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14353c10-77d6-4d40-8e83-0c1f6ed5ec34 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:13.918430 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae882c9-91df-4af9-a9c6-dfaab4adb177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:13.919047 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae882c9-91df-4af9-a9c6-dfaab4adb177 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:13.919328 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae882c9-91df-4af9-a9c6-dfaab4adb177 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:13.919604 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae882c9-91df-4af9-a9c6-dfaab4adb177 None admin] PATH_INFO: `/v3/domains` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:13.920247 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae882c9-91df-4af9-a9c6-dfaab4adb177 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:13.920580 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae882c9-91df-4af9-a9c6-dfaab4adb177 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:13.921983 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae882c9-91df-4af9-a9c6-dfaab4adb177 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:13.930264 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 347/695] 10.222.0.72 () {56 vars in 1148 bytes} [Mon Sep 19 14:44:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:13.931936 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b3e47-8adf-4af6-a2fd-7a4beb3a015c None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:13.932537 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b3e47-8adf-4af6-a2fd-7a4beb3a015c None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:13.933784 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b3e47-8adf-4af6-a2fd-7a4beb3a015c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:13.941718 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 349/696] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Sep 19 14:44:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:13.941718 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae882c9-91df-4af9-a9c6-dfaab4adb177 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:13.961803 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-b00b3e47-8adf-4af6-a2fd-7a4beb3a015c None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:44:13.963480 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-b00b3e47-8adf-4af6-a2fd-7a4beb3a015c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:44:14.056354 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 348/697] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:44:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:44:14.056354 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00b3e47-8adf-4af6-a2fd-7a4beb3a015c None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:14.066650 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae882c9-91df-4af9-a9c6-dfaab4adb177 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:14.130715 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:14.137327 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1723962f-5db9-4980-961b-c7ff288bf0f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:14.138030 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1723962f-5db9-4980-961b-c7ff288bf0f6 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:14.139072 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1723962f-5db9-4980-961b-c7ff288bf0f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:14.139353 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1723962f-5db9-4980-961b-c7ff288bf0f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:14.140098 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1723962f-5db9-4980-961b-c7ff288bf0f6 None admin] RBAC: Adding query filter params (role.id=537cde5f25284acca3c3ea9ff806d724, scope.project.id=51af3a14d665498c9b7a35b34dac0ef1, user.id=8504425c3a414608b030d0cf1af78af5) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:14.140409 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1723962f-5db9-4980-961b-c7ff288bf0f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:14.142856 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1723962f-5db9-4980-961b-c7ff288bf0f6 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:14.154438 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 350/698] 10.222.0.72 () {56 vars in 1374 bytes} [Mon Sep 19 14:44:13 2022] GET /identity/v3/role_assignments?user.id=8504425c3a414608b030d0cf1af78af5&scope.project.id=51af3a14d665498c9b7a35b34dac0ef1&role.id=537cde5f25284acca3c3ea9ff806d724 => generated 608 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:14.213700 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00b3e47-8adf-4af6-a2fd-7a4beb3a015c None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:14.236746 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:14.265056 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20370044-2e76-4f25-af84-55a630313fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:14.265708 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20370044-2e76-4f25-af84-55a630313fb2 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:14.265983 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20370044-2e76-4f25-af84-55a630313fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:14.266249 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20370044-2e76-4f25-af84-55a630313fb2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:14.275325 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20370044-2e76-4f25-af84-55a630313fb2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:14.276898 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20370044-2e76-4f25-af84-55a630313fb2 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:14.298388 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-20370044-2e76-4f25-af84-55a630313fb2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 19 14:44:14.298388 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:14.298388 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:14.298388 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:14.298388 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:14.298388 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:14.298388 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:14.298388 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:14.298388 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:14.298388 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:14.298388 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:14.298388 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:14.298388 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 14:44:14.298388 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 14:44:14.298388 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 14:44:14.298388 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 14:44:14.300205 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:14.300205 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:14.300205 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:44:14.300205 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:44:14.300205 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:44:14.300205 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:44:14.300205 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:14.300205 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:14.300205 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:14.300205 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:14.300205 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:14.300205 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:14.300205 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:14.300205 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:14.300205 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:14.300205 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:14.300205 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:14.300205 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:14.301409 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:14.301409 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:14.301409 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 14:44:14.301409 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 14:44:14.301409 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 14:44:14.301409 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 14:44:14.301409 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 14:44:14.301409 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 14:44:14.301409 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 19 14:44:14.301409 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:44:14.301409 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 349/699] 10.222.0.72 () {56 vars in 1093 bytes} [Mon Sep 19 14:44:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:14.305545 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1723962f-5db9-4980-961b-c7ff288bf0f6 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:14.395771 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20370044-2e76-4f25-af84-55a630313fb2 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:14.441537 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1723962f-5db9-4980-961b-c7ff288bf0f6 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:14.489672 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ea5c42-7a18-4461-b048-340febb1423b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:14.490304 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ea5c42-7a18-4461-b048-340febb1423b None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:14.490552 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ea5c42-7a18-4461-b048-340febb1423b None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:14.490826 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ea5c42-7a18-4461-b048-340febb1423b None admin] PATH_INFO: `/v3/users` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:14.491558 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ea5c42-7a18-4461-b048-340febb1423b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:14.491866 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ea5c42-7a18-4461-b048-340febb1423b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:14.493762 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ea5c42-7a18-4461-b048-340febb1423b None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:14.517047 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 351/700] 10.222.0.72 () {56 vars in 1133 bytes} [Mon Sep 19 14:44:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:14.518905 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20370044-2e76-4f25-af84-55a630313fb2 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:14.524122 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ea5c42-7a18-4461-b048-340febb1423b None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:14.564606 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4771ea9f-d43e-40f4-b855-22e6b2401bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:14.565235 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4771ea9f-d43e-40f4-b855-22e6b2401bdd None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:14.565558 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4771ea9f-d43e-40f4-b855-22e6b2401bdd None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:14.565876 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4771ea9f-d43e-40f4-b855-22e6b2401bdd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:14.580805 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4771ea9f-d43e-40f4-b855-22e6b2401bdd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:14.582273 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4771ea9f-d43e-40f4-b855-22e6b2401bdd None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:14.598134 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-4771ea9f-d43e-40f4-b855-22e6b2401bdd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:44:14.598134 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:14.598134 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:14.598134 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:14.598134 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:14.598134 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:14.598134 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:14.598134 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:14.598134 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:14.598134 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:14.598134 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:14.598134 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:14.598134 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:44:14.598134 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:44:14.598134 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:44:14.598134 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:44:14.599166 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:14.599166 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:14.599166 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:14.599166 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:14.599166 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:14.599166 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:14.599166 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:14.599166 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:14.599166 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:14.599166 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:14.599166 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:14.599166 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:14.599166 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:14.599166 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:14.599166 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:14.599166 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:14.599166 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:44:14.600063 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:44:14.600063 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:44:14.600063 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:44:14.600063 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 350/701] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:44:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:44:14.600763 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf10b61-2685-4060-9033-b8508dadf67b None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:14.600963 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf10b61-2685-4060-9033-b8508dadf67b None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:14.601233 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf10b61-2685-4060-9033-b8508dadf67b None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:14.607398 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 351/702] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:44:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:44:14.608412 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf10b61-2685-4060-9033-b8508dadf67b None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:14.608980 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:14.644688 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:14.658843 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ea5c42-7a18-4461-b048-340febb1423b None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:14.697779 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bd288f-ac72-44d5-b328-7cd59197737f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:14.698318 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bd288f-ac72-44d5-b328-7cd59197737f None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:14.698599 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bd288f-ac72-44d5-b328-7cd59197737f None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:14.698898 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bd288f-ac72-44d5-b328-7cd59197737f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:14.753985 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf10b61-2685-4060-9033-b8508dadf67b None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:14.791668 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5d860f-a766-4598-8532-bcb3c7bee787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:14.791903 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bd288f-ac72-44d5-b328-7cd59197737f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:14.792302 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d860f-a766-4598-8532-bcb3c7bee787 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:14.792707 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d860f-a766-4598-8532-bcb3c7bee787 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:14.793086 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d860f-a766-4598-8532-bcb3c7bee787 None admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:14.793725 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5d860f-a766-4598-8532-bcb3c7bee787 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:14.793831 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bd288f-ac72-44d5-b328-7cd59197737f None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:14.794026 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5d860f-a766-4598-8532-bcb3c7bee787 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:14.795383 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5d860f-a766-4598-8532-bcb3c7bee787 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:14.812360 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 352/703] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Sep 19 14:44:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:44:14.814312 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11106c8-f8be-47a6-bfc3-307babd9ff69 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:14.814598 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11106c8-f8be-47a6-bfc3-307babd9ff69 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:14.814869 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11106c8-f8be-47a6-bfc3-307babd9ff69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:14.838660 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-b11106c8-f8be-47a6-bfc3-307babd9ff69 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:44:14.840426 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-b11106c8-f8be-47a6-bfc3-307babd9ff69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:44:14.857023 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:14.919562 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 352/704] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Sep 19 14:44:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 14:44:14.920627 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bd288f-ac72-44d5-b328-7cd59197737f None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:14.932145 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 353/705] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:44:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:44:14.933326 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11106c8-f8be-47a6-bfc3-307babd9ff69 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:14.968658 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:15.079757 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bd288f-ac72-44d5-b328-7cd59197737f None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:15.126466 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11106c8-f8be-47a6-bfc3-307babd9ff69 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:15.160473 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f841e051-a1eb-4989-98c2-919b6a0dc074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:15.161094 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f841e051-a1eb-4989-98c2-919b6a0dc074 None admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:15.161377 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f841e051-a1eb-4989-98c2-919b6a0dc074 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:15.161652 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f841e051-a1eb-4989-98c2-919b6a0dc074 None admin] PATH_INFO: `/v3/users` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:15.162307 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f841e051-a1eb-4989-98c2-919b6a0dc074 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:15.163757 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f841e051-a1eb-4989-98c2-919b6a0dc074 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:15.189222 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aea11f-de8a-4e1c-874b-bd82d1a09343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:15.189857 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aea11f-de8a-4e1c-874b-bd82d1a09343 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:15.190134 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aea11f-de8a-4e1c-874b-bd82d1a09343 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:15.190405 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aea11f-de8a-4e1c-874b-bd82d1a09343 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:15.207433 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 353/706] 10.222.0.72 () {60 vars in 1132 bytes} [Mon Sep 19 14:44:14 2022] POST /identity/v3/users => generated 254 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:44:15.211387 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aea11f-de8a-4e1c-874b-bd82d1a09343 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:15.212929 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aea11f-de8a-4e1c-874b-bd82d1a09343 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:15.221483 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f841e051-a1eb-4989-98c2-919b6a0dc074 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:15.238976 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:15.245022 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-80aea11f-de8a-4e1c-874b-bd82d1a09343 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:44:15.245022 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:15.245022 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:15.245022 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:15.245022 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:15.245022 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:15.245022 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:15.245022 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:15.245022 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:15.245022 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:15.245022 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:15.245022 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:15.245022 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:44:15.245022 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:44:15.245022 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:44:15.245022 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:44:15.247074 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:15.247074 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:15.247074 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:15.247074 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:15.247074 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:15.247074 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:15.247074 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:15.247074 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:15.247074 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:15.247074 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:15.247074 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:15.247074 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:15.247074 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:15.247074 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:15.247074 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:15.247074 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:15.247074 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:44:15.248290 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:44:15.248290 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:44:15.248290 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:44:15.248290 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 354/707] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:44:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:15.258444 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aea11f-de8a-4e1c-874b-bd82d1a09343 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:15.396137 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:15.412767 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f841e051-a1eb-4989-98c2-919b6a0dc074 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:15.436983 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aea11f-de8a-4e1c-874b-bd82d1a09343 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:15.458069 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71adabb-f268-4d42-b2ae-48e7835f1d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:15.458821 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71adabb-f268-4d42-b2ae-48e7835f1d04 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:15.459102 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71adabb-f268-4d42-b2ae-48e7835f1d04 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:15.459374 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71adabb-f268-4d42-b2ae-48e7835f1d04 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:15.459960 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71adabb-f268-4d42-b2ae-48e7835f1d04 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:15.461362 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71adabb-f268-4d42-b2ae-48e7835f1d04 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:15.473875 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-d71adabb-f268-4d42-b2ae-48e7835f1d04 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 19 14:44:15.473875 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:15.473875 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 14:44:15.473875 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 14:44:15.473875 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 14:44:15.473875 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 14:44:15.473875 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 14:44:15.473875 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:44:15.473875 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 19 14:44:15.473875 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:44:15.473875 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 14:44:15.473875 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:44:15.473875 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:15.473875 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:15.473875 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:15.473875 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:15.473875 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:15.474888 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:15.474888 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:15.474888 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:15.474888 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:15.474888 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:15.474888 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:15.474888 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 14:44:15.474888 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 14:44:15.474888 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 14:44:15.474888 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 14:44:15.474888 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:15.474888 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:15.474888 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:15.474888 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:15.474888 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:15.474888 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:15.475730 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:15.475730 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:15.475730 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:15.475730 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:15.475730 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:15.475730 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:15.475730 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:15.475730 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:15.475730 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:15.475730 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:15.475730 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 14:44:15.475730 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:44:15.475730 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 19 14:44:15.475730 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:44:15.475730 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 354/708] 10.222.0.72 () {56 vars in 1129 bytes} [Mon Sep 19 14:44:15 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:44:15.480779 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71adabb-f268-4d42-b2ae-48e7835f1d04 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:15.505526 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1419372f-fc16-458d-bde0-3f0c554570f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:15.506144 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1419372f-fc16-458d-bde0-3f0c554570f7 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:15.506517 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1419372f-fc16-458d-bde0-3f0c554570f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:15.506788 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1419372f-fc16-458d-bde0-3f0c554570f7 None admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:15.507536 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1419372f-fc16-458d-bde0-3f0c554570f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:15.507835 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1419372f-fc16-458d-bde0-3f0c554570f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:15.509229 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1419372f-fc16-458d-bde0-3f0c554570f7 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:15.527529 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 355/709] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Sep 19 14:44:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:15.533359 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1419372f-fc16-458d-bde0-3f0c554570f7 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:15.572690 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:15.595101 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71adabb-f268-4d42-b2ae-48e7835f1d04 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:15.661767 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082b799d-565b-45bb-9d60-ff2c3175acc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:15.662407 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082b799d-565b-45bb-9d60-ff2c3175acc2 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:15.662686 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082b799d-565b-45bb-9d60-ff2c3175acc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:15.662958 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082b799d-565b-45bb-9d60-ff2c3175acc2 None admin] PATH_INFO: `/v3/services` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:15.663619 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082b799d-565b-45bb-9d60-ff2c3175acc2 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:15.663922 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082b799d-565b-45bb-9d60-ff2c3175acc2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:15.665391 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082b799d-565b-45bb-9d60-ff2c3175acc2 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:15.675280 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 355/710] 10.222.0.72 () {56 vars in 1124 bytes} [Mon Sep 19 14:44:15 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:15.689361 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082b799d-565b-45bb-9d60-ff2c3175acc2 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:15.718546 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1419372f-fc16-458d-bde0-3f0c554570f7 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:15.798788 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:15.816267 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082b799d-565b-45bb-9d60-ff2c3175acc2 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:15.820201 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abde745b-075b-40e2-a633-7b3c76f0886b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:15.820878 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde745b-075b-40e2-a633-7b3c76f0886b None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:15.821160 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde745b-075b-40e2-a633-7b3c76f0886b None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:15.821434 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde745b-075b-40e2-a633-7b3c76f0886b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:15.830154 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abde745b-075b-40e2-a633-7b3c76f0886b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:15.831600 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abde745b-075b-40e2-a633-7b3c76f0886b None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:15.843358 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-abde745b-075b-40e2-a633-7b3c76f0886b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:44:15.843358 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:15.843358 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:15.843358 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:15.843358 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:15.843358 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:15.843358 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:15.843358 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:15.843358 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:15.843358 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:15.843358 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:15.843358 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:15.843358 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 14:44:15.843358 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 14:44:15.843358 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 14:44:15.844320 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 14:44:15.844320 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:15.844320 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:15.844320 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:15.844320 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:15.844320 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:15.844320 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:15.844320 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:15.844320 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:15.844320 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:15.844320 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:15.844320 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:15.844320 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:15.844320 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:15.844320 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:15.844320 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:15.844320 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:15.845264 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 14:44:15.845264 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 14:44:15.845264 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:44:15.845264 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:44:15.845264 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:44:15.845264 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:44:15.845264 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:44:15.845264 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:44:15.849219 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 356/711] 10.222.0.72 () {56 vars in 1111 bytes} [Mon Sep 19 14:44:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:15.850477 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d42d0-01ed-4f3c-a812-ef6c4631beb2 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:15.850751 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d42d0-01ed-4f3c-a812-ef6c4631beb2 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:15.851030 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d42d0-01ed-4f3c-a812-ef6c4631beb2 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:15.853028 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 357/712] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:44:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:44:15.853738 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854d42d0-01ed-4f3c-a812-ef6c4631beb2 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:15.861143 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c58474a-4a39-4977-85bb-7058028edcf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:15.862072 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c58474a-4a39-4977-85bb-7058028edcf4 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:15.862555 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c58474a-4a39-4977-85bb-7058028edcf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:15.863038 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c58474a-4a39-4977-85bb-7058028edcf4 None admin] PATH_INFO: `/v3/services` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:15.864359 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c58474a-4a39-4977-85bb-7058028edcf4 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:15.864876 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c58474a-4a39-4977-85bb-7058028edcf4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:15.866842 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c58474a-4a39-4977-85bb-7058028edcf4 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:15.874139 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 356/713] 10.222.0.72 () {56 vars in 1124 bytes} [Mon Sep 19 14:44:15 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:44:15.875619 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06c94b0-3c53-4166-845f-98e0425afa95 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:15.876108 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06c94b0-3c53-4166-845f-98e0425afa95 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:15.876615 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06c94b0-3c53-4166-845f-98e0425afa95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:15.897693 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-f06c94b0-3c53-4166-845f-98e0425afa95 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:44:15.899378 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-f06c94b0-3c53-4166-845f-98e0425afa95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:44:15.921875 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:15.980227 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 357/714] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:44:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:44:16.071319 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854d42d0-01ed-4f3c-a812-ef6c4631beb2 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:16.127157 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65acf394-f157-4069-95a6-1f66b9ae9476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:16.127781 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65acf394-f157-4069-95a6-1f66b9ae9476 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:16.128059 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65acf394-f157-4069-95a6-1f66b9ae9476 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:16.128344 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65acf394-f157-4069-95a6-1f66b9ae9476 None admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:16.129053 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65acf394-f157-4069-95a6-1f66b9ae9476 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:16.129358 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65acf394-f157-4069-95a6-1f66b9ae9476 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:16.130821 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65acf394-f157-4069-95a6-1f66b9ae9476 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:16.150071 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 358/715] 10.222.0.72 () {56 vars in 1148 bytes} [Mon Sep 19 14:44:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:16.156493 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06c94b0-3c53-4166-845f-98e0425afa95 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:16.268187 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06c94b0-3c53-4166-845f-98e0425afa95 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:16.299219 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65acf394-f157-4069-95a6-1f66b9ae9476 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:16.301120 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:16.307319 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3b956b-8f9b-48cc-a516-839d51412273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:16.308545 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3b956b-8f9b-48cc-a516-839d51412273 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:16.309035 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3b956b-8f9b-48cc-a516-839d51412273 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:16.309549 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3b956b-8f9b-48cc-a516-839d51412273 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:16.310485 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3b956b-8f9b-48cc-a516-839d51412273 None admin] RBAC: Adding query filter params (role.id=ddb643577b2e4e478100ec370decfaeb, scope.project.id=51af3a14d665498c9b7a35b34dac0ef1, user.id=055439dc35e946f4a82535c684f9b60d) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:16.310996 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3b956b-8f9b-48cc-a516-839d51412273 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:16.313140 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3b956b-8f9b-48cc-a516-839d51412273 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:16.320493 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 358/716] 10.222.0.72 () {56 vars in 1374 bytes} [Mon Sep 19 14:44:16 2022] GET /identity/v3/role_assignments?user.id=055439dc35e946f4a82535c684f9b60d&scope.project.id=51af3a14d665498c9b7a35b34dac0ef1&role.id=ddb643577b2e4e478100ec370decfaeb => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:16.376801 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:16.456353 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65acf394-f157-4069-95a6-1f66b9ae9476 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:16.512660 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f4dfb3-95bf-4484-ace4-d4c1a894246e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:16.513308 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f4dfb3-95bf-4484-ace4-d4c1a894246e None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:16.513586 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f4dfb3-95bf-4484-ace4-d4c1a894246e None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:16.513857 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f4dfb3-95bf-4484-ace4-d4c1a894246e None admin] PATH_INFO: `/v3/services/network` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:16.514441 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f4dfb3-95bf-4484-ace4-d4c1a894246e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:16.515841 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f4dfb3-95bf-4484-ace4-d4c1a894246e None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:16.531433 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-b7f4dfb3-95bf-4484-ace4-d4c1a894246e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 19 14:44:16.531433 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:16.531433 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 14:44:16.531433 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 14:44:16.531433 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 14:44:16.531433 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 14:44:16.531433 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 14:44:16.531433 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:44:16.531433 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 19 14:44:16.531433 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:44:16.531433 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 14:44:16.531433 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:44:16.531433 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:16.531433 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:16.531433 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:16.531433 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:16.531433 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:16.532507 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:16.532507 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:16.532507 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:16.532507 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:16.532507 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:16.532507 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:16.532507 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 14:44:16.532507 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 14:44:16.532507 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 14:44:16.532507 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 14:44:16.532507 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:16.532507 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:16.532507 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:16.532507 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:16.532507 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:16.532507 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:16.533384 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:16.533384 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:16.533384 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:16.533384 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:16.533384 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:16.533384 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:16.533384 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:16.533384 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:16.533384 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:16.533384 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:16.533384 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 14:44:16.533384 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:44:16.533384 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 19 14:44:16.533384 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:44:16.533384 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 359/717] 10.222.0.72 () {56 vars in 1111 bytes} [Mon Sep 19 14:44:16 2022] GET /identity/v3/services/network => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:44:16.538448 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3b956b-8f9b-48cc-a516-839d51412273 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:16.693127 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3b956b-8f9b-48cc-a516-839d51412273 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:16.746322 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9b972a-2056-4009-9124-2df7f5b4d78e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:16.746998 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9b972a-2056-4009-9124-2df7f5b4d78e None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:16.747218 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9b972a-2056-4009-9124-2df7f5b4d78e None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:16.747493 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9b972a-2056-4009-9124-2df7f5b4d78e None admin] PATH_INFO: `/v3/services` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:16.748121 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9b972a-2056-4009-9124-2df7f5b4d78e None admin] RBAC: Adding query filter params (name=network) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:16.748452 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9b972a-2056-4009-9124-2df7f5b4d78e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:16.749898 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9b972a-2056-4009-9124-2df7f5b4d78e None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:16.760557 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 359/718] 10.222.0.72 () {56 vars in 1112 bytes} [Mon Sep 19 14:44:16 2022] GET /identity/v3/services?name=network => generated 124 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:16.766243 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f4dfb3-95bf-4484-ace4-d4c1a894246e None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:16.890927 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd178f23-81ea-4182-86f3-af18365eff12 None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:16.891293 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd178f23-81ea-4182-86f3-af18365eff12 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:16.891479 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd178f23-81ea-4182-86f3-af18365eff12 None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:16.894195 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 360/719] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:44:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 14:44:16.900508 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd8bc8e-4ec6-46ba-9586-dd3e0588f24a None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:16.901063 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd8bc8e-4ec6-46ba-9586-dd3e0588f24a None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:16.901541 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd8bc8e-4ec6-46ba-9586-dd3e0588f24a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:16.912007 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f4dfb3-95bf-4484-ace4-d4c1a894246e None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:16.921479 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-8bd8bc8e-4ec6-46ba-9586-dd3e0588f24a None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:44:16.923152 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-8bd8bc8e-4ec6-46ba-9586-dd3e0588f24a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:44:16.938037 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:16.979767 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78104ed-865b-4ab1-a957-26107f5b5629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:16.981571 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78104ed-865b-4ab1-a957-26107f5b5629 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:16.982061 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78104ed-865b-4ab1-a957-26107f5b5629 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:16.982535 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78104ed-865b-4ab1-a957-26107f5b5629 None admin] PATH_INFO: `/v3/services` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:16.983369 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78104ed-865b-4ab1-a957-26107f5b5629 None admin] RBAC: Adding query filter params (type=network) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:16.984070 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78104ed-865b-4ab1-a957-26107f5b5629 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:16.985683 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78104ed-865b-4ab1-a957-26107f5b5629 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:17.000448 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 360/720] 10.222.0.72 () {56 vars in 1112 bytes} [Mon Sep 19 14:44:16 2022] GET /identity/v3/services?type=network => generated 124 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:17.019748 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 361/721] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:44:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 14:44:17.020699 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:17.360966 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78104ed-865b-4ab1-a957-26107f5b5629 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:17.485521 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78104ed-865b-4ab1-a957-26107f5b5629 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:17.533036 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1562dff3-cbc9-4241-851f-21b17136da42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:17.533676 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1562dff3-cbc9-4241-851f-21b17136da42 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:17.533956 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1562dff3-cbc9-4241-851f-21b17136da42 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:17.534226 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1562dff3-cbc9-4241-851f-21b17136da42 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:17.546796 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1562dff3-cbc9-4241-851f-21b17136da42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:44:17.552776 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-1562dff3-cbc9-4241-851f-21b17136da42 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:44:17.552776 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:17.552776 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:17.552776 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:17.552776 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:17.552776 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:17.552776 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:17.552776 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:17.552776 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:17.552776 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:17.552776 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:17.552776 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:17.552776 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:44:17.552776 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:44:17.552776 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:44:17.552776 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:44:17.553780 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:44:17.553780 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:44:17.553780 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:44:17.553780 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:44:17.553780 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:17.553780 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:17.553780 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:17.553780 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:17.553780 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:17.553780 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:17.553780 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:17.553780 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:17.553780 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:17.553780 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:17.553780 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:17.553780 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:17.554590 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:17.554590 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:17.554590 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:17.554590 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:17.554590 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:44:17.554590 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:44:17.554590 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:44:17.554590 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:44:17.554590 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:44:17.554590 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:44:17.554590 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:44:17.554590 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:44:17.554590 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 361/722] 10.222.0.72 () {56 vars in 1096 bytes} [Mon Sep 19 14:44:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:17.561212 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd8bc8e-4ec6-46ba-9586-dd3e0588f24a None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:17.665040 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd8bc8e-4ec6-46ba-9586-dd3e0588f24a None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:17.701624 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45287379-7d77-44bb-aff6-ca4c45956ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:17.702240 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45287379-7d77-44bb-aff6-ca4c45956ef0 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:17.702502 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45287379-7d77-44bb-aff6-ca4c45956ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:17.702777 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45287379-7d77-44bb-aff6-ca4c45956ef0 None admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:17.703449 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45287379-7d77-44bb-aff6-ca4c45956ef0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:17.703756 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45287379-7d77-44bb-aff6-ca4c45956ef0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:17.705172 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45287379-7d77-44bb-aff6-ca4c45956ef0 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:17.715075 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 362/723] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Sep 19 14:44:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:17.721685 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1562dff3-cbc9-4241-851f-21b17136da42 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:17.761237 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:17.833939 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1562dff3-cbc9-4241-851f-21b17136da42 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:17.878490 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aaed78-5a4c-4bdb-8063-bce25be8a425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:17.879268 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aaed78-5a4c-4bdb-8063-bce25be8a425 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:17.879620 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aaed78-5a4c-4bdb-8063-bce25be8a425 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:17.879963 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aaed78-5a4c-4bdb-8063-bce25be8a425 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:17.893845 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aaed78-5a4c-4bdb-8063-bce25be8a425 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:17.895382 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aaed78-5a4c-4bdb-8063-bce25be8a425 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:17.911790 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-d4aaed78-5a4c-4bdb-8063-bce25be8a425 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:44:17.911790 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:17.911790 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:17.911790 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:17.911790 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:17.911790 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:17.911790 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:17.911790 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:17.911790 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:17.911790 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:17.911790 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:17.911790 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:17.911790 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:44:17.911790 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:44:17.911790 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:44:17.911790 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:44:17.912847 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:17.912847 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:17.912847 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:17.912847 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:17.912847 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:17.912847 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:17.912847 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:17.912847 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:17.912847 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:17.912847 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:17.912847 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:17.912847 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:17.912847 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:17.912847 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:17.912847 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:17.912847 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:17.912847 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:44:17.913775 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:44:17.913775 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:44:17.913775 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:44:17.913775 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 362/724] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:44:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:17.919570 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45287379-7d77-44bb-aff6-ca4c45956ef0 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:17.977090 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:17.982505 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7067969-eccf-4b83-84fa-547319e1d593 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:17.983985 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7067969-eccf-4b83-84fa-547319e1d593 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:17.983985 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7067969-eccf-4b83-84fa-547319e1d593 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:17.984410 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 363/725] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:44:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:44:17.989837 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ec9d8-217f-4ec8-986f-262e97252137 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:17.990120 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ec9d8-217f-4ec8-986f-262e97252137 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:17.990396 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ec9d8-217f-4ec8-986f-262e97252137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:18.024480 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-d19ec9d8-217f-4ec8-986f-262e97252137 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:44:18.025687 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-d19ec9d8-217f-4ec8-986f-262e97252137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:44:18.056512 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45287379-7d77-44bb-aff6-ca4c45956ef0 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:18.095448 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802ba063-91ac-413d-b0ea-18820d06a44d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:18.096069 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802ba063-91ac-413d-b0ea-18820d06a44d None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:18.096370 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802ba063-91ac-413d-b0ea-18820d06a44d None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:18.096654 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802ba063-91ac-413d-b0ea-18820d06a44d None admin] PATH_INFO: `/v3/domains` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:18.097304 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802ba063-91ac-413d-b0ea-18820d06a44d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:18.097610 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802ba063-91ac-413d-b0ea-18820d06a44d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:18.098985 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802ba063-91ac-413d-b0ea-18820d06a44d None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:18.134323 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 363/726] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Sep 19 14:44:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:18.140239 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802ba063-91ac-413d-b0ea-18820d06a44d None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:18.180494 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 364/727] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:44:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 14:44:18.268461 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802ba063-91ac-413d-b0ea-18820d06a44d None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:18.283495 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:18.308991 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e9ff92-42ec-4b2c-9452-9884ce566e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:18.309662 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e9ff92-42ec-4b2c-9452-9884ce566e93 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:18.310012 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e9ff92-42ec-4b2c-9452-9884ce566e93 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:18.310337 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e9ff92-42ec-4b2c-9452-9884ce566e93 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:18.318651 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e9ff92-42ec-4b2c-9452-9884ce566e93 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:18.320113 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e9ff92-42ec-4b2c-9452-9884ce566e93 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:18.333121 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-d2e9ff92-42ec-4b2c-9452-9884ce566e93 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 19 14:44:18.333121 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:18.333121 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:18.333121 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:18.333121 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:18.333121 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:18.333121 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:18.333121 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:18.333121 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:18.333121 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:18.333121 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:18.333121 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:18.333121 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 14:44:18.333121 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 14:44:18.333121 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 14:44:18.333121 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 14:44:18.334096 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:18.334096 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:18.334096 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:44:18.334096 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:44:18.334096 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:44:18.334096 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:44:18.334096 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:18.334096 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:18.334096 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:18.334096 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:18.334096 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:18.334096 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:18.334096 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:18.334096 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:18.334096 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:18.334096 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:18.334096 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:18.334096 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:18.335015 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:18.335015 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:18.335015 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 14:44:18.335015 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 14:44:18.335015 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 14:44:18.335015 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 14:44:18.335015 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 14:44:18.335015 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 14:44:18.335015 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 19 14:44:18.335015 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:44:18.335015 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 364/728] 10.222.0.72 () {56 vars in 1096 bytes} [Mon Sep 19 14:44:18 2022] GET /identity/v3/users/swift => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:44:18.340888 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19ec9d8-217f-4ec8-986f-262e97252137 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:18.361155 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:18.448183 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19ec9d8-217f-4ec8-986f-262e97252137 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:18.485102 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebd3925-b552-4598-b241-c8e410aa7c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:18.485715 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebd3925-b552-4598-b241-c8e410aa7c61 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:18.486307 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebd3925-b552-4598-b241-c8e410aa7c61 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:18.486307 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebd3925-b552-4598-b241-c8e410aa7c61 None admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:18.486971 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebd3925-b552-4598-b241-c8e410aa7c61 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:18.487279 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebd3925-b552-4598-b241-c8e410aa7c61 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:18.488745 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebd3925-b552-4598-b241-c8e410aa7c61 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:18.506737 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 365/729] 10.222.0.72 () {56 vars in 1135 bytes} [Mon Sep 19 14:44:18 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:18.512970 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e9ff92-42ec-4b2c-9452-9884ce566e93 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:18.620304 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e9ff92-42ec-4b2c-9452-9884ce566e93 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:18.649165 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebd3925-b552-4598-b241-c8e410aa7c61 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:18.657319 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5603828e-8ff8-488e-9c8e-3b5b31f8d482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:18.658243 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5603828e-8ff8-488e-9c8e-3b5b31f8d482 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:18.658750 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5603828e-8ff8-488e-9c8e-3b5b31f8d482 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:18.659220 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5603828e-8ff8-488e-9c8e-3b5b31f8d482 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:18.703874 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:18.733588 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5603828e-8ff8-488e-9c8e-3b5b31f8d482 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:18.735369 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5603828e-8ff8-488e-9c8e-3b5b31f8d482 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:18.824900 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:18.862208 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 365/730] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Sep 19 14:44:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 14:44:18.866283 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebd3925-b552-4598-b241-c8e410aa7c61 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:18.868208 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5603828e-8ff8-488e-9c8e-3b5b31f8d482 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:18.939044 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a9316f-3846-461f-acea-9aae3d751997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:18.939694 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a9316f-3846-461f-acea-9aae3d751997 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:18.939976 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a9316f-3846-461f-acea-9aae3d751997 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:18.940249 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a9316f-3846-461f-acea-9aae3d751997 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:18.954349 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a9316f-3846-461f-acea-9aae3d751997 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:44:18.961046 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-21a9316f-3846-461f-acea-9aae3d751997 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:44:18.961046 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:18.961046 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:18.961046 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:18.961046 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:18.961046 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:18.961046 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:18.961046 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:18.961046 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:18.961046 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:18.961046 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:18.961046 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:18.961046 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:44:18.961046 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:44:18.961046 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:44:18.961046 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:44:18.962057 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:44:18.962057 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:44:18.962057 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:44:18.962057 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:44:18.962057 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:18.962057 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:18.962057 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:18.962057 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:18.962057 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:18.962057 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:18.962057 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:18.962057 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:18.962057 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:18.962057 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:18.962057 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:18.962057 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:18.963380 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:18.963380 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:18.963380 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:18.963380 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:18.963380 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:44:18.963380 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:44:18.963380 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:44:18.963380 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:44:18.963380 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:44:18.963380 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:44:18.963380 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:44:18.963380 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:44:18.963380 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 366/731] 10.222.0.72 () {56 vars in 1102 bytes} [Mon Sep 19 14:44:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:18.965539 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266cfbf-db4b-4244-a2d6-d6a8eb26d08c None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:18.965539 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266cfbf-db4b-4244-a2d6-d6a8eb26d08c None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:18.965539 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266cfbf-db4b-4244-a2d6-d6a8eb26d08c None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:18.967019 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 367/732] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:44:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:44:18.970730 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a266cfbf-db4b-4244-a2d6-d6a8eb26d08c None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:18.984517 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:19.025895 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5603828e-8ff8-488e-9c8e-3b5b31f8d482 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:19.068309 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9a99cc-a0e0-4ac1-83d6-c22bf338fba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:19.068966 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9a99cc-a0e0-4ac1-83d6-c22bf338fba9 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:19.069247 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9a99cc-a0e0-4ac1-83d6-c22bf338fba9 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:19.069945 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9a99cc-a0e0-4ac1-83d6-c22bf338fba9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:19.080656 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9a99cc-a0e0-4ac1-83d6-c22bf338fba9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:19.082079 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9a99cc-a0e0-4ac1-83d6-c22bf338fba9 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:19.082622 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a266cfbf-db4b-4244-a2d6-d6a8eb26d08c None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:19.097471 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-1e9a99cc-a0e0-4ac1-83d6-c22bf338fba9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:44:19.097471 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:19.097471 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:19.097471 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:19.097471 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:19.097471 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:19.097471 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:19.097471 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:19.097471 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:19.097471 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:19.097471 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:19.097471 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:19.097471 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:44:19.097471 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:44:19.097471 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:44:19.097471 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:44:19.098432 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:19.098432 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:19.098432 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:19.098432 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:19.098432 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:19.098432 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:19.098432 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:19.098432 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:19.098432 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:19.098432 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:19.098432 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:19.098432 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:19.098432 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:19.098432 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:19.098432 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:19.098432 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:19.098432 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:44:19.099915 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:44:19.099915 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:44:19.099915 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:44:19.099915 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 366/733] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:44:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:19.100145 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df17489f-ac16-476a-9dc2-7d7b7e47c9a5 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:19.100764 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df17489f-ac16-476a-9dc2-7d7b7e47c9a5 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:19.100764 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df17489f-ac16-476a-9dc2-7d7b7e47c9a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:19.119493 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-df17489f-ac16-476a-9dc2-7d7b7e47c9a5 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:44:19.120749 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-df17489f-ac16-476a-9dc2-7d7b7e47c9a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:44:19.125742 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d8edba-3bd4-42b9-9116-cea18c502454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:19.126352 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d8edba-3bd4-42b9-9116-cea18c502454 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:19.126635 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d8edba-3bd4-42b9-9116-cea18c502454 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:19.126908 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d8edba-3bd4-42b9-9116-cea18c502454 None admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:19.127564 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d8edba-3bd4-42b9-9116-cea18c502454 None admin] RBAC: Adding query filter params (name=service) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:19.127870 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d8edba-3bd4-42b9-9116-cea18c502454 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:19.129697 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d8edba-3bd4-42b9-9116-cea18c502454 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:19.132934 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:19.140349 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 368/734] 10.222.0.72 () {56 vars in 1103 bytes} [Mon Sep 19 14:44:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:19.141556 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7cad1c-d502-4d72-acb0-d0f1c855f8e6 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:19.141834 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7cad1c-d502-4d72-acb0-d0f1c855f8e6 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:19.142100 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7cad1c-d502-4d72-acb0-d0f1c855f8e6 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:19.145244 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 369/735] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:44:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:44:19.146701 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7cad1c-d502-4d72-acb0-d0f1c855f8e6 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:19.201384 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 367/736] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:44:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:44:19.202529 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df17489f-ac16-476a-9dc2-7d7b7e47c9a5 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:19.271258 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:19.288858 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7cad1c-d502-4d72-acb0-d0f1c855f8e6 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:19.326089 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df17489f-ac16-476a-9dc2-7d7b7e47c9a5 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:19.334255 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f064485-4a87-4c87-a213-878334e26844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:19.335278 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f064485-4a87-4c87-a213-878334e26844 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:19.335570 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f064485-4a87-4c87-a213-878334e26844 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:19.335848 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f064485-4a87-4c87-a213-878334e26844 None admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:19.336529 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f064485-4a87-4c87-a213-878334e26844 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:19.336854 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f064485-4a87-4c87-a213-878334e26844 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:19.338612 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f064485-4a87-4c87-a213-878334e26844 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:19.356248 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 370/737] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Sep 19 14:44:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:19.357838 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c7fbdf-937a-425d-ace8-48a99a6aa57f None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:19.358316 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c7fbdf-937a-425d-ace8-48a99a6aa57f None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:19.358779 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c7fbdf-937a-425d-ace8-48a99a6aa57f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:19.375463 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b536945f-1add-4401-b2be-b8aa09db37b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:19.376109 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b536945f-1add-4401-b2be-b8aa09db37b5 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:19.376470 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b536945f-1add-4401-b2be-b8aa09db37b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:19.376751 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b536945f-1add-4401-b2be-b8aa09db37b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:19.379580 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-58c7fbdf-937a-425d-ace8-48a99a6aa57f None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:44:19.381142 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-58c7fbdf-937a-425d-ace8-48a99a6aa57f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:44:19.388145 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b536945f-1add-4401-b2be-b8aa09db37b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:19.389678 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b536945f-1add-4401-b2be-b8aa09db37b5 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:19.406738 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-b536945f-1add-4401-b2be-b8aa09db37b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:44:19.406738 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:19.406738 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:19.406738 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:19.406738 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:19.406738 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:19.406738 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:19.406738 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:19.406738 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:19.406738 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:19.406738 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:19.406738 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:19.406738 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:44:19.406738 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:44:19.406738 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:44:19.406738 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:44:19.407689 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:19.407689 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:19.407689 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:19.407689 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:19.407689 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:19.407689 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:19.407689 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:19.407689 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:19.407689 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:19.407689 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:19.407689 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:19.407689 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:19.407689 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:19.407689 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:19.407689 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:19.407689 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:19.407689 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:44:19.409264 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:44:19.409264 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:44:19.409264 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:44:19.409264 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 368/738] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:44:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:19.409264 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b536945f-1add-4401-b2be-b8aa09db37b5 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:19.451468 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:19.471388 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 371/739] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:44:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:44:19.472934 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c7fbdf-937a-425d-ace8-48a99a6aa57f None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:19.541833 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b536945f-1add-4401-b2be-b8aa09db37b5 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:19.559980 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:19.587380 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efccdfd1-7851-4a4b-9e5e-a409b99cc823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:19.588029 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efccdfd1-7851-4a4b-9e5e-a409b99cc823 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:19.588313 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efccdfd1-7851-4a4b-9e5e-a409b99cc823 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:19.588625 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efccdfd1-7851-4a4b-9e5e-a409b99cc823 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:19.600147 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efccdfd1-7851-4a4b-9e5e-a409b99cc823 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:19.602097 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efccdfd1-7851-4a4b-9e5e-a409b99cc823 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:19.610601 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c7fbdf-937a-425d-ace8-48a99a6aa57f None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:19.617477 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-efccdfd1-7851-4a4b-9e5e-a409b99cc823 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:44:19.617477 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:19.617477 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:19.617477 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:19.617477 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:19.617477 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:19.617477 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:19.617477 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:19.617477 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:19.617477 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:19.617477 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:19.617477 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:19.617477 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 14:44:19.617477 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 14:44:19.617477 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 14:44:19.618443 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 14:44:19.618443 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:19.618443 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:19.618443 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:19.618443 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:19.618443 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:19.618443 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:19.618443 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:19.618443 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:19.618443 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:19.618443 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:19.618443 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:19.618443 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:19.618443 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:19.618443 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:19.618443 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:19.618443 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:19.619317 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 14:44:19.619317 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 14:44:19.619317 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:44:19.619317 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:44:19.619317 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:44:19.619317 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:44:19.619317 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:44:19.619317 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:44:19.624443 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 369/740] 10.222.0.72 () {56 vars in 1111 bytes} [Mon Sep 19 14:44:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:19.625192 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efccdfd1-7851-4a4b-9e5e-a409b99cc823 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:19.657506 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb9aa37-1b62-4659-a921-1df8ed687e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:19.658161 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb9aa37-1b62-4659-a921-1df8ed687e1e None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:19.658385 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb9aa37-1b62-4659-a921-1df8ed687e1e None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:19.658659 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb9aa37-1b62-4659-a921-1df8ed687e1e None admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:19.659293 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb9aa37-1b62-4659-a921-1df8ed687e1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:19.659683 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb9aa37-1b62-4659-a921-1df8ed687e1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:19.661016 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb9aa37-1b62-4659-a921-1df8ed687e1e None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:19.673330 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 372/741] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Sep 19 14:44:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:19.674275 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb9aa37-1b62-4659-a921-1df8ed687e1e None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:19.726884 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:19.754494 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efccdfd1-7851-4a4b-9e5e-a409b99cc823 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:19.785533 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb9aa37-1b62-4659-a921-1df8ed687e1e None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:19.789140 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77d3fe6-63e2-4f8e-928d-a3101ef8f32e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:19.789747 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d3fe6-63e2-4f8e-928d-a3101ef8f32e None admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:19.790043 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d3fe6-63e2-4f8e-928d-a3101ef8f32e None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:19.790301 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d3fe6-63e2-4f8e-928d-a3101ef8f32e None admin] PATH_INFO: `/v3/services` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:19.790947 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77d3fe6-63e2-4f8e-928d-a3101ef8f32e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:19.792397 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77d3fe6-63e2-4f8e-928d-a3101ef8f32e None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:19.809406 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 370/742] 10.222.0.72 () {60 vars in 1141 bytes} [Mon Sep 19 14:44:19 2022] POST /identity/v3/services => generated 251 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:44:19.810221 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77d3fe6-63e2-4f8e-928d-a3101ef8f32e None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:19.840010 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:19.845176 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4790acc-3d73-4592-8a5f-067e58551187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:19.845603 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4790acc-3d73-4592-8a5f-067e58551187 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:19.845988 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4790acc-3d73-4592-8a5f-067e58551187 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:19.846158 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4790acc-3d73-4592-8a5f-067e58551187 None admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:19.846933 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4790acc-3d73-4592-8a5f-067e58551187 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:19.847164 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4790acc-3d73-4592-8a5f-067e58551187 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:19.848655 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4790acc-3d73-4592-8a5f-067e58551187 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:19.869205 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 373/743] 10.222.0.72 () {56 vars in 1148 bytes} [Mon Sep 19 14:44:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:19.869205 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f4ec14-93cc-40f6-832e-1319d9caf15b None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:19.869205 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f4ec14-93cc-40f6-832e-1319d9caf15b None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:19.869205 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f4ec14-93cc-40f6-832e-1319d9caf15b None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:19.869205 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 374/744] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:44:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:44:19.870276 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f4ec14-93cc-40f6-832e-1319d9caf15b None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:19.935855 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77d3fe6-63e2-4f8e-928d-a3101ef8f32e None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:19.977922 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6944b5-25b9-4ab4-b9da-397a28d19421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:19.978570 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6944b5-25b9-4ab4-b9da-397a28d19421 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:19.979220 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6944b5-25b9-4ab4-b9da-397a28d19421 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:19.979220 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6944b5-25b9-4ab4-b9da-397a28d19421 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:19.988413 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6944b5-25b9-4ab4-b9da-397a28d19421 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:19.990177 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6944b5-25b9-4ab4-b9da-397a28d19421 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:19.994618 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f4ec14-93cc-40f6-832e-1319d9caf15b None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:19.997152 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:20.001887 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-9f6944b5-25b9-4ab4-b9da-397a28d19421 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 14:44:20.001887 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:20.001887 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:20.001887 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:20.001887 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:20.001887 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:20.001887 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:20.001887 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:20.001887 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:20.001887 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:20.001887 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:20.001887 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:20.001887 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 14:44:20.001887 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 14:44:20.001887 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 14:44:20.001887 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 14:44:20.002810 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:20.002810 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:20.002810 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:44:20.002810 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:44:20.002810 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:44:20.002810 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:44:20.002810 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:20.002810 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:20.002810 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:20.002810 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:20.002810 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:20.002810 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:20.002810 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:20.002810 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:20.002810 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:20.002810 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:20.002810 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:20.002810 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:20.003755 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:20.003755 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:20.003755 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 14:44:20.003755 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 14:44:20.003755 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 14:44:20.003755 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 14:44:20.003755 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 14:44:20.003755 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 14:44:20.003755 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 14:44:20.003755 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:44:20.003755 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 371/745] 10.222.0.72 () {56 vars in 1117 bytes} [Mon Sep 19 14:44:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:20.004353 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6944b5-25b9-4ab4-b9da-397a28d19421 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:20.044591 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7ee596-9ae6-4b1d-8c2f-8cfc786b5d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:20.045148 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7ee596-9ae6-4b1d-8c2f-8cfc786b5d98 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:20.045540 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7ee596-9ae6-4b1d-8c2f-8cfc786b5d98 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:20.045816 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7ee596-9ae6-4b1d-8c2f-8cfc786b5d98 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:20.056625 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7ee596-9ae6-4b1d-8c2f-8cfc786b5d98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:44:20.062308 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-2e7ee596-9ae6-4b1d-8c2f-8cfc786b5d98 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:44:20.062308 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:20.062308 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:20.062308 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:20.062308 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:20.062308 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:20.062308 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:20.062308 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:20.062308 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:20.062308 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:20.062308 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:20.062308 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:20.062308 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:44:20.062308 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:44:20.062308 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:44:20.062308 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:44:20.063362 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:44:20.063362 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:44:20.063362 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:44:20.063362 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:44:20.063362 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:20.063362 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:20.063362 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:20.063362 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:20.063362 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:20.063362 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:20.063362 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:20.063362 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:20.063362 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:20.063362 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:20.063362 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:20.063362 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:20.065857 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:20.065857 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:20.065857 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:20.065857 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:20.065857 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:44:20.065857 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:44:20.065857 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:44:20.065857 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:44:20.065857 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:44:20.065857 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:44:20.065857 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:44:20.065857 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:44:20.065857 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 375/746] 10.222.0.72 () {56 vars in 1096 bytes} [Mon Sep 19 14:44:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:20.065857 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e18657-82fc-4eb9-9c50-a8d8b78f2931 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:20.066628 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e18657-82fc-4eb9-9c50-a8d8b78f2931 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:20.066628 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e18657-82fc-4eb9-9c50-a8d8b78f2931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:20.085379 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-c7e18657-82fc-4eb9-9c50-a8d8b78f2931 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:44:20.086563 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-c7e18657-82fc-4eb9-9c50-a8d8b78f2931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:44:20.102104 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:20.119940 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6944b5-25b9-4ab4-b9da-397a28d19421 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:20.158665 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82ef9b9-1e67-4c70-8b68-ae848e276073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:20.159272 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82ef9b9-1e67-4c70-8b68-ae848e276073 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:20.159550 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82ef9b9-1e67-4c70-8b68-ae848e276073 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:20.159818 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82ef9b9-1e67-4c70-8b68-ae848e276073 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:20.160574 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82ef9b9-1e67-4c70-8b68-ae848e276073 None admin] RBAC: Adding query filter params (role.id=ddb643577b2e4e478100ec370decfaeb, scope.project.id=51af3a14d665498c9b7a35b34dac0ef1, user.id=8504425c3a414608b030d0cf1af78af5) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:20.160882 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82ef9b9-1e67-4c70-8b68-ae848e276073 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:20.162323 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82ef9b9-1e67-4c70-8b68-ae848e276073 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:20.162941 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 376/747] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:44:20 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:44:20.164124 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e18657-82fc-4eb9-9c50-a8d8b78f2931 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:20.177556 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 372/748] 10.222.0.72 () {56 vars in 1374 bytes} [Mon Sep 19 14:44:20 2022] GET /identity/v3/role_assignments?user.id=8504425c3a414608b030d0cf1af78af5&scope.project.id=51af3a14d665498c9b7a35b34dac0ef1&role.id=ddb643577b2e4e478100ec370decfaeb => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:20.178744 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82ef9b9-1e67-4c70-8b68-ae848e276073 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:20.303828 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82ef9b9-1e67-4c70-8b68-ae848e276073 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:20.360772 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f94a347-3998-41b8-98eb-c7d1440bcdd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:20.361403 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f94a347-3998-41b8-98eb-c7d1440bcdd7 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:20.361683 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f94a347-3998-41b8-98eb-c7d1440bcdd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:20.361960 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f94a347-3998-41b8-98eb-c7d1440bcdd7 None admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:20.362644 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f94a347-3998-41b8-98eb-c7d1440bcdd7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:20.362946 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f94a347-3998-41b8-98eb-c7d1440bcdd7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:20.368350 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f94a347-3998-41b8-98eb-c7d1440bcdd7 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:20.390949 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 373/749] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Sep 19 14:44:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:20.395287 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f94a347-3998-41b8-98eb-c7d1440bcdd7 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:20.407917 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:20.414978 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:20.424037 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e18657-82fc-4eb9-9c50-a8d8b78f2931 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:20.483150 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37998a0-2a0f-41eb-94ac-a44d6719941c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:20.484262 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37998a0-2a0f-41eb-94ac-a44d6719941c None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:20.484774 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37998a0-2a0f-41eb-94ac-a44d6719941c None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:20.485252 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37998a0-2a0f-41eb-94ac-a44d6719941c None admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:20.486278 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37998a0-2a0f-41eb-94ac-a44d6719941c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:20.486783 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37998a0-2a0f-41eb-94ac-a44d6719941c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:20.488648 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37998a0-2a0f-41eb-94ac-a44d6719941c None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:20.508552 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f94a347-3998-41b8-98eb-c7d1440bcdd7 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:20.517607 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 377/750] 10.222.0.72 () {56 vars in 1149 bytes} [Mon Sep 19 14:44:20 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:20.517607 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37998a0-2a0f-41eb-94ac-a44d6719941c None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:20.548194 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fd7c0f-4b70-4ce6-8d01-dc435a8ec6d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:20.549307 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fd7c0f-4b70-4ce6-8d01-dc435a8ec6d9 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:20.549837 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fd7c0f-4b70-4ce6-8d01-dc435a8ec6d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:20.550764 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fd7c0f-4b70-4ce6-8d01-dc435a8ec6d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:20.564704 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fd7c0f-4b70-4ce6-8d01-dc435a8ec6d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:20.567438 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fd7c0f-4b70-4ce6-8d01-dc435a8ec6d9 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:20.584840 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-a6fd7c0f-4b70-4ce6-8d01-dc435a8ec6d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:44:20.584840 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:20.584840 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:20.584840 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:20.584840 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:20.584840 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:20.584840 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:20.584840 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:20.584840 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:20.584840 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:20.584840 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:20.584840 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:20.584840 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:44:20.584840 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:44:20.584840 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:44:20.584840 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:44:20.585823 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:20.585823 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:20.585823 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:20.585823 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:20.585823 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:20.585823 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:20.585823 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:20.585823 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:20.585823 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:20.585823 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:20.585823 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:20.585823 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:20.585823 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:20.585823 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:20.585823 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:20.585823 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:20.585823 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:44:20.586706 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:44:20.586706 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:44:20.586706 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:44:20.590289 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 374/751] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:44:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:20.591359 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fd7c0f-4b70-4ce6-8d01-dc435a8ec6d9 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:20.643450 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37998a0-2a0f-41eb-94ac-a44d6719941c None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:20.673138 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:20.681904 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7319f6-afe9-4388-8130-1d94bd8d6337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:20.682843 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7319f6-afe9-4388-8130-1d94bd8d6337 None admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:20.684254 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7319f6-afe9-4388-8130-1d94bd8d6337 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:20.684892 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7319f6-afe9-4388-8130-1d94bd8d6337 None admin] PATH_INFO: `/v3/services` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:20.685755 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7319f6-afe9-4388-8130-1d94bd8d6337 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:20.687546 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7319f6-afe9-4388-8130-1d94bd8d6337 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:20.707192 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 378/752] 10.222.0.72 () {60 vars in 1141 bytes} [Mon Sep 19 14:44:20 2022] POST /identity/v3/services => generated 240 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:44:20.708468 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7319f6-afe9-4388-8130-1d94bd8d6337 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:20.741863 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fd7c0f-4b70-4ce6-8d01-dc435a8ec6d9 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:20.749323 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:20.872300 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7319f6-afe9-4388-8130-1d94bd8d6337 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:20.889097 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0b0601-58be-4a65-8170-d0257fd8b295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:20.889767 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0b0601-58be-4a65-8170-d0257fd8b295 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:20.890015 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0b0601-58be-4a65-8170-d0257fd8b295 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:20.890292 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0b0601-58be-4a65-8170-d0257fd8b295 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:20.925090 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9abbee-7651-4ad9-a25f-7b749297e8fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:20.925706 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9abbee-7651-4ad9-a25f-7b749297e8fa None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:20.925987 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9abbee-7651-4ad9-a25f-7b749297e8fa None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:20.926709 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9abbee-7651-4ad9-a25f-7b749297e8fa None admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:20.927447 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9abbee-7651-4ad9-a25f-7b749297e8fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:20.927994 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9abbee-7651-4ad9-a25f-7b749297e8fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:20.929676 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9abbee-7651-4ad9-a25f-7b749297e8fa None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:20.946384 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 379/753] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Sep 19 14:44:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:20.952889 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9abbee-7651-4ad9-a25f-7b749297e8fa None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:20.992219 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0b0601-58be-4a65-8170-d0257fd8b295 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:20.994012 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0b0601-58be-4a65-8170-d0257fd8b295 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:21.026732 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:21.064656 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:21.066902 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9abbee-7651-4ad9-a25f-7b749297e8fa None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:21.104735 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba09a5d-b87b-442e-8b5b-f1bf2378e638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:21.105952 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba09a5d-b87b-442e-8b5b-f1bf2378e638 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:21.106233 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba09a5d-b87b-442e-8b5b-f1bf2378e638 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:21.106598 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba09a5d-b87b-442e-8b5b-f1bf2378e638 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:21.108942 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 375/754] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Sep 19 14:44:20 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 14:44:21.117913 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0b0601-58be-4a65-8170-d0257fd8b295 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:21.118857 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba09a5d-b87b-442e-8b5b-f1bf2378e638 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:21.120309 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba09a5d-b87b-442e-8b5b-f1bf2378e638 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:21.133554 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-aba09a5d-b87b-442e-8b5b-f1bf2378e638 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 19 14:44:21.133554 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:21.133554 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:21.133554 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:21.133554 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:21.133554 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:21.133554 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:21.133554 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:21.133554 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:21.133554 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:21.133554 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:21.133554 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:21.133554 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 14:44:21.133554 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 14:44:21.133554 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 14:44:21.133554 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 14:44:21.134504 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:21.134504 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:21.134504 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:44:21.134504 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:44:21.134504 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:44:21.134504 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:44:21.134504 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:21.134504 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:21.134504 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:21.134504 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:21.134504 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:21.134504 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:21.134504 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:21.134504 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:21.134504 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:21.134504 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:21.134504 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:21.134504 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:21.135701 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:21.135701 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:21.135701 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 14:44:21.135701 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 14:44:21.135701 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 14:44:21.135701 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 14:44:21.135701 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 14:44:21.135701 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 14:44:21.135701 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 19 14:44:21.135701 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:44:21.135701 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 380/755] 10.222.0.72 () {56 vars in 1093 bytes} [Mon Sep 19 14:44:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:44:21.141206 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba09a5d-b87b-442e-8b5b-f1bf2378e638 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:21.261079 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba09a5d-b87b-442e-8b5b-f1bf2378e638 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:21.288100 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0b0601-58be-4a65-8170-d0257fd8b295 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:21.294564 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:21.304177 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d32d17-f845-4e49-826e-aada5150e769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:21.304957 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d32d17-f845-4e49-826e-aada5150e769 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:21.305240 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d32d17-f845-4e49-826e-aada5150e769 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:21.305515 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d32d17-f845-4e49-826e-aada5150e769 None admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:21.306239 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d32d17-f845-4e49-826e-aada5150e769 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:21.306691 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d32d17-f845-4e49-826e-aada5150e769 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:21.309676 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d32d17-f845-4e49-826e-aada5150e769 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:21.329675 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef7b6a7-1e5d-4a03-80c7-e61fb7a9a3d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:21.330604 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef7b6a7-1e5d-4a03-80c7-e61fb7a9a3d6 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:21.331023 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef7b6a7-1e5d-4a03-80c7-e61fb7a9a3d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:21.331533 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef7b6a7-1e5d-4a03-80c7-e61fb7a9a3d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:21.331637 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 381/756] 10.222.0.72 () {56 vars in 1133 bytes} [Mon Sep 19 14:44:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:21.337649 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d32d17-f845-4e49-826e-aada5150e769 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:21.347335 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef7b6a7-1e5d-4a03-80c7-e61fb7a9a3d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:21.349103 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef7b6a7-1e5d-4a03-80c7-e61fb7a9a3d6 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:21.364680 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-3ef7b6a7-1e5d-4a03-80c7-e61fb7a9a3d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:44:21.364680 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:21.364680 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:21.364680 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:21.364680 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:21.364680 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:21.364680 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:21.364680 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:21.364680 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:21.364680 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:21.364680 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:21.364680 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:21.364680 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:44:21.364680 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:44:21.364680 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:44:21.364680 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:44:21.365796 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:21.365796 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:21.365796 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:21.365796 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:21.365796 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:21.365796 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:21.365796 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:21.365796 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:21.365796 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:21.365796 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:21.365796 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:21.365796 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:21.365796 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:21.365796 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:21.365796 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:21.365796 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:21.365796 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:44:21.366674 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:44:21.366674 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:44:21.366674 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:44:21.368871 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 376/757] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:44:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:21.383009 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef7b6a7-1e5d-4a03-80c7-e61fb7a9a3d6 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:21.420762 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:21.458976 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d32d17-f845-4e49-826e-aada5150e769 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:21.499214 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac7feac-60d4-42fc-bb54-9b419fd915a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:21.499854 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac7feac-60d4-42fc-bb54-9b419fd915a4 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:21.500133 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac7feac-60d4-42fc-bb54-9b419fd915a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:21.500430 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac7feac-60d4-42fc-bb54-9b419fd915a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:21.512419 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac7feac-60d4-42fc-bb54-9b419fd915a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:21.514163 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac7feac-60d4-42fc-bb54-9b419fd915a4 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:21.530891 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-fac7feac-60d4-42fc-bb54-9b419fd915a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:44:21.530891 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:21.530891 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:21.530891 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:21.530891 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:21.530891 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:21.530891 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:21.530891 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:21.530891 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:21.530891 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:21.530891 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:21.530891 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:21.530891 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:44:21.530891 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:44:21.530891 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:44:21.530891 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:44:21.531857 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:21.531857 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:21.531857 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:21.531857 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:21.531857 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:21.531857 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:21.531857 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:21.531857 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:21.531857 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:21.531857 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:21.531857 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:21.531857 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:21.531857 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:21.531857 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:21.531857 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:21.531857 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:21.531857 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:44:21.533406 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:44:21.533406 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:44:21.533406 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:44:21.533406 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 382/758] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:44:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:21.537404 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac7feac-60d4-42fc-bb54-9b419fd915a4 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:21.590617 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef7b6a7-1e5d-4a03-80c7-e61fb7a9a3d6 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:21.604037 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:21.630480 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f526e3-6f6e-4d3c-a853-3cbeafdc2d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:21.631097 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f526e3-6f6e-4d3c-a853-3cbeafdc2d83 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:21.631379 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f526e3-6f6e-4d3c-a853-3cbeafdc2d83 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:21.631662 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f526e3-6f6e-4d3c-a853-3cbeafdc2d83 None admin] PATH_INFO: `/v3/domains` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:21.632309 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f526e3-6f6e-4d3c-a853-3cbeafdc2d83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:21.632633 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f526e3-6f6e-4d3c-a853-3cbeafdc2d83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:21.634000 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f526e3-6f6e-4d3c-a853-3cbeafdc2d83 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:21.657018 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 377/759] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Sep 19 14:44:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:21.663076 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f526e3-6f6e-4d3c-a853-3cbeafdc2d83 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:21.699932 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac7feac-60d4-42fc-bb54-9b419fd915a4 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:21.763659 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5a2887-9c1a-4c51-8787-aa31b5baec3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:21.764276 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a2887-9c1a-4c51-8787-aa31b5baec3c None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:21.764586 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a2887-9c1a-4c51-8787-aa31b5baec3c None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:21.764862 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a2887-9c1a-4c51-8787-aa31b5baec3c None admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:21.765504 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5a2887-9c1a-4c51-8787-aa31b5baec3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:21.765807 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5a2887-9c1a-4c51-8787-aa31b5baec3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:21.767179 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5a2887-9c1a-4c51-8787-aa31b5baec3c None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:21.783357 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 383/760] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Sep 19 14:44:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:21.789979 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5a2887-9c1a-4c51-8787-aa31b5baec3c None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:21.828980 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:21.878613 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f526e3-6f6e-4d3c-a853-3cbeafdc2d83 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:21.966259 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6dd6e6-a00e-414f-84e3-4886a9fb8109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:21.966902 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6dd6e6-a00e-414f-84e3-4886a9fb8109 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:21.967170 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6dd6e6-a00e-414f-84e3-4886a9fb8109 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:21.967444 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6dd6e6-a00e-414f-84e3-4886a9fb8109 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:21.981054 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6dd6e6-a00e-414f-84e3-4886a9fb8109 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:21.982507 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6dd6e6-a00e-414f-84e3-4886a9fb8109 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:22.000679 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:22.003735 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-3f6dd6e6-a00e-414f-84e3-4886a9fb8109 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:44:22.003735 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:22.003735 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:22.003735 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:22.003735 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:22.003735 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:22.003735 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:22.003735 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:22.003735 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:22.003735 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:22.003735 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:22.003735 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:22.003735 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 14:44:22.003735 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 14:44:22.003735 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 14:44:22.004670 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 14:44:22.004670 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:22.004670 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:22.004670 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:22.004670 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:22.004670 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:22.004670 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:22.004670 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:22.004670 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:22.004670 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:22.004670 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:22.004670 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:22.004670 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:22.004670 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:22.004670 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:22.004670 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:22.004670 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:22.005538 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 14:44:22.005538 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 14:44:22.005538 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:44:22.005538 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:44:22.005538 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:44:22.005538 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:44:22.005538 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:44:22.005538 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:44:22.007085 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5a2887-9c1a-4c51-8787-aa31b5baec3c None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:22.012535 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 378/761] 10.222.0.72 () {56 vars in 1111 bytes} [Mon Sep 19 14:44:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:22.013461 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6dd6e6-a00e-414f-84e3-4886a9fb8109 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:22.048727 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb52a3f-902d-4e8f-b54a-24b6c0dffd7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:22.049373 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb52a3f-902d-4e8f-b54a-24b6c0dffd7c None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:22.049656 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb52a3f-902d-4e8f-b54a-24b6c0dffd7c None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:22.049929 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb52a3f-902d-4e8f-b54a-24b6c0dffd7c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:22.057837 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb52a3f-902d-4e8f-b54a-24b6c0dffd7c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:22.059643 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb52a3f-902d-4e8f-b54a-24b6c0dffd7c None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:22.072110 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-8fb52a3f-902d-4e8f-b54a-24b6c0dffd7c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:44:22.072110 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:22.072110 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:22.072110 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:22.072110 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:22.072110 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:22.072110 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:22.072110 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:22.072110 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:22.072110 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:22.072110 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:22.072110 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:22.072110 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 14:44:22.072110 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 14:44:22.072110 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 14:44:22.074208 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 14:44:22.074208 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:22.074208 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:22.074208 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:22.074208 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:22.074208 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:22.074208 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:22.074208 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:22.074208 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:22.074208 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:22.074208 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:22.074208 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:22.074208 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:22.074208 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:22.074208 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:22.074208 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:22.074208 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:22.076188 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 14:44:22.076188 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 14:44:22.076188 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:44:22.076188 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:44:22.076188 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:44:22.076188 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:44:22.076188 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:44:22.076188 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:44:22.076188 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 384/762] 10.222.0.72 () {56 vars in 1111 bytes} [Mon Sep 19 14:44:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:22.080154 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb52a3f-902d-4e8f-b54a-24b6c0dffd7c None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:22.200761 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6dd6e6-a00e-414f-84e3-4886a9fb8109 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:22.232643 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb52a3f-902d-4e8f-b54a-24b6c0dffd7c None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:22.249331 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0979cc50-c890-446d-80e9-b65e94763f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:22.249954 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0979cc50-c890-446d-80e9-b65e94763f90 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:22.250251 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0979cc50-c890-446d-80e9-b65e94763f90 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:22.250638 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0979cc50-c890-446d-80e9-b65e94763f90 None admin] PATH_INFO: `/v3/projects` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:22.251496 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0979cc50-c890-446d-80e9-b65e94763f90 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:22.251809 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0979cc50-c890-446d-80e9-b65e94763f90 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:22.253921 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0979cc50-c890-446d-80e9-b65e94763f90 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:22.256622 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:22.271771 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 379/763] 10.222.0.72 () {56 vars in 1148 bytes} [Mon Sep 19 14:44:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:22.273458 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3947a3ce-ac08-4e08-9e14-c57d223d841b None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:22.273945 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3947a3ce-ac08-4e08-9e14-c57d223d841b None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:22.274472 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3947a3ce-ac08-4e08-9e14-c57d223d841b None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:22.280179 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 380/764] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:44:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:44:22.280688 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3947a3ce-ac08-4e08-9e14-c57d223d841b None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:22.284577 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440c550c-ed8d-430a-9814-16e15560b828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:22.285191 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440c550c-ed8d-430a-9814-16e15560b828 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:22.285477 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440c550c-ed8d-430a-9814-16e15560b828 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:22.286694 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440c550c-ed8d-430a-9814-16e15560b828 None admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:22.287403 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440c550c-ed8d-430a-9814-16e15560b828 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:22.287715 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440c550c-ed8d-430a-9814-16e15560b828 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:22.289206 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440c550c-ed8d-430a-9814-16e15560b828 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:22.306019 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 385/765] 10.222.0.72 () {56 vars in 1148 bytes} [Mon Sep 19 14:44:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:22.307928 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc0fcfa-3ea9-4bd6-802c-3480d1fc1588 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:22.309156 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc0fcfa-3ea9-4bd6-802c-3480d1fc1588 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:22.309786 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc0fcfa-3ea9-4bd6-802c-3480d1fc1588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:22.334894 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-6bc0fcfa-3ea9-4bd6-802c-3480d1fc1588 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:44:22.336407 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-6bc0fcfa-3ea9-4bd6-802c-3480d1fc1588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:44:22.356156 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:22.399823 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3947a3ce-ac08-4e08-9e14-c57d223d841b None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:22.432643 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 386/766] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:44:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:44:22.436379 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc0fcfa-3ea9-4bd6-802c-3480d1fc1588 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:22.447753 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9e18f5-efba-4da6-8cbc-ff5a1e8ca153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:22.448748 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e18f5-efba-4da6-8cbc-ff5a1e8ca153 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:22.449895 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e18f5-efba-4da6-8cbc-ff5a1e8ca153 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:22.450411 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e18f5-efba-4da6-8cbc-ff5a1e8ca153 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:22.451359 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9e18f5-efba-4da6-8cbc-ff5a1e8ca153 None admin] RBAC: Adding query filter params (role.id=537cde5f25284acca3c3ea9ff806d724, scope.project.id=51af3a14d665498c9b7a35b34dac0ef1, user.id=afbbbf11f3234297ab1dd509f064480f) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:22.451936 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9e18f5-efba-4da6-8cbc-ff5a1e8ca153 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:22.453704 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9e18f5-efba-4da6-8cbc-ff5a1e8ca153 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:22.467312 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 381/767] 10.222.0.72 () {56 vars in 1374 bytes} [Mon Sep 19 14:44:22 2022] GET /identity/v3/role_assignments?user.id=afbbbf11f3234297ab1dd509f064480f&scope.project.id=51af3a14d665498c9b7a35b34dac0ef1&role.id=537cde5f25284acca3c3ea9ff806d724 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:22.579156 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc0fcfa-3ea9-4bd6-802c-3480d1fc1588 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:22.622910 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d53099-2db4-4e0a-9c81-68836619f97b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:22.624069 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d53099-2db4-4e0a-9c81-68836619f97b None admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:22.624598 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d53099-2db4-4e0a-9c81-68836619f97b None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:22.625079 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d53099-2db4-4e0a-9c81-68836619f97b None admin] PATH_INFO: `/v3/projects/51af3a14d665498c9b7a35b34dac0ef1/users/055439dc35e946f4a82535c684f9b60d/roles/ddb643577b2e4e478100ec370decfaeb` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:22.627358 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d53099-2db4-4e0a-9c81-68836619f97b None admin] RBAC: Authorizing `identity:create_grant(project_id=51af3a14d665498c9b7a35b34dac0ef1, user_id=055439dc35e946f4a82535c684f9b60d, role_id=ddb643577b2e4e478100ec370decfaeb)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:22.629112 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d53099-2db4-4e0a-9c81-68836619f97b None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:22.649771 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 387/768] 10.222.0.72 () {58 vars in 1439 bytes} [Mon Sep 19 14:44:22 2022] PUT /identity/v3/projects/51af3a14d665498c9b7a35b34dac0ef1/users/055439dc35e946f4a82535c684f9b60d/roles/ddb643577b2e4e478100ec370decfaeb => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:44:22.781653 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a98756-3e75-48a3-abce-74047b61a9a3 None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:22.782333 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a98756-3e75-48a3-abce-74047b61a9a3 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:22.782802 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a98756-3e75-48a3-abce-74047b61a9a3 None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:22.784387 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 382/769] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:44:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:44:22.793811 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b124bcf3-306f-4c6f-a364-02d6a83247ab None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:22.795017 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b124bcf3-306f-4c6f-a364-02d6a83247ab None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:22.795497 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b124bcf3-306f-4c6f-a364-02d6a83247ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:22.800949 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a98756-3e75-48a3-abce-74047b61a9a3 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:22.841651 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-b124bcf3-306f-4c6f-a364-02d6a83247ab None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:44:22.844414 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-b124bcf3-306f-4c6f-a364-02d6a83247ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:44:22.848615 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:22.927408 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:22.968308 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 388/770] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:44:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:44:22.983990 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a98756-3e75-48a3-abce-74047b61a9a3 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:23.021825 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40067028-bd58-437e-b824-4ab3850c7fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:23.022809 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40067028-bd58-437e-b824-4ab3850c7fde None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:23.023284 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40067028-bd58-437e-b824-4ab3850c7fde None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:23.023764 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40067028-bd58-437e-b824-4ab3850c7fde None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:23.024574 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40067028-bd58-437e-b824-4ab3850c7fde None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:23.026243 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40067028-bd58-437e-b824-4ab3850c7fde None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:23.037384 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-40067028-bd58-437e-b824-4ab3850c7fde None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 19 14:44:23.037384 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:23.037384 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 14:44:23.037384 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 14:44:23.037384 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 14:44:23.037384 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 14:44:23.037384 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 14:44:23.037384 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:44:23.037384 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 19 14:44:23.037384 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:44:23.037384 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 14:44:23.037384 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:44:23.037384 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:23.037384 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:23.037384 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:23.037384 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:23.037384 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:23.038374 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:23.038374 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:23.038374 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:23.038374 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:23.038374 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:23.038374 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:23.038374 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 14:44:23.038374 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 14:44:23.038374 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 14:44:23.038374 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 14:44:23.038374 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:23.038374 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:23.038374 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:23.038374 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:23.038374 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:23.038374 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:23.039211 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:23.039211 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:23.039211 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:23.039211 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:23.039211 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:23.039211 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:23.039211 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:23.039211 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:23.039211 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:23.039211 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:23.039211 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 14:44:23.039211 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:44:23.039211 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 19 14:44:23.039211 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:44:23.041964 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 383/771] 10.222.0.72 () {56 vars in 1129 bytes} [Mon Sep 19 14:44:22 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:44:23.053936 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b124bcf3-306f-4c6f-a364-02d6a83247ab None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:23.162613 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b124bcf3-306f-4c6f-a364-02d6a83247ab None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:23.198569 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b6c78b-5b42-41cc-9e9e-d9043176e8cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:23.200454 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b6c78b-5b42-41cc-9e9e-d9043176e8cc None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:23.200958 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b6c78b-5b42-41cc-9e9e-d9043176e8cc None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:23.201426 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b6c78b-5b42-41cc-9e9e-d9043176e8cc None admin] PATH_INFO: `/v3/services` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:23.202410 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b6c78b-5b42-41cc-9e9e-d9043176e8cc None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:23.202910 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b6c78b-5b42-41cc-9e9e-d9043176e8cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:23.204520 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b6c78b-5b42-41cc-9e9e-d9043176e8cc None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:23.209802 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 389/772] 10.222.0.72 () {56 vars in 1124 bytes} [Mon Sep 19 14:44:23 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:23.217619 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40067028-bd58-437e-b824-4ab3850c7fde None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:23.347998 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40067028-bd58-437e-b824-4ab3850c7fde None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:23.379830 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:23.393807 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d17d3ef-de9e-4f4a-951c-efe815b6a5e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:23.394804 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d17d3ef-de9e-4f4a-951c-efe815b6a5e7 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:23.395291 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d17d3ef-de9e-4f4a-951c-efe815b6a5e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:23.395765 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d17d3ef-de9e-4f4a-951c-efe815b6a5e7 None admin] PATH_INFO: `/v3/services` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:23.396635 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d17d3ef-de9e-4f4a-951c-efe815b6a5e7 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:23.397130 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d17d3ef-de9e-4f4a-951c-efe815b6a5e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:23.398683 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d17d3ef-de9e-4f4a-951c-efe815b6a5e7 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:23.405455 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 384/773] 10.222.0.72 () {56 vars in 1124 bytes} [Mon Sep 19 14:44:23 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:23.413737 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b6c78b-5b42-41cc-9e9e-d9043176e8cc None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:23.417321 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:23.480197 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4020e4e-d2e8-4cdf-ac14-d983d18e4e47 None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:23.480662 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4020e4e-d2e8-4cdf-ac14-d983d18e4e47 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:23.481149 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4020e4e-d2e8-4cdf-ac14-d983d18e4e47 None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:23.486417 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 385/774] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:44:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:44:23.487699 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3526423-ac5c-4d88-9d90-ed882958df4e None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:23.487985 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3526423-ac5c-4d88-9d90-ed882958df4e None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:23.488255 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3526423-ac5c-4d88-9d90-ed882958df4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:23.522352 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-b3526423-ac5c-4d88-9d90-ed882958df4e None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:44:23.523643 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-b3526423-ac5c-4d88-9d90-ed882958df4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:44:23.569571 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b6c78b-5b42-41cc-9e9e-d9043176e8cc None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:23.616361 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5e1ee5-beaf-4159-8499-ed0c65a40353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:23.616361 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e1ee5-beaf-4159-8499-ed0c65a40353 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:23.616361 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e1ee5-beaf-4159-8499-ed0c65a40353 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:23.616361 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e1ee5-beaf-4159-8499-ed0c65a40353 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:23.616796 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5e1ee5-beaf-4159-8499-ed0c65a40353 None admin] RBAC: Adding query filter params (interface=public, service_id=47cd4eadb90540b994269e86ed60335f, region_id=RegionOne) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:23.616796 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5e1ee5-beaf-4159-8499-ed0c65a40353 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:23.616796 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5e1ee5-beaf-4159-8499-ed0c65a40353 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:23.617457 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 386/775] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:44:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 14:44:23.618617 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3526423-ac5c-4d88-9d90-ed882958df4e None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:23.623494 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 390/776] 10.222.0.72 () {56 vars in 1251 bytes} [Mon Sep 19 14:44:23 2022] GET /identity/v3/endpoints?service_id=47cd4eadb90540b994269e86ed60335f&interface=public®ion_id=RegionOne => generated 194 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:23.633769 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5e1ee5-beaf-4159-8499-ed0c65a40353 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:23.725787 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3526423-ac5c-4d88-9d90-ed882958df4e None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:23.749639 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:23.766176 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547df990-8e2b-425a-8c04-de9bfd1b4722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:23.766823 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547df990-8e2b-425a-8c04-de9bfd1b4722 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:23.767104 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547df990-8e2b-425a-8c04-de9bfd1b4722 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:23.767377 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547df990-8e2b-425a-8c04-de9bfd1b4722 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:23.780361 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547df990-8e2b-425a-8c04-de9bfd1b4722 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:44:23.784680 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-547df990-8e2b-425a-8c04-de9bfd1b4722 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:44:23.784680 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:23.784680 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:23.784680 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:23.784680 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:23.784680 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:23.784680 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:23.784680 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:23.784680 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:23.784680 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:23.784680 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:23.784680 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:23.784680 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:44:23.784680 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:44:23.784680 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:44:23.784680 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:44:23.785616 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:44:23.785616 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:44:23.785616 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:44:23.785616 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:44:23.785616 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:23.785616 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:23.785616 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:23.785616 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:23.785616 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:23.785616 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:23.785616 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:23.785616 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:23.785616 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:23.785616 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:23.785616 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:23.785616 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:23.786462 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:23.786462 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:23.786462 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:23.786462 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:23.786462 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:44:23.786462 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:44:23.786462 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:44:23.786462 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:44:23.786462 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:44:23.786462 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:44:23.786462 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:44:23.786462 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:44:23.786462 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 387/777] 10.222.0.72 () {56 vars in 1096 bytes} [Mon Sep 19 14:44:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:23.796361 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547df990-8e2b-425a-8c04-de9bfd1b4722 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:23.796559 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:23.872300 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5e1ee5-beaf-4159-8499-ed0c65a40353 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:23.936781 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41ed408-ce88-4da7-8ecb-3ed064dcf771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:23.937398 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ed408-ce88-4da7-8ecb-3ed064dcf771 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:23.937675 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ed408-ce88-4da7-8ecb-3ed064dcf771 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:23.937944 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ed408-ce88-4da7-8ecb-3ed064dcf771 None admin] PATH_INFO: `/v3/services` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:23.938547 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41ed408-ce88-4da7-8ecb-3ed064dcf771 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:23.939921 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41ed408-ce88-4da7-8ecb-3ed064dcf771 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:23.945404 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 391/778] 10.222.0.72 () {56 vars in 1087 bytes} [Mon Sep 19 14:44:23 2022] GET /identity/v3/services => generated 772 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:23.946246 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41ed408-ce88-4da7-8ecb-3ed064dcf771 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:23.967885 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547df990-8e2b-425a-8c04-de9bfd1b4722 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:24.009864 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9b926f-cb32-4b98-96d1-c41791075a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:24.010599 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9b926f-cb32-4b98-96d1-c41791075a5a None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:24.010765 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9b926f-cb32-4b98-96d1-c41791075a5a None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:24.011070 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9b926f-cb32-4b98-96d1-c41791075a5a None admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:24.011935 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9b926f-cb32-4b98-96d1-c41791075a5a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:24.012270 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9b926f-cb32-4b98-96d1-c41791075a5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:24.013707 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9b926f-cb32-4b98-96d1-c41791075a5a None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:24.023776 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 388/779] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Sep 19 14:44:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:44:24.033212 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9b926f-cb32-4b98-96d1-c41791075a5a None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:24.084391 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:24.203864 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41ed408-ce88-4da7-8ecb-3ed064dcf771 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:24.239692 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:24.249926 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99047ab-10ab-48b8-a7ce-c6d9b8c2acd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:24.250583 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99047ab-10ab-48b8-a7ce-c6d9b8c2acd8 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:24.250859 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99047ab-10ab-48b8-a7ce-c6d9b8c2acd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:24.251129 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99047ab-10ab-48b8-a7ce-c6d9b8c2acd8 None admin] PATH_INFO: `/v3/services/network` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:24.251721 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99047ab-10ab-48b8-a7ce-c6d9b8c2acd8 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:24.253235 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99047ab-10ab-48b8-a7ce-c6d9b8c2acd8 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:24.265108 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-a99047ab-10ab-48b8-a7ce-c6d9b8c2acd8 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 19 14:44:24.265108 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:24.265108 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 14:44:24.265108 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 14:44:24.265108 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 14:44:24.265108 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 14:44:24.265108 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 14:44:24.265108 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:44:24.265108 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 19 14:44:24.265108 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:44:24.265108 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 14:44:24.265108 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:44:24.265108 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:24.265108 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:24.265108 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:24.265108 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:24.265108 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:24.266133 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:24.266133 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:24.266133 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:24.266133 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:24.266133 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:24.266133 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:24.266133 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 14:44:24.266133 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 14:44:24.266133 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 14:44:24.266133 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 14:44:24.266133 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:24.266133 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:24.266133 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:24.266133 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:24.266133 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:24.266133 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:24.266965 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:24.266965 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:24.266965 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:24.266965 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:24.266965 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:24.266965 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:24.266965 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:24.266965 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:24.266965 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:24.266965 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:24.266965 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 14:44:24.266965 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:44:24.266965 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 19 14:44:24.266965 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:44:24.266965 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 392/780] 10.222.0.72 () {56 vars in 1111 bytes} [Mon Sep 19 14:44:23 2022] GET /identity/v3/services/network => generated 88 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:24.272259 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99047ab-10ab-48b8-a7ce-c6d9b8c2acd8 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:24.330164 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9b926f-cb32-4b98-96d1-c41791075a5a None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:24.396689 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd471716-1fb7-4426-9cc6-a6552bea513f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:24.397334 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd471716-1fb7-4426-9cc6-a6552bea513f None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:24.397614 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd471716-1fb7-4426-9cc6-a6552bea513f None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:24.397883 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd471716-1fb7-4426-9cc6-a6552bea513f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:24.420893 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd471716-1fb7-4426-9cc6-a6552bea513f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:24.422350 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd471716-1fb7-4426-9cc6-a6552bea513f None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:24.450777 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-bd471716-1fb7-4426-9cc6-a6552bea513f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:44:24.450777 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:24.450777 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:24.450777 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:24.450777 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:24.450777 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:24.450777 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:24.450777 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:24.450777 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:24.450777 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:24.450777 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:24.450777 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:24.450777 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:44:24.450777 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:44:24.450777 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:44:24.450777 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:44:24.451746 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:24.451746 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:24.451746 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:24.451746 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:24.451746 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:24.451746 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:24.451746 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:24.451746 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:24.451746 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:24.451746 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:24.451746 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:24.451746 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:24.451746 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:24.451746 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:24.451746 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:24.451746 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:24.451746 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:44:24.452661 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:44:24.452661 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:44:24.452661 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:44:24.467334 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99047ab-10ab-48b8-a7ce-c6d9b8c2acd8 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:24.468889 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 389/781] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:44:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 429 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:24.469817 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd471716-1fb7-4426-9cc6-a6552bea513f None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:24.546570 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04100ee7-9c77-4fff-bd31-ca6f3ff13612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:24.547103 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04100ee7-9c77-4fff-bd31-ca6f3ff13612 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:24.547383 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04100ee7-9c77-4fff-bd31-ca6f3ff13612 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:24.547655 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04100ee7-9c77-4fff-bd31-ca6f3ff13612 None admin] PATH_INFO: `/v3/services` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:24.548290 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04100ee7-9c77-4fff-bd31-ca6f3ff13612 None admin] RBAC: Adding query filter params (name=network) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:24.548618 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04100ee7-9c77-4fff-bd31-ca6f3ff13612 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:24.549982 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04100ee7-9c77-4fff-bd31-ca6f3ff13612 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:24.564604 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 393/782] 10.222.0.72 () {56 vars in 1112 bytes} [Mon Sep 19 14:44:24 2022] GET /identity/v3/services?name=network => generated 124 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:44:24.566749 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04100ee7-9c77-4fff-bd31-ca6f3ff13612 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:24.635852 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:24.647383 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd471716-1fb7-4426-9cc6-a6552bea513f None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:24.689189 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3ec39b-c522-47dd-8ebf-672f4cb49753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:24.690142 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ec39b-c522-47dd-8ebf-672f4cb49753 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:24.690435 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ec39b-c522-47dd-8ebf-672f4cb49753 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:24.690712 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ec39b-c522-47dd-8ebf-672f4cb49753 None admin] PATH_INFO: `/v3/domains` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:24.691362 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3ec39b-c522-47dd-8ebf-672f4cb49753 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:24.691668 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3ec39b-c522-47dd-8ebf-672f4cb49753 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:24.693154 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3ec39b-c522-47dd-8ebf-672f4cb49753 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:24.702305 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:24.709487 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 390/783] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Sep 19 14:44:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:24.717380 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3ec39b-c522-47dd-8ebf-672f4cb49753 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:24.785181 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04100ee7-9c77-4fff-bd31-ca6f3ff13612 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:24.853946 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ddf55e-aefb-420e-8422-acfa2cc265b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:24.854555 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ddf55e-aefb-420e-8422-acfa2cc265b6 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:24.854817 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ddf55e-aefb-420e-8422-acfa2cc265b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:24.855017 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ddf55e-aefb-420e-8422-acfa2cc265b6 None admin] PATH_INFO: `/v3/services` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:24.855861 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ddf55e-aefb-420e-8422-acfa2cc265b6 None admin] RBAC: Adding query filter params (type=network) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:24.856164 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ddf55e-aefb-420e-8422-acfa2cc265b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:24.857565 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ddf55e-aefb-420e-8422-acfa2cc265b6 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:24.866643 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 394/784] 10.222.0.72 () {56 vars in 1112 bytes} [Mon Sep 19 14:44:24 2022] GET /identity/v3/services?type=network => generated 350 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:24.872689 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ddf55e-aefb-420e-8422-acfa2cc265b6 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:24.901239 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3ec39b-c522-47dd-8ebf-672f4cb49753 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:24.971852 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad19cc7-9d95-4112-b88d-951d32fa33e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:24.972512 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad19cc7-9d95-4112-b88d-951d32fa33e0 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:24.972792 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad19cc7-9d95-4112-b88d-951d32fa33e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:24.973058 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad19cc7-9d95-4112-b88d-951d32fa33e0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:24.984624 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad19cc7-9d95-4112-b88d-951d32fa33e0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:24.986062 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad19cc7-9d95-4112-b88d-951d32fa33e0 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:25.005502 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-fad19cc7-9d95-4112-b88d-951d32fa33e0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 19 14:44:25.005502 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:25.005502 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:25.005502 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:25.005502 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:25.005502 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:25.005502 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:25.005502 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:25.005502 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:25.005502 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:25.005502 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:25.005502 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:25.005502 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 14:44:25.005502 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 14:44:25.005502 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 14:44:25.005502 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 14:44:25.006505 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:25.006505 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:25.006505 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:44:25.006505 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:44:25.006505 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:44:25.006505 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:44:25.006505 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:25.006505 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:25.006505 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:25.006505 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:25.006505 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:25.006505 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:25.006505 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:25.006505 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:25.006505 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:25.006505 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:25.006505 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:25.006505 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:25.007448 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:25.007448 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:25.007448 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 14:44:25.007448 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 14:44:25.007448 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 14:44:25.007448 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 14:44:25.007448 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 14:44:25.007448 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 14:44:25.007448 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 19 14:44:25.007448 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:44:25.008532 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 391/785] 10.222.0.72 () {56 vars in 1096 bytes} [Mon Sep 19 14:44:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:25.013579 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad19cc7-9d95-4112-b88d-951d32fa33e0 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:25.043706 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:25.062183 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ddf55e-aefb-420e-8422-acfa2cc265b6 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:25.091736 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:25.109149 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d76f3e-bbd6-4d4a-a921-128f203c822c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:25.110121 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d76f3e-bbd6-4d4a-a921-128f203c822c None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:25.110598 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d76f3e-bbd6-4d4a-a921-128f203c822c None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:25.111063 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d76f3e-bbd6-4d4a-a921-128f203c822c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:25.112001 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d76f3e-bbd6-4d4a-a921-128f203c822c None admin] RBAC: Adding query filter params (interface=public, service_id=0fc6138df7dd4395954b0e0ac931a083, region_id=RegionOne) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:25.113217 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d76f3e-bbd6-4d4a-a921-128f203c822c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:25.115354 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d76f3e-bbd6-4d4a-a921-128f203c822c None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:25.128366 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 395/786] 10.222.0.72 () {56 vars in 1251 bytes} [Mon Sep 19 14:44:24 2022] GET /identity/v3/endpoints?service_id=0fc6138df7dd4395954b0e0ac931a083&interface=public®ion_id=RegionOne => generated 194 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:44:25.130213 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362a1abf-a89e-4fc7-8097-71b9bf90ff3f None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:25.130506 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362a1abf-a89e-4fc7-8097-71b9bf90ff3f None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:25.132665 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362a1abf-a89e-4fc7-8097-71b9bf90ff3f None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:25.135245 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 396/787] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:44:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:44:25.136483 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362a1abf-a89e-4fc7-8097-71b9bf90ff3f None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:25.152685 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad19cc7-9d95-4112-b88d-951d32fa33e0 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:25.192003 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2306f96e-fd87-4bf4-bf15-1ba8a2b050fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:25.192680 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2306f96e-fd87-4bf4-bf15-1ba8a2b050fe None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:25.192962 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2306f96e-fd87-4bf4-bf15-1ba8a2b050fe None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:25.193249 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2306f96e-fd87-4bf4-bf15-1ba8a2b050fe None admin] PATH_INFO: `/v3/users` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:25.193971 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2306f96e-fd87-4bf4-bf15-1ba8a2b050fe None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:25.194279 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2306f96e-fd87-4bf4-bf15-1ba8a2b050fe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:25.195808 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2306f96e-fd87-4bf4-bf15-1ba8a2b050fe None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:25.223539 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 392/788] 10.222.0.72 () {56 vars in 1135 bytes} [Mon Sep 19 14:44:25 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:25.225293 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d6ae3-915f-4ebf-ad3a-c729e6436e76 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:25.225406 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d6ae3-915f-4ebf-ad3a-c729e6436e76 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:25.225620 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d6ae3-915f-4ebf-ad3a-c729e6436e76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:25.246788 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-9a1d6ae3-915f-4ebf-ad3a-c729e6436e76 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:44:25.247985 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-9a1d6ae3-915f-4ebf-ad3a-c729e6436e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:44:25.260990 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362a1abf-a89e-4fc7-8097-71b9bf90ff3f None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:25.296046 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdf57d7-2d9f-4df3-b456-675f7bd37d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:25.296680 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf57d7-2d9f-4df3-b456-675f7bd37d61 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:25.296961 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf57d7-2d9f-4df3-b456-675f7bd37d61 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:25.297231 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf57d7-2d9f-4df3-b456-675f7bd37d61 None admin] PATH_INFO: `/v3/services` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:25.297829 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdf57d7-2d9f-4df3-b456-675f7bd37d61 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:25.299188 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdf57d7-2d9f-4df3-b456-675f7bd37d61 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:25.308432 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 397/789] 10.222.0.72 () {56 vars in 1087 bytes} [Mon Sep 19 14:44:25 2022] GET /identity/v3/services => generated 772 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:25.308432 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdf57d7-2d9f-4df3-b456-675f7bd37d61 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:25.328674 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:25.344826 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 393/790] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:44:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:44:25.346622 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d028a6-99b0-49d9-ae86-a0ab49922f7e None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:25.346905 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d028a6-99b0-49d9-ae86-a0ab49922f7e None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:25.347229 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d028a6-99b0-49d9-ae86-a0ab49922f7e None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:25.348984 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 394/791] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:44:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:44:25.354584 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f393175-4604-4047-958c-729174e66523 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:25.354910 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f393175-4604-4047-958c-729174e66523 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:25.355736 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f393175-4604-4047-958c-729174e66523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:25.375629 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:25.392854 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-8f393175-4604-4047-958c-729174e66523 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:44:25.394205 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-8f393175-4604-4047-958c-729174e66523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:44:25.432881 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdf57d7-2d9f-4df3-b456-675f7bd37d61 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:25.494901 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65f1250-1eac-417d-9406-140c4a81e28c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:25.495553 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f1250-1eac-417d-9406-140c4a81e28c None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:25.496754 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f1250-1eac-417d-9406-140c4a81e28c None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:25.497266 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f1250-1eac-417d-9406-140c4a81e28c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:25.529562 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65f1250-1eac-417d-9406-140c4a81e28c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:25.530126 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65f1250-1eac-417d-9406-140c4a81e28c None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:25.540739 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 395/792] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:44:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 14:44:25.549218 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-a65f1250-1eac-417d-9406-140c4a81e28c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:44:25.549218 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:25.549218 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:25.549218 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:25.549218 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:25.549218 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:25.549218 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:25.549218 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:25.549218 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:25.549218 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:25.549218 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:25.549218 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:25.549218 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:44:25.549218 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:44:25.549218 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:44:25.549218 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:44:25.550156 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:25.550156 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:25.550156 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:25.550156 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:25.550156 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:25.550156 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:25.550156 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:25.550156 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:25.550156 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:25.550156 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:25.550156 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:25.550156 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:25.550156 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:25.550156 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:25.550156 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:25.550156 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:25.550156 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:44:25.551021 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:44:25.551021 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:44:25.551021 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:44:25.553063 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 398/793] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:44:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:25.560159 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f393175-4604-4047-958c-729174e66523 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:25.668914 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f393175-4604-4047-958c-729174e66523 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:25.701138 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:25.709030 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1cd423-82ef-4c70-80a0-83ac0cbc58eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:25.709652 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1cd423-82ef-4c70-80a0-83ac0cbc58eb None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:25.709929 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1cd423-82ef-4c70-80a0-83ac0cbc58eb None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:25.710196 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1cd423-82ef-4c70-80a0-83ac0cbc58eb None admin] PATH_INFO: `/v3/domains` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:25.710844 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1cd423-82ef-4c70-80a0-83ac0cbc58eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:25.711144 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1cd423-82ef-4c70-80a0-83ac0cbc58eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:25.716361 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1cd423-82ef-4c70-80a0-83ac0cbc58eb None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:25.716487 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65f1250-1eac-417d-9406-140c4a81e28c None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:25.727903 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 396/794] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Sep 19 14:44:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:25.734517 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1cd423-82ef-4c70-80a0-83ac0cbc58eb None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:25.830261 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65f1250-1eac-417d-9406-140c4a81e28c None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:25.831818 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:25.876173 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3899224e-3277-42c6-8ddd-4678723a842b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:25.876877 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3899224e-3277-42c6-8ddd-4678723a842b None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:25.877260 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3899224e-3277-42c6-8ddd-4678723a842b None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:25.877687 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3899224e-3277-42c6-8ddd-4678723a842b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:25.891484 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3899224e-3277-42c6-8ddd-4678723a842b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:44:25.899904 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-3899224e-3277-42c6-8ddd-4678723a842b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:44:25.899904 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:25.899904 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:25.899904 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:25.899904 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:25.899904 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:25.899904 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:25.899904 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:25.899904 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:25.899904 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:25.899904 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:25.899904 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:25.899904 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:44:25.899904 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:44:25.899904 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:44:25.899904 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:44:25.900903 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:44:25.900903 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:44:25.900903 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:44:25.900903 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:44:25.900903 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:25.900903 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:25.900903 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:25.900903 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:25.900903 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:25.900903 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:25.900903 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:25.900903 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:25.900903 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:25.900903 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:25.900903 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:25.900903 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:25.901748 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:25.901748 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:25.901748 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:25.901748 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:25.901748 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:44:25.901748 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:44:25.901748 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:44:25.901748 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:44:25.901748 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:44:25.901748 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:44:25.901748 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:44:25.901748 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:44:25.901748 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 399/795] 10.222.0.72 () {56 vars in 1102 bytes} [Mon Sep 19 14:44:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:44:25.903167 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3899224e-3277-42c6-8ddd-4678723a842b None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:25.912981 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1cd423-82ef-4c70-80a0-83ac0cbc58eb None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:25.959510 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4376b51-f2dd-4c85-a41f-30b647503056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:25.960529 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4376b51-f2dd-4c85-a41f-30b647503056 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:25.960989 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4376b51-f2dd-4c85-a41f-30b647503056 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:25.961861 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4376b51-f2dd-4c85-a41f-30b647503056 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:25.971524 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4376b51-f2dd-4c85-a41f-30b647503056 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:25.973795 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4376b51-f2dd-4c85-a41f-30b647503056 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:25.990965 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-e4376b51-f2dd-4c85-a41f-30b647503056 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:44:25.990965 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:25.990965 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:25.990965 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:25.990965 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:25.990965 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:25.990965 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:25.990965 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:25.990965 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:25.990965 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:25.990965 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:25.990965 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:25.990965 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 14:44:25.990965 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 14:44:25.990965 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 14:44:25.991885 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 14:44:25.991885 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:25.991885 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:25.991885 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:25.991885 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:25.991885 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:25.991885 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:25.991885 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:25.991885 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:25.991885 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:25.991885 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:25.991885 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:25.991885 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:25.991885 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:25.991885 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:25.991885 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:25.991885 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:25.993297 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 14:44:25.993297 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 14:44:25.993297 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:44:25.993297 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:44:25.993297 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:44:25.993297 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:44:25.993297 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:44:25.993297 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:44:25.994965 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 397/796] 10.222.0.72 () {56 vars in 1111 bytes} [Mon Sep 19 14:44:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:44:25.995578 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4376b51-f2dd-4c85-a41f-30b647503056 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:26.047557 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:26.049640 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3899224e-3277-42c6-8ddd-4678723a842b None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:26.087767 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bfc8a7-f034-46db-8a67-4eca60b3887a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:26.088462 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bfc8a7-f034-46db-8a67-4eca60b3887a None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:26.088873 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bfc8a7-f034-46db-8a67-4eca60b3887a None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:26.089145 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bfc8a7-f034-46db-8a67-4eca60b3887a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:26.100658 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bfc8a7-f034-46db-8a67-4eca60b3887a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:44:26.106920 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-e9bfc8a7-f034-46db-8a67-4eca60b3887a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:44:26.106920 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:26.106920 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:26.106920 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:26.106920 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:26.106920 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:26.106920 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:26.106920 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:26.106920 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:26.106920 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:26.106920 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:26.106920 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:26.106920 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:44:26.106920 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:44:26.106920 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:44:26.106920 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:44:26.107867 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:44:26.107867 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:44:26.107867 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:44:26.107867 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:44:26.107867 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:26.107867 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:26.107867 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:26.107867 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:26.107867 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:26.107867 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:26.107867 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:26.107867 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:26.107867 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:26.107867 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:26.107867 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:26.107867 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:26.108754 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:26.108754 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:26.108754 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:26.108754 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:26.108754 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:44:26.108754 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:44:26.108754 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:44:26.108754 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:44:26.108754 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:44:26.108754 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:44:26.108754 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:44:26.108754 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:44:26.112975 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 400/797] 10.222.0.72 () {56 vars in 1096 bytes} [Mon Sep 19 14:44:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:26.113935 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bfc8a7-f034-46db-8a67-4eca60b3887a None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:26.118496 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4376b51-f2dd-4c85-a41f-30b647503056 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:26.143976 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:26.160148 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a38a91-9615-439d-ad7e-916edd207fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:26.160796 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a38a91-9615-439d-ad7e-916edd207fd4 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:26.161075 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a38a91-9615-439d-ad7e-916edd207fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:26.161345 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a38a91-9615-439d-ad7e-916edd207fd4 None admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:26.162005 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a38a91-9615-439d-ad7e-916edd207fd4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:26.162305 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a38a91-9615-439d-ad7e-916edd207fd4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:26.163658 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a38a91-9615-439d-ad7e-916edd207fd4 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:26.176304 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 398/798] 10.222.0.72 () {56 vars in 1103 bytes} [Mon Sep 19 14:44:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:26.179417 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a38a91-9615-439d-ad7e-916edd207fd4 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:26.234330 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bfc8a7-f034-46db-8a67-4eca60b3887a None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:26.270436 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f7a353-e2f5-4de1-b168-06e5cf8808cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:26.271431 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f7a353-e2f5-4de1-b168-06e5cf8808cc None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:26.271980 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f7a353-e2f5-4de1-b168-06e5cf8808cc None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:26.272510 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f7a353-e2f5-4de1-b168-06e5cf8808cc None admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:26.273397 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f7a353-e2f5-4de1-b168-06e5cf8808cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:26.273992 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f7a353-e2f5-4de1-b168-06e5cf8808cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:26.275621 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f7a353-e2f5-4de1-b168-06e5cf8808cc None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:26.288918 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 401/799] 10.222.0.72 () {56 vars in 1148 bytes} [Mon Sep 19 14:44:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:26.290110 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f7a353-e2f5-4de1-b168-06e5cf8808cc None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:26.301386 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a38a91-9615-439d-ad7e-916edd207fd4 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:26.317792 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:26.344882 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb11f1a-9d9c-446e-99dc-a0200f532009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:26.345558 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb11f1a-9d9c-446e-99dc-a0200f532009 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:26.345847 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb11f1a-9d9c-446e-99dc-a0200f532009 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:26.346124 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb11f1a-9d9c-446e-99dc-a0200f532009 None admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:26.347207 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb11f1a-9d9c-446e-99dc-a0200f532009 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:26.347521 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb11f1a-9d9c-446e-99dc-a0200f532009 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:26.348917 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb11f1a-9d9c-446e-99dc-a0200f532009 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:26.364406 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 399/800] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Sep 19 14:44:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:26.365577 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb11f1a-9d9c-446e-99dc-a0200f532009 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:26.384657 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:26.408545 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f7a353-e2f5-4de1-b168-06e5cf8808cc None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:26.448301 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226ade7d-2879-444f-bc87-22906ea53030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:26.449355 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226ade7d-2879-444f-bc87-22906ea53030 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:26.449749 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226ade7d-2879-444f-bc87-22906ea53030 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:26.450099 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226ade7d-2879-444f-bc87-22906ea53030 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:26.461091 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226ade7d-2879-444f-bc87-22906ea53030 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:26.462670 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226ade7d-2879-444f-bc87-22906ea53030 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:26.481346 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-226ade7d-2879-444f-bc87-22906ea53030 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:44:26.481346 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:26.481346 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:26.481346 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:26.481346 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:26.481346 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:26.481346 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:26.481346 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:26.481346 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:26.481346 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:26.481346 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:26.481346 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:26.481346 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:44:26.481346 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:44:26.481346 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:44:26.481346 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:44:26.482549 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:26.482549 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:26.482549 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:26.482549 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:26.482549 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:26.482549 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:26.482549 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:26.482549 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:26.482549 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:26.482549 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:26.482549 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:26.482549 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:26.482549 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:26.482549 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:26.482549 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:26.482549 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:26.482549 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:44:26.483654 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:44:26.483654 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:44:26.483654 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:44:26.489578 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 402/801] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:44:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:26.489578 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226ade7d-2879-444f-bc87-22906ea53030 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:26.501243 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb11f1a-9d9c-446e-99dc-a0200f532009 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:26.543236 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae54969-4f2f-40f0-8da4-efe38c359e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:26.543910 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae54969-4f2f-40f0-8da4-efe38c359e79 None admin] REQUEST_METHOD: `PUT` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:26.544191 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae54969-4f2f-40f0-8da4-efe38c359e79 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:26.544496 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae54969-4f2f-40f0-8da4-efe38c359e79 None admin] PATH_INFO: `/v3/projects/51af3a14d665498c9b7a35b34dac0ef1/users/8504425c3a414608b030d0cf1af78af5/roles/ddb643577b2e4e478100ec370decfaeb` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:26.546436 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae54969-4f2f-40f0-8da4-efe38c359e79 None admin] RBAC: Authorizing `identity:create_grant(project_id=51af3a14d665498c9b7a35b34dac0ef1, user_id=8504425c3a414608b030d0cf1af78af5, role_id=ddb643577b2e4e478100ec370decfaeb)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:26.547854 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae54969-4f2f-40f0-8da4-efe38c359e79 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:26.561944 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 400/802] 10.222.0.72 () {58 vars in 1439 bytes} [Mon Sep 19 14:44:26 2022] PUT /identity/v3/projects/51af3a14d665498c9b7a35b34dac0ef1/users/8504425c3a414608b030d0cf1af78af5/roles/ddb643577b2e4e478100ec370decfaeb => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:44:26.562736 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae54969-4f2f-40f0-8da4-efe38c359e79 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:26.612113 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:26.635628 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226ade7d-2879-444f-bc87-22906ea53030 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:26.688509 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3416f1c-37c3-4c03-b8c5-e8eeab88174c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:26.689504 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3416f1c-37c3-4c03-b8c5-e8eeab88174c None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:26.689790 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3416f1c-37c3-4c03-b8c5-e8eeab88174c None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:26.690070 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3416f1c-37c3-4c03-b8c5-e8eeab88174c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:26.693181 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:26.698507 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae54969-4f2f-40f0-8da4-efe38c359e79 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:26.707732 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3416f1c-37c3-4c03-b8c5-e8eeab88174c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:26.709951 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3416f1c-37c3-4c03-b8c5-e8eeab88174c None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:26.733580 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-e3416f1c-37c3-4c03-b8c5-e8eeab88174c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:44:26.733580 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:26.733580 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:26.733580 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:26.733580 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:26.733580 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:26.733580 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:26.733580 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:26.733580 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:26.733580 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:26.733580 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:26.733580 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:26.733580 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:44:26.733580 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:44:26.733580 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:44:26.733580 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:44:26.734574 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:26.734574 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:26.734574 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:26.734574 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:26.734574 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:26.734574 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:26.734574 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:26.734574 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:26.734574 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:26.734574 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:26.734574 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:26.734574 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:26.734574 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:26.734574 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:26.734574 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:26.734574 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:26.734574 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:44:26.735459 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:44:26.735459 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:44:26.735459 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:44:26.735459 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 403/803] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:44:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:26.735459 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d350e-4bbe-4cca-aab0-4219a8e242ec None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:26.735748 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d350e-4bbe-4cca-aab0-4219a8e242ec None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:26.736061 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d350e-4bbe-4cca-aab0-4219a8e242ec None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:26.742002 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 404/804] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:44:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:44:26.743944 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8d350e-4bbe-4cca-aab0-4219a8e242ec None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:26.745535 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65249b3-7d91-4609-9315-9a80200d6eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:26.746777 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65249b3-7d91-4609-9315-9a80200d6eb1 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:26.747066 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65249b3-7d91-4609-9315-9a80200d6eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:26.747326 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65249b3-7d91-4609-9315-9a80200d6eb1 None admin] PATH_INFO: `/v3/domains` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:26.747975 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65249b3-7d91-4609-9315-9a80200d6eb1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:26.748279 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65249b3-7d91-4609-9315-9a80200d6eb1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:26.749764 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65249b3-7d91-4609-9315-9a80200d6eb1 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:26.766805 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 401/805] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Sep 19 14:44:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:26.772568 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a7d7a8-658c-4136-b0ee-9f495c9fcc55 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:26.773188 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a7d7a8-658c-4136-b0ee-9f495c9fcc55 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:26.774689 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a7d7a8-658c-4136-b0ee-9f495c9fcc55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:26.793899 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-e0a7d7a8-658c-4136-b0ee-9f495c9fcc55 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:44:26.795390 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-e0a7d7a8-658c-4136-b0ee-9f495c9fcc55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:44:26.876442 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 402/806] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:44:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:44:26.877340 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a7d7a8-658c-4136-b0ee-9f495c9fcc55 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:26.878355 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8d350e-4bbe-4cca-aab0-4219a8e242ec None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:26.929744 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:26.952136 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0408bc0d-7a52-43d7-8f62-84caa25d006e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:26.952784 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0408bc0d-7a52-43d7-8f62-84caa25d006e None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:26.953076 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0408bc0d-7a52-43d7-8f62-84caa25d006e None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:26.953332 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0408bc0d-7a52-43d7-8f62-84caa25d006e None admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:26.953980 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0408bc0d-7a52-43d7-8f62-84caa25d006e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:26.954283 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0408bc0d-7a52-43d7-8f62-84caa25d006e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:26.955664 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0408bc0d-7a52-43d7-8f62-84caa25d006e None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:26.979200 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 405/807] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Sep 19 14:44:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:44:26.981423 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0408bc0d-7a52-43d7-8f62-84caa25d006e None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:27.043407 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a7d7a8-658c-4136-b0ee-9f495c9fcc55 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:27.082927 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:27.103290 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e84e009-055c-47db-9cf9-1045ea4d9409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:27.103929 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e84e009-055c-47db-9cf9-1045ea4d9409 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:27.104213 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e84e009-055c-47db-9cf9-1045ea4d9409 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:27.104514 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e84e009-055c-47db-9cf9-1045ea4d9409 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:27.121976 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e84e009-055c-47db-9cf9-1045ea4d9409 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:27.123446 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e84e009-055c-47db-9cf9-1045ea4d9409 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:27.138316 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-1e84e009-055c-47db-9cf9-1045ea4d9409 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 14:44:27.138316 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:27.138316 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:27.138316 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:27.138316 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:27.138316 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:27.138316 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:27.138316 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:27.138316 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:27.138316 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:27.138316 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:27.138316 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:27.138316 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 14:44:27.138316 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 14:44:27.138316 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 14:44:27.138316 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 14:44:27.139269 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:27.139269 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:27.139269 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:44:27.139269 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:44:27.139269 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:44:27.139269 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:44:27.139269 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:27.139269 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:27.139269 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:27.139269 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:27.139269 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:27.139269 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:27.139269 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:27.139269 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:27.139269 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:27.139269 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:27.139269 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:27.139269 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:27.140853 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:27.140853 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:27.140853 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 14:44:27.140853 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 14:44:27.140853 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 14:44:27.140853 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 14:44:27.140853 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 14:44:27.140853 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 14:44:27.140853 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 14:44:27.140853 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:44:27.140853 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 403/808] 10.222.0.72 () {56 vars in 1117 bytes} [Mon Sep 19 14:44:26 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:27.145126 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e84e009-055c-47db-9cf9-1045ea4d9409 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:27.155348 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0408bc0d-7a52-43d7-8f62-84caa25d006e None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:27.193386 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9ee97b-1a9e-4846-b115-73278c51fbf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:27.194294 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ee97b-1a9e-4846-b115-73278c51fbf0 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:27.194574 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ee97b-1a9e-4846-b115-73278c51fbf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:27.194846 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ee97b-1a9e-4846-b115-73278c51fbf0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:27.208220 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9ee97b-1a9e-4846-b115-73278c51fbf0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:27.209701 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9ee97b-1a9e-4846-b115-73278c51fbf0 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:27.226751 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-dc9ee97b-1a9e-4846-b115-73278c51fbf0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 19 14:44:27.226751 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:27.226751 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:27.226751 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:27.226751 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:27.226751 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:27.226751 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:27.226751 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:27.226751 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:27.226751 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:27.226751 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:27.226751 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:27.226751 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 14:44:27.226751 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 14:44:27.226751 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 14:44:27.226751 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 14:44:27.227889 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:27.227889 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:27.227889 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:44:27.227889 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:44:27.227889 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:44:27.227889 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:44:27.227889 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:27.227889 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:27.227889 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:27.227889 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:27.227889 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:27.227889 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:27.227889 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:27.227889 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:27.227889 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:27.227889 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:27.227889 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:27.227889 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:27.229313 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:27.229313 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:27.229313 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 14:44:27.229313 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 14:44:27.229313 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 14:44:27.229313 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 14:44:27.229313 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 14:44:27.229313 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 14:44:27.229313 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 19 14:44:27.229313 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:44:27.229313 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 406/809] 10.222.0.72 () {56 vars in 1093 bytes} [Mon Sep 19 14:44:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:27.229313 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9ee97b-1a9e-4846-b115-73278c51fbf0 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:27.247741 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:27.267052 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e84e009-055c-47db-9cf9-1045ea4d9409 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:27.303704 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c480c5b4-6048-4d2c-abf7-0fbe22aeb3a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:27.304556 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c480c5b4-6048-4d2c-abf7-0fbe22aeb3a4 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:27.304997 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c480c5b4-6048-4d2c-abf7-0fbe22aeb3a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:27.305405 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c480c5b4-6048-4d2c-abf7-0fbe22aeb3a4 None admin] PATH_INFO: `/v3/users` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:27.306287 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c480c5b4-6048-4d2c-abf7-0fbe22aeb3a4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:27.306583 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c480c5b4-6048-4d2c-abf7-0fbe22aeb3a4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:27.307991 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c480c5b4-6048-4d2c-abf7-0fbe22aeb3a4 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:27.328436 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 404/810] 10.222.0.72 () {56 vars in 1149 bytes} [Mon Sep 19 14:44:27 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:44:27.328436 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c480c5b4-6048-4d2c-abf7-0fbe22aeb3a4 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:27.358358 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9ee97b-1a9e-4846-b115-73278c51fbf0 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:27.365512 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:27.395570 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fed9b1-9edc-4e88-b0ad-ba0461d48c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:27.396467 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fed9b1-9edc-4e88-b0ad-ba0461d48c9d None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:27.396884 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fed9b1-9edc-4e88-b0ad-ba0461d48c9d None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:27.397290 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fed9b1-9edc-4e88-b0ad-ba0461d48c9d None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:27.398028 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fed9b1-9edc-4e88-b0ad-ba0461d48c9d None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:27.399537 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fed9b1-9edc-4e88-b0ad-ba0461d48c9d None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:27.408707 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-23fed9b1-9edc-4e88-b0ad-ba0461d48c9d None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 19 14:44:27.408707 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:27.408707 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 14:44:27.408707 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 14:44:27.408707 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 14:44:27.408707 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 14:44:27.408707 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 14:44:27.408707 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:44:27.408707 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 19 14:44:27.408707 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:44:27.408707 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 14:44:27.408707 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:44:27.408707 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:27.408707 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:27.408707 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:27.408707 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:27.408707 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:27.409886 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:27.409886 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:27.409886 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:27.409886 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:27.409886 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:27.409886 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:27.409886 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 14:44:27.409886 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 14:44:27.409886 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 14:44:27.409886 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 14:44:27.409886 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:27.409886 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:27.409886 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:27.409886 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:27.409886 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:27.409886 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:27.410844 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:27.410844 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:27.410844 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:27.410844 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:27.410844 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:27.410844 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:27.410844 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:27.410844 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:27.410844 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:27.410844 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:27.410844 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 14:44:27.410844 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:44:27.410844 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 19 14:44:27.410844 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:44:27.417561 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 407/811] 10.222.0.72 () {56 vars in 1129 bytes} [Mon Sep 19 14:44:27 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:27.418605 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fed9b1-9edc-4e88-b0ad-ba0461d48c9d None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:27.443093 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c480c5b4-6048-4d2c-abf7-0fbe22aeb3a4 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:27.479045 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8e8f54-f70d-4b3d-bf86-45d070e546a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:27.479659 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8e8f54-f70d-4b3d-bf86-45d070e546a1 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:27.479938 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8e8f54-f70d-4b3d-bf86-45d070e546a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:27.480767 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8e8f54-f70d-4b3d-bf86-45d070e546a1 None admin] PATH_INFO: `/v3/users` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:27.481928 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8e8f54-f70d-4b3d-bf86-45d070e546a1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:27.482233 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8e8f54-f70d-4b3d-bf86-45d070e546a1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:27.483715 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8e8f54-f70d-4b3d-bf86-45d070e546a1 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:27.499175 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:27.503510 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 405/812] 10.222.0.72 () {56 vars in 1133 bytes} [Mon Sep 19 14:44:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:27.504465 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8e8f54-f70d-4b3d-bf86-45d070e546a1 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:27.535810 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fed9b1-9edc-4e88-b0ad-ba0461d48c9d None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:27.575957 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1b5699-98fb-43bd-850b-5550086384c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:27.577116 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1b5699-98fb-43bd-850b-5550086384c3 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:27.577689 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1b5699-98fb-43bd-850b-5550086384c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:27.578160 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1b5699-98fb-43bd-850b-5550086384c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:27.590107 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1b5699-98fb-43bd-850b-5550086384c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:27.592011 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1b5699-98fb-43bd-850b-5550086384c3 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:27.608449 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-dc1b5699-98fb-43bd-850b-5550086384c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:44:27.608449 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:27.608449 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:27.608449 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:27.608449 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:27.608449 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:27.608449 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:27.608449 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:27.608449 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:27.608449 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:27.608449 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:27.608449 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:27.608449 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:44:27.608449 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:44:27.608449 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:44:27.608449 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:44:27.609399 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:27.609399 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:27.609399 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:27.609399 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:27.609399 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:27.609399 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:27.609399 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:27.609399 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:27.609399 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:27.609399 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:27.609399 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:27.609399 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:27.609399 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:27.609399 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:27.609399 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:27.609399 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:27.609399 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:44:27.610315 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:44:27.610315 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:44:27.610315 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:44:27.612055 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 408/813] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:44:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:27.612229 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8e8f54-f70d-4b3d-bf86-45d070e546a1 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:27.613300 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1b5699-98fb-43bd-850b-5550086384c3 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:27.648962 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:27.660930 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b906448a-e2ce-4170-b795-b2530ae0d8ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:27.661876 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b906448a-e2ce-4170-b795-b2530ae0d8ae None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:27.662413 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b906448a-e2ce-4170-b795-b2530ae0d8ae None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:27.663056 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b906448a-e2ce-4170-b795-b2530ae0d8ae None admin] PATH_INFO: `/v3/services` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:27.664749 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b906448a-e2ce-4170-b795-b2530ae0d8ae None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:27.665264 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b906448a-e2ce-4170-b795-b2530ae0d8ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:27.666898 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b906448a-e2ce-4170-b795-b2530ae0d8ae None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:27.674265 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 406/814] 10.222.0.72 () {56 vars in 1124 bytes} [Mon Sep 19 14:44:27 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:27.675423 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b906448a-e2ce-4170-b795-b2530ae0d8ae None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:27.749650 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1b5699-98fb-43bd-850b-5550086384c3 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:27.757582 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:27.792203 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a20b631-7e58-4c8d-86c2-8f32fd00573d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:27.793496 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a20b631-7e58-4c8d-86c2-8f32fd00573d None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:27.794249 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a20b631-7e58-4c8d-86c2-8f32fd00573d None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:27.794249 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a20b631-7e58-4c8d-86c2-8f32fd00573d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:27.809601 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b906448a-e2ce-4170-b795-b2530ae0d8ae None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:27.860596 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846f1434-f5c5-4d20-a5fe-cdc48ce08473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:27.861678 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f1434-f5c5-4d20-a5fe-cdc48ce08473 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:27.862479 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f1434-f5c5-4d20-a5fe-cdc48ce08473 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:27.863205 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f1434-f5c5-4d20-a5fe-cdc48ce08473 None admin] PATH_INFO: `/v3/domains` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:27.864581 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846f1434-f5c5-4d20-a5fe-cdc48ce08473 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:27.865447 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846f1434-f5c5-4d20-a5fe-cdc48ce08473 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:27.867308 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846f1434-f5c5-4d20-a5fe-cdc48ce08473 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:27.872577 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a20b631-7e58-4c8d-86c2-8f32fd00573d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:27.874035 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a20b631-7e58-4c8d-86c2-8f32fd00573d None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:27.883394 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 407/815] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Sep 19 14:44:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:27.884562 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846f1434-f5c5-4d20-a5fe-cdc48ce08473 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:27.905148 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:28.001564 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 409/816] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Sep 19 14:44:27 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 14:44:28.002653 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a20b631-7e58-4c8d-86c2-8f32fd00573d None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:28.009149 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846f1434-f5c5-4d20-a5fe-cdc48ce08473 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:28.034322 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:28.048087 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09aa911-b7d0-4f21-ae73-fbcce227345a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:28.048724 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09aa911-b7d0-4f21-ae73-fbcce227345a None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:28.049004 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09aa911-b7d0-4f21-ae73-fbcce227345a None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:28.049290 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09aa911-b7d0-4f21-ae73-fbcce227345a None admin] PATH_INFO: `/v3/services` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:28.050020 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09aa911-b7d0-4f21-ae73-fbcce227345a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:28.050324 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09aa911-b7d0-4f21-ae73-fbcce227345a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:28.051928 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09aa911-b7d0-4f21-ae73-fbcce227345a None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:28.061713 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 408/817] 10.222.0.72 () {56 vars in 1124 bytes} [Mon Sep 19 14:44:27 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:28.061713 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dafba5b-fbf0-4f12-a3b1-022dd50c2749 None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:28.061713 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dafba5b-fbf0-4f12-a3b1-022dd50c2749 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:28.061713 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dafba5b-fbf0-4f12-a3b1-022dd50c2749 None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:28.061713 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 409/818] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:44:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:44:28.061713 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dafba5b-fbf0-4f12-a3b1-022dd50c2749 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:28.107245 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a20b631-7e58-4c8d-86c2-8f32fd00573d None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:28.130167 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:28.142959 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22bbb05-d43e-4153-87b5-941d71fd0ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:28.143598 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22bbb05-d43e-4153-87b5-941d71fd0ca7 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:28.143940 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22bbb05-d43e-4153-87b5-941d71fd0ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:28.144218 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22bbb05-d43e-4153-87b5-941d71fd0ca7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:28.152259 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22bbb05-d43e-4153-87b5-941d71fd0ca7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:28.153737 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22bbb05-d43e-4153-87b5-941d71fd0ca7 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:28.165882 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-c22bbb05-d43e-4153-87b5-941d71fd0ca7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:44:28.165882 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:28.165882 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:28.165882 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:28.165882 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:28.165882 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:28.165882 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:28.165882 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:28.165882 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:28.165882 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:28.165882 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:28.165882 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:28.165882 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 14:44:28.165882 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 14:44:28.165882 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 14:44:28.166793 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 14:44:28.166793 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:28.166793 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:28.166793 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:28.166793 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:28.166793 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:28.166793 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:28.166793 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:28.166793 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:28.166793 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:28.166793 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:28.166793 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:28.166793 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:28.166793 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:28.166793 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:28.166793 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:28.166793 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:28.167867 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 14:44:28.167867 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 14:44:28.167867 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:44:28.167867 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:44:28.167867 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:44:28.167867 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:44:28.167867 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:44:28.167867 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:44:28.167867 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 410/819] 10.222.0.72 () {56 vars in 1111 bytes} [Mon Sep 19 14:44:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:28.167867 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22bbb05-d43e-4153-87b5-941d71fd0ca7 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:28.176910 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dafba5b-fbf0-4f12-a3b1-022dd50c2749 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:28.215319 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad7c10a-cb53-46bd-8f1b-8e99e301e416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:28.215930 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad7c10a-cb53-46bd-8f1b-8e99e301e416 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:28.216208 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad7c10a-cb53-46bd-8f1b-8e99e301e416 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:28.216523 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad7c10a-cb53-46bd-8f1b-8e99e301e416 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:28.227747 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad7c10a-cb53-46bd-8f1b-8e99e301e416 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:28.229190 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad7c10a-cb53-46bd-8f1b-8e99e301e416 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:28.244200 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-4ad7c10a-cb53-46bd-8f1b-8e99e301e416 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:44:28.244200 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:28.244200 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:28.244200 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:28.244200 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:28.244200 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:28.244200 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:28.244200 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:28.244200 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:28.244200 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:28.244200 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:28.244200 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:28.244200 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:44:28.244200 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:44:28.244200 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:44:28.244200 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:44:28.245381 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:28.245381 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:28.245381 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:28.245381 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:28.245381 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:28.245381 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:28.245381 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:28.245381 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:28.245381 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:28.245381 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:28.245381 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:28.245381 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:28.245381 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:28.245381 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:28.245381 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:28.245381 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:28.245381 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:44:28.247083 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:44:28.247083 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:44:28.247083 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:44:28.250518 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 410/820] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:44:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:28.251876 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96106a42-b8bb-4e4c-ad2b-f7e35e574a07 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:28.252163 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96106a42-b8bb-4e4c-ad2b-f7e35e574a07 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:28.252474 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96106a42-b8bb-4e4c-ad2b-f7e35e574a07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:28.270989 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-96106a42-b8bb-4e4c-ad2b-f7e35e574a07 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:44:28.272166 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-96106a42-b8bb-4e4c-ad2b-f7e35e574a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:44:28.278249 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22bbb05-d43e-4153-87b5-941d71fd0ca7 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:28.311194 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:28.316007 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a17b5e-9f70-4fe7-b625-775315f70cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:28.317012 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a17b5e-9f70-4fe7-b625-775315f70cdb None admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:28.317305 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a17b5e-9f70-4fe7-b625-775315f70cdb None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:28.317681 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a17b5e-9f70-4fe7-b625-775315f70cdb None admin] PATH_INFO: `/v3/endpoints` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:28.318377 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a17b5e-9f70-4fe7-b625-775315f70cdb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:28.319791 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a17b5e-9f70-4fe7-b625-775315f70cdb None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:28.343718 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 411/821] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Sep 19 14:44:28 2022] POST /identity/v3/endpoints => generated 346 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:44:28.344717 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a17b5e-9f70-4fe7-b625-775315f70cdb None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:28.368369 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 411/822] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:44:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:44:28.370086 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96106a42-b8bb-4e4c-ad2b-f7e35e574a07 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:28.425815 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:28.545605 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a17b5e-9f70-4fe7-b625-775315f70cdb None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:28.567251 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96106a42-b8bb-4e4c-ad2b-f7e35e574a07 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:28.583780 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89040556-a5ec-4f08-9cdd-b6c15773ae4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:28.585277 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89040556-a5ec-4f08-9cdd-b6c15773ae4c None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:28.585277 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89040556-a5ec-4f08-9cdd-b6c15773ae4c None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:28.585277 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89040556-a5ec-4f08-9cdd-b6c15773ae4c None admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:28.585843 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89040556-a5ec-4f08-9cdd-b6c15773ae4c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:28.586158 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89040556-a5ec-4f08-9cdd-b6c15773ae4c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:28.588836 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89040556-a5ec-4f08-9cdd-b6c15773ae4c None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:28.604718 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 412/823] 10.222.0.72 () {56 vars in 1148 bytes} [Mon Sep 19 14:44:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:28.611354 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89040556-a5ec-4f08-9cdd-b6c15773ae4c None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:28.613407 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc958df3-f64b-4ea2-a9ab-55f53e5c56af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:28.614560 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc958df3-f64b-4ea2-a9ab-55f53e5c56af None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:28.616000 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc958df3-f64b-4ea2-a9ab-55f53e5c56af None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:28.616525 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc958df3-f64b-4ea2-a9ab-55f53e5c56af None admin] PATH_INFO: `/v3/domains` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:28.617383 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc958df3-f64b-4ea2-a9ab-55f53e5c56af None admin] RBAC: Adding query filter params (name=Default) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:28.617911 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc958df3-f64b-4ea2-a9ab-55f53e5c56af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:28.619507 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc958df3-f64b-4ea2-a9ab-55f53e5c56af None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:28.634840 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 412/824] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Sep 19 14:44:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:28.639903 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc958df3-f64b-4ea2-a9ab-55f53e5c56af None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:28.676956 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:28.749389 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:28.755477 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89040556-a5ec-4f08-9cdd-b6c15773ae4c None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:28.773616 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc958df3-f64b-4ea2-a9ab-55f53e5c56af None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:28.804014 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bedf9c-3382-4655-81f4-545bd0411419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:28.805509 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bedf9c-3382-4655-81f4-545bd0411419 None admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:28.805944 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bedf9c-3382-4655-81f4-545bd0411419 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:28.806393 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bedf9c-3382-4655-81f4-545bd0411419 None admin] PATH_INFO: `/v3/projects/51af3a14d665498c9b7a35b34dac0ef1/users/afbbbf11f3234297ab1dd509f064480f/roles/537cde5f25284acca3c3ea9ff806d724` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:28.816209 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5053fc09-785e-428e-90cc-ed6565b42249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:28.817057 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5053fc09-785e-428e-90cc-ed6565b42249 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:28.817397 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5053fc09-785e-428e-90cc-ed6565b42249 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:28.817735 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5053fc09-785e-428e-90cc-ed6565b42249 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:28.824517 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bedf9c-3382-4655-81f4-545bd0411419 None admin] RBAC: Authorizing `identity:create_grant(project_id=51af3a14d665498c9b7a35b34dac0ef1, user_id=afbbbf11f3234297ab1dd509f064480f, role_id=537cde5f25284acca3c3ea9ff806d724)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:28.826109 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5053fc09-785e-428e-90cc-ed6565b42249 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:28.826692 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bedf9c-3382-4655-81f4-545bd0411419 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:28.827720 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5053fc09-785e-428e-90cc-ed6565b42249 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:28.841878 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-5053fc09-785e-428e-90cc-ed6565b42249 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:44:28.841878 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:28.841878 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:28.841878 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:28.841878 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:28.841878 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:28.841878 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:28.841878 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:28.841878 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:28.841878 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:28.841878 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:28.841878 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:28.841878 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 14:44:28.841878 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 14:44:28.841878 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 14:44:28.842844 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 14:44:28.842844 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:28.842844 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:28.842844 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:28.842844 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:28.842844 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:28.842844 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:28.842844 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:28.842844 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:28.842844 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:28.842844 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:28.842844 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:28.842844 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:28.842844 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:28.842844 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:28.842844 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:28.842844 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:28.843727 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 14:44:28.843727 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 14:44:28.843727 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:44:28.843727 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:44:28.843727 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:44:28.843727 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:44:28.843727 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:44:28.843727 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:44:28.843727 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 413/825] 10.222.0.72 () {56 vars in 1111 bytes} [Mon Sep 19 14:44:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:28.844756 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5053fc09-785e-428e-90cc-ed6565b42249 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:28.845569 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 413/826] 10.222.0.72 () {58 vars in 1439 bytes} [Mon Sep 19 14:44:28 2022] PUT /identity/v3/projects/51af3a14d665498c9b7a35b34dac0ef1/users/afbbbf11f3234297ab1dd509f064480f/roles/537cde5f25284acca3c3ea9ff806d724 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:44:28.849949 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bedf9c-3382-4655-81f4-545bd0411419 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:28.955636 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:28.974386 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5053fc09-785e-428e-90cc-ed6565b42249 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:28.986561 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bedf9c-3382-4655-81f4-545bd0411419 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:29.013860 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00da30b2-0173-4969-91fb-7c00b4d0c42f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:29.014867 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00da30b2-0173-4969-91fb-7c00b4d0c42f None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:29.015325 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00da30b2-0173-4969-91fb-7c00b4d0c42f None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:29.015797 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00da30b2-0173-4969-91fb-7c00b4d0c42f None admin] PATH_INFO: `/v3/services/network` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:29.016604 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00da30b2-0173-4969-91fb-7c00b4d0c42f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:29.018221 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00da30b2-0173-4969-91fb-7c00b4d0c42f None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:29.028684 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-00da30b2-0173-4969-91fb-7c00b4d0c42f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 19 14:44:29.028684 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:29.028684 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 14:44:29.028684 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 14:44:29.028684 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 14:44:29.028684 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 14:44:29.028684 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 14:44:29.028684 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:44:29.028684 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 19 14:44:29.028684 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:44:29.028684 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 14:44:29.028684 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:44:29.028684 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:29.028684 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:29.028684 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:29.028684 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:29.028684 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:29.029755 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:29.029755 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:29.029755 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:29.029755 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:29.029755 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:29.029755 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:29.029755 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 14:44:29.029755 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 14:44:29.029755 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 14:44:29.029755 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 14:44:29.029755 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:29.029755 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:29.029755 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:29.029755 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:29.029755 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:29.029755 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:29.030581 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:29.030581 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:29.030581 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:29.030581 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:29.030581 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:29.030581 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:29.030581 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:29.030581 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:29.030581 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:29.030581 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:29.030581 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 14:44:29.030581 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:44:29.030581 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 19 14:44:29.030581 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:44:29.031300 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750447a1-55c5-4f54-9d87-e3e28cbe9a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:29.031300 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750447a1-55c5-4f54-9d87-e3e28cbe9a3f None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:29.031300 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750447a1-55c5-4f54-9d87-e3e28cbe9a3f None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:29.031300 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750447a1-55c5-4f54-9d87-e3e28cbe9a3f None admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:29.031571 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750447a1-55c5-4f54-9d87-e3e28cbe9a3f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:29.031571 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750447a1-55c5-4f54-9d87-e3e28cbe9a3f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:29.032936 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750447a1-55c5-4f54-9d87-e3e28cbe9a3f None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:29.034224 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 414/827] 10.222.0.72 () {56 vars in 1111 bytes} [Mon Sep 19 14:44:28 2022] GET /identity/v3/services/network => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:29.035753 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17ca698-d4df-45f1-a7d6-9059516fc653 None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:29.036258 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17ca698-d4df-45f1-a7d6-9059516fc653 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:29.036755 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17ca698-d4df-45f1-a7d6-9059516fc653 None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:29.038490 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 415/828] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:44:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:44:29.039491 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17ca698-d4df-45f1-a7d6-9059516fc653 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:29.047750 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 414/829] 10.222.0.72 () {56 vars in 1148 bytes} [Mon Sep 19 14:44:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:44:29.049706 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bc26bd-67de-43b7-9e1d-d927bcbabcd5 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:29.050051 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bc26bd-67de-43b7-9e1d-d927bcbabcd5 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:29.050400 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bc26bd-67de-43b7-9e1d-d927bcbabcd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:29.070948 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-93bc26bd-67de-43b7-9e1d-d927bcbabcd5 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:44:29.072192 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-93bc26bd-67de-43b7-9e1d-d927bcbabcd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:44:29.074642 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:29.165553 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17ca698-d4df-45f1-a7d6-9059516fc653 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:29.170286 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 415/830] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:44:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:44:29.171239 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bc26bd-67de-43b7-9e1d-d927bcbabcd5 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:29.224989 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d458029c-8b8c-49f4-9b41-2cdf70e0b399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:29.226380 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d458029c-8b8c-49f4-9b41-2cdf70e0b399 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:29.226840 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d458029c-8b8c-49f4-9b41-2cdf70e0b399 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:29.227289 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d458029c-8b8c-49f4-9b41-2cdf70e0b399 None admin] PATH_INFO: `/v3/services` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:29.228091 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d458029c-8b8c-49f4-9b41-2cdf70e0b399 None admin] RBAC: Adding query filter params (name=network) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:29.228603 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d458029c-8b8c-49f4-9b41-2cdf70e0b399 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:29.230897 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d458029c-8b8c-49f4-9b41-2cdf70e0b399 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:29.236158 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 416/831] 10.222.0.72 () {56 vars in 1112 bytes} [Mon Sep 19 14:44:29 2022] GET /identity/v3/services?name=network => generated 124 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:44:29.241393 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d458029c-8b8c-49f4-9b41-2cdf70e0b399 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:29.270167 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:29.367018 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bc26bd-67de-43b7-9e1d-d927bcbabcd5 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:29.409837 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce81e27b-5f1b-4b46-a001-bdb44624be0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:29.410912 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce81e27b-5f1b-4b46-a001-bdb44624be0a None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:29.411192 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce81e27b-5f1b-4b46-a001-bdb44624be0a None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:29.411465 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce81e27b-5f1b-4b46-a001-bdb44624be0a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:29.412191 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce81e27b-5f1b-4b46-a001-bdb44624be0a None admin] RBAC: Adding query filter params (role.id=ddb643577b2e4e478100ec370decfaeb, scope.project.id=51af3a14d665498c9b7a35b34dac0ef1, user.id=055439dc35e946f4a82535c684f9b60d) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:29.412544 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce81e27b-5f1b-4b46-a001-bdb44624be0a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:29.414487 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce81e27b-5f1b-4b46-a001-bdb44624be0a None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:29.422528 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 416/832] 10.222.0.72 () {56 vars in 1374 bytes} [Mon Sep 19 14:44:29 2022] GET /identity/v3/role_assignments?user.id=055439dc35e946f4a82535c684f9b60d&scope.project.id=51af3a14d665498c9b7a35b34dac0ef1&role.id=ddb643577b2e4e478100ec370decfaeb => generated 608 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:29.444086 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d458029c-8b8c-49f4-9b41-2cdf70e0b399 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:29.484112 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142919f5-9e8a-4008-9d2d-725dc6be028f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:29.484688 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142919f5-9e8a-4008-9d2d-725dc6be028f None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:29.484968 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142919f5-9e8a-4008-9d2d-725dc6be028f None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:29.485240 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142919f5-9e8a-4008-9d2d-725dc6be028f None admin] PATH_INFO: `/v3/services` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:29.485889 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142919f5-9e8a-4008-9d2d-725dc6be028f None admin] RBAC: Adding query filter params (type=network) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:29.486191 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142919f5-9e8a-4008-9d2d-725dc6be028f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:29.487725 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142919f5-9e8a-4008-9d2d-725dc6be028f None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:29.493940 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 417/833] 10.222.0.72 () {56 vars in 1112 bytes} [Mon Sep 19 14:44:29 2022] GET /identity/v3/services?type=network => generated 350 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:44:29.501437 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142919f5-9e8a-4008-9d2d-725dc6be028f None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:29.501604 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce81e27b-5f1b-4b46-a001-bdb44624be0a None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:29.504998 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:29.644725 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:29.664203 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142919f5-9e8a-4008-9d2d-725dc6be028f None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:29.700869 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc406e1-87f5-4b37-a16f-30984626462b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:29.701487 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc406e1-87f5-4b37-a16f-30984626462b None admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:29.701770 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc406e1-87f5-4b37-a16f-30984626462b None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:29.702038 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc406e1-87f5-4b37-a16f-30984626462b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:29.702723 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc406e1-87f5-4b37-a16f-30984626462b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:29.704070 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc406e1-87f5-4b37-a16f-30984626462b None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:29.744869 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 418/834] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Sep 19 14:44:29 2022] POST /identity/v3/endpoints => generated 337 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:44:29.817573 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce81e27b-5f1b-4b46-a001-bdb44624be0a None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:29.873538 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fe6f40-cc6b-4f3e-b899-fdfc9ec050c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:29.874257 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fe6f40-cc6b-4f3e-b899-fdfc9ec050c0 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:29.874542 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fe6f40-cc6b-4f3e-b899-fdfc9ec050c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:29.874814 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fe6f40-cc6b-4f3e-b899-fdfc9ec050c0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:29.894015 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fe6f40-cc6b-4f3e-b899-fdfc9ec050c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:44:29.899309 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-e5fe6f40-cc6b-4f3e-b899-fdfc9ec050c0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:44:29.899309 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:29.899309 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:29.899309 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:29.899309 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:29.899309 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:29.899309 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:29.899309 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:29.899309 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:29.899309 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:29.899309 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:29.899309 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:29.899309 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:44:29.899309 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:44:29.899309 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:44:29.899309 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:44:29.900272 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:44:29.900272 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:44:29.900272 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:44:29.900272 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:44:29.900272 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:29.900272 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:29.900272 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:29.900272 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:29.900272 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:29.900272 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:29.900272 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:29.900272 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:29.900272 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:29.900272 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:29.900272 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:29.900272 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:29.901162 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:29.901162 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:29.901162 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:29.901162 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:29.901162 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:44:29.901162 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:44:29.901162 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:44:29.901162 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:44:29.901162 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:44:29.901162 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:44:29.901162 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:44:29.901162 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:44:29.901162 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 417/835] 10.222.0.72 () {56 vars in 1096 bytes} [Mon Sep 19 14:44:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 400 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:29.910217 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc406e1-87f5-4b37-a16f-30984626462b None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:30.033198 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc406e1-87f5-4b37-a16f-30984626462b None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:30.068487 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44bd302-25c5-4720-a730-9d37be903c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:30.069250 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44bd302-25c5-4720-a730-9d37be903c76 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:30.069535 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44bd302-25c5-4720-a730-9d37be903c76 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:30.069811 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44bd302-25c5-4720-a730-9d37be903c76 None admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:30.070476 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44bd302-25c5-4720-a730-9d37be903c76 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:30.070785 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44bd302-25c5-4720-a730-9d37be903c76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:30.072161 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44bd302-25c5-4720-a730-9d37be903c76 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:30.073593 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:30.089071 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fe6f40-cc6b-4f3e-b899-fdfc9ec050c0 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:30.089656 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 419/836] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Sep 19 14:44:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:30.158053 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:30.206462 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fe6f40-cc6b-4f3e-b899-fdfc9ec050c0 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:30.247404 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b567b6-8455-4e0c-b6fc-d19d74e60977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:30.248096 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b567b6-8455-4e0c-b6fc-d19d74e60977 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:30.248348 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b567b6-8455-4e0c-b6fc-d19d74e60977 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:30.248628 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b567b6-8455-4e0c-b6fc-d19d74e60977 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:30.261860 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b567b6-8455-4e0c-b6fc-d19d74e60977 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:30.263323 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b567b6-8455-4e0c-b6fc-d19d74e60977 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:30.279768 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-37b567b6-8455-4e0c-b6fc-d19d74e60977 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:44:30.279768 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:30.279768 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:30.279768 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:30.279768 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:30.279768 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:30.279768 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:30.279768 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:30.279768 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:30.279768 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:30.279768 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:30.279768 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:30.279768 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:44:30.279768 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:44:30.279768 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:44:30.279768 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:44:30.280782 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:30.280782 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:30.280782 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:30.280782 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:30.280782 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:30.280782 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:30.280782 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:30.280782 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:30.280782 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:30.280782 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:30.280782 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:30.280782 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:30.280782 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:30.280782 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:30.280782 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:30.280782 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:30.280782 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:44:30.281654 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:44:30.281654 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:44:30.281654 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:44:30.281654 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 418/837] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:44:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:30.287178 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44bd302-25c5-4720-a730-9d37be903c76 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:30.394616 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44bd302-25c5-4720-a730-9d37be903c76 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:30.428609 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a49c89-36da-4d3a-a1ff-7782200f0e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:30.429213 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a49c89-36da-4d3a-a1ff-7782200f0e77 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:30.429489 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a49c89-36da-4d3a-a1ff-7782200f0e77 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:30.429757 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a49c89-36da-4d3a-a1ff-7782200f0e77 None admin] PATH_INFO: `/v3/domains` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:30.430391 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a49c89-36da-4d3a-a1ff-7782200f0e77 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:30.430687 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a49c89-36da-4d3a-a1ff-7782200f0e77 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:30.432039 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a49c89-36da-4d3a-a1ff-7782200f0e77 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:30.444344 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 420/838] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Sep 19 14:44:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:30.449837 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b567b6-8455-4e0c-b6fc-d19d74e60977 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:30.553004 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b567b6-8455-4e0c-b6fc-d19d74e60977 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:30.564813 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:30.591730 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e05f6aa-3e6c-468f-8eef-b06276715cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:30.592384 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e05f6aa-3e6c-468f-8eef-b06276715cc3 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:30.592670 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e05f6aa-3e6c-468f-8eef-b06276715cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:30.592944 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e05f6aa-3e6c-468f-8eef-b06276715cc3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:30.600844 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e05f6aa-3e6c-468f-8eef-b06276715cc3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:30.602280 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e05f6aa-3e6c-468f-8eef-b06276715cc3 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:30.613904 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-0e05f6aa-3e6c-468f-8eef-b06276715cc3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 19 14:44:30.613904 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:30.613904 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:30.613904 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:30.613904 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:30.613904 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:30.613904 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:30.613904 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:30.613904 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:30.613904 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:30.613904 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:30.613904 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:30.613904 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 14:44:30.613904 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 14:44:30.613904 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 14:44:30.613904 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 14:44:30.614841 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:30.614841 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:30.614841 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:44:30.614841 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:44:30.614841 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:44:30.614841 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:44:30.614841 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:30.614841 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:30.614841 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:30.614841 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:30.614841 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:30.614841 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:30.614841 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:30.614841 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:30.614841 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:30.614841 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:30.614841 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:30.614841 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:30.615767 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:30.615767 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:30.615767 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 14:44:30.615767 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 14:44:30.615767 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 14:44:30.615767 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 14:44:30.615767 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 14:44:30.615767 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 14:44:30.615767 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 19 14:44:30.615767 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:44:30.615767 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 419/839] 10.222.0.72 () {56 vars in 1096 bytes} [Mon Sep 19 14:44:30 2022] GET /identity/v3/users/swift => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:30.620989 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a49c89-36da-4d3a-a1ff-7782200f0e77 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:30.678113 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:30.724106 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a49c89-36da-4d3a-a1ff-7782200f0e77 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:30.757759 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae9b8ad-0331-44f0-84a9-a17472403dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:30.758368 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae9b8ad-0331-44f0-84a9-a17472403dfd None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:30.758641 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae9b8ad-0331-44f0-84a9-a17472403dfd None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:30.758906 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae9b8ad-0331-44f0-84a9-a17472403dfd None admin] PATH_INFO: `/v3/users` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:30.759634 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae9b8ad-0331-44f0-84a9-a17472403dfd None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:30.759934 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae9b8ad-0331-44f0-84a9-a17472403dfd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:30.761960 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae9b8ad-0331-44f0-84a9-a17472403dfd None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:30.780393 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 421/840] 10.222.0.72 () {56 vars in 1135 bytes} [Mon Sep 19 14:44:30 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:30.786025 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e05f6aa-3e6c-468f-8eef-b06276715cc3 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:30.914456 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e05f6aa-3e6c-468f-8eef-b06276715cc3 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:30.952769 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb416b9-f5d2-4207-8d6f-534de062d251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:30.953438 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb416b9-f5d2-4207-8d6f-534de062d251 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:30.953721 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb416b9-f5d2-4207-8d6f-534de062d251 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:30.954045 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb416b9-f5d2-4207-8d6f-534de062d251 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:30.956833 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e1af29-ea31-43ad-b097-4a72dbad7c70 None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:30.957336 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e1af29-ea31-43ad-b097-4a72dbad7c70 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:30.957634 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e1af29-ea31-43ad-b097-4a72dbad7c70 None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:30.960103 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 422/841] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:44:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:44:30.965653 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aff80e-1f29-428b-bb27-8d376e44b0a9 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:30.966073 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aff80e-1f29-428b-bb27-8d376e44b0a9 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:30.966448 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aff80e-1f29-428b-bb27-8d376e44b0a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:30.984896 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-a0aff80e-1f29-428b-bb27-8d376e44b0a9 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:44:30.986231 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-a0aff80e-1f29-428b-bb27-8d376e44b0a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:44:30.996450 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:31.029697 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb416b9-f5d2-4207-8d6f-534de062d251 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:31.031141 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb416b9-f5d2-4207-8d6f-534de062d251 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:31.068786 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 423/842] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:44:30 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:44:31.141797 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 420/843] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Sep 19 14:44:30 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 14:44:31.147219 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aff80e-1f29-428b-bb27-8d376e44b0a9 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:31.199511 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:31.204297 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0878160b-bc8e-498e-8a53-d1bdf2aa97bd None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:31.204608 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0878160b-bc8e-498e-8a53-d1bdf2aa97bd None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:31.204885 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0878160b-bc8e-498e-8a53-d1bdf2aa97bd None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:31.206365 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 421/844] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:44:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:44:31.211971 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6750439-062a-4e29-b57e-e3ce1636c00a None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:31.212572 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6750439-062a-4e29-b57e-e3ce1636c00a None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:31.213087 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6750439-062a-4e29-b57e-e3ce1636c00a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:31.233437 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-c6750439-062a-4e29-b57e-e3ce1636c00a None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:44:31.234904 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-c6750439-062a-4e29-b57e-e3ce1636c00a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:44:31.263594 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aff80e-1f29-428b-bb27-8d376e44b0a9 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:31.302561 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:31.309230 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59f7b6e-e380-41d1-9199-00b84f495242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:31.309866 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59f7b6e-e380-41d1-9199-00b84f495242 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:31.310325 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59f7b6e-e380-41d1-9199-00b84f495242 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:31.310430 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59f7b6e-e380-41d1-9199-00b84f495242 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:31.310652 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 422/845] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:44:31 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 14:44:31.326033 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59f7b6e-e380-41d1-9199-00b84f495242 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:31.327731 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59f7b6e-e380-41d1-9199-00b84f495242 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:31.343023 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-a59f7b6e-e380-41d1-9199-00b84f495242 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:44:31.343023 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:31.343023 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:31.343023 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:31.343023 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:31.343023 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:31.343023 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:31.343023 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:31.343023 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:31.343023 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:31.343023 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:31.343023 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:31.343023 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:44:31.343023 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:44:31.343023 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:44:31.343023 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:44:31.343971 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:31.343971 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:31.343971 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:31.343971 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:31.343971 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:31.343971 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:31.343971 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:31.343971 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:31.343971 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:31.343971 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:31.343971 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:31.343971 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:31.343971 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:31.343971 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:31.343971 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:31.343971 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:31.343971 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:44:31.344875 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:44:31.344875 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:44:31.344875 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:44:31.346930 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 424/846] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:44:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:31.353680 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6750439-062a-4e29-b57e-e3ce1636c00a None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:31.354065 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59f7b6e-e380-41d1-9199-00b84f495242 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:31.467171 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:31.472735 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6750439-062a-4e29-b57e-e3ce1636c00a None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:31.474754 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59f7b6e-e380-41d1-9199-00b84f495242 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:31.517349 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42c438e-3117-4421-a6d3-67980602f485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:31.518252 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c438e-3117-4421-a6d3-67980602f485 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:31.518595 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9cebe3-2de6-4bd8-b982-e38a57c93312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:31.518916 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c438e-3117-4421-a6d3-67980602f485 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:31.519331 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c438e-3117-4421-a6d3-67980602f485 None admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:31.519495 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9cebe3-2de6-4bd8-b982-e38a57c93312 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:31.519864 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9cebe3-2de6-4bd8-b982-e38a57c93312 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:31.520226 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9cebe3-2de6-4bd8-b982-e38a57c93312 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:31.520596 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42c438e-3117-4421-a6d3-67980602f485 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:31.521001 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9cebe3-2de6-4bd8-b982-e38a57c93312 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:31.521212 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42c438e-3117-4421-a6d3-67980602f485 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:31.522532 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9cebe3-2de6-4bd8-b982-e38a57c93312 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:31.522907 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42c438e-3117-4421-a6d3-67980602f485 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:31.532893 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-1a9cebe3-2de6-4bd8-b982-e38a57c93312 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 19 14:44:31.532893 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:31.532893 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 14:44:31.532893 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 14:44:31.532893 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 14:44:31.532893 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 14:44:31.532893 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 14:44:31.532893 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:44:31.532893 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 19 14:44:31.532893 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:44:31.532893 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 14:44:31.532893 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:44:31.532893 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:31.532893 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:31.532893 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:31.532893 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:31.532893 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:31.533930 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:31.533930 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:31.533930 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:31.533930 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:31.533930 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:31.533930 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:31.533930 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 14:44:31.533930 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 14:44:31.533930 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 14:44:31.533930 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 14:44:31.533930 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:31.533930 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:31.533930 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:31.533930 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:31.533930 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:31.533930 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:31.534772 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:31.534772 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:31.534772 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:31.534772 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:31.534772 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:31.534772 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:31.534772 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:31.534772 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:31.534772 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:31.534772 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:31.534772 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 14:44:31.534772 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:44:31.534772 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 19 14:44:31.534772 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:44:31.538877 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 425/847] 10.222.0.72 () {56 vars in 1114 bytes} [Mon Sep 19 14:44:31 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:44:31.544395 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9cebe3-2de6-4bd8-b982-e38a57c93312 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:31.544552 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 423/848] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Sep 19 14:44:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:31.546517 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42c438e-3117-4421-a6d3-67980602f485 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:31.618679 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:31.649770 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9cebe3-2de6-4bd8-b982-e38a57c93312 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:31.663469 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42c438e-3117-4421-a6d3-67980602f485 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:31.686116 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0b7a83-0aff-4140-92b3-72aac0c16c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:31.687088 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0b7a83-0aff-4140-92b3-72aac0c16c82 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:31.687553 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0b7a83-0aff-4140-92b3-72aac0c16c82 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:31.688032 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0b7a83-0aff-4140-92b3-72aac0c16c82 None admin] PATH_INFO: `/v3/services` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:31.688828 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0b7a83-0aff-4140-92b3-72aac0c16c82 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:31.689293 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0b7a83-0aff-4140-92b3-72aac0c16c82 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:31.691039 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0b7a83-0aff-4140-92b3-72aac0c16c82 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:31.696263 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 426/849] 10.222.0.72 () {56 vars in 1114 bytes} [Mon Sep 19 14:44:31 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:44:31.697219 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0b7a83-0aff-4140-92b3-72aac0c16c82 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:31.702298 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07634545-6ca8-4cd9-8264-867a8cd8ce91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:31.702966 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07634545-6ca8-4cd9-8264-867a8cd8ce91 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:31.703242 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07634545-6ca8-4cd9-8264-867a8cd8ce91 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:31.703511 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07634545-6ca8-4cd9-8264-867a8cd8ce91 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:31.710342 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07634545-6ca8-4cd9-8264-867a8cd8ce91 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:31.711761 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07634545-6ca8-4cd9-8264-867a8cd8ce91 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:31.723527 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-07634545-6ca8-4cd9-8264-867a8cd8ce91 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:44:31.723527 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:31.723527 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:31.723527 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:31.723527 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:31.723527 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:31.723527 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:31.723527 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:31.723527 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:31.723527 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:31.723527 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:31.723527 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:31.723527 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 14:44:31.723527 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 14:44:31.723527 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 14:44:31.724633 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 14:44:31.724633 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:31.724633 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:31.724633 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:31.724633 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:31.724633 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:31.724633 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:31.724633 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:31.724633 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:31.724633 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:31.724633 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:31.724633 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:31.724633 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:31.724633 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:31.724633 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:31.724633 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:31.724633 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:31.725531 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 14:44:31.725531 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 14:44:31.725531 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:44:31.725531 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:44:31.725531 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:44:31.725531 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:44:31.725531 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:44:31.725531 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:44:31.725531 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 424/850] 10.222.0.72 () {56 vars in 1111 bytes} [Mon Sep 19 14:44:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:31.726004 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07634545-6ca8-4cd9-8264-867a8cd8ce91 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:31.733632 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:31.813941 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0b7a83-0aff-4140-92b3-72aac0c16c82 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:31.835572 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07634545-6ca8-4cd9-8264-867a8cd8ce91 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:31.852793 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d80e2fd-a82a-4e46-a767-5c782c9559e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:31.853436 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d80e2fd-a82a-4e46-a767-5c782c9559e0 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:31.853720 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d80e2fd-a82a-4e46-a767-5c782c9559e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:31.853995 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d80e2fd-a82a-4e46-a767-5c782c9559e0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:31.858352 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:31.866626 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d80e2fd-a82a-4e46-a767-5c782c9559e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:44:31.872920 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98de8b9-d967-41a7-b027-3f84f7562430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:31.873139 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-3d80e2fd-a82a-4e46-a767-5c782c9559e0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:44:31.873139 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:31.873139 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:31.873139 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:31.873139 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:31.873139 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:31.873139 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:31.873139 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:31.873139 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:31.873139 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:31.873139 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:31.873139 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:31.873139 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:44:31.873139 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:44:31.873139 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:44:31.873139 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:44:31.874007 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:44:31.874007 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:44:31.874007 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:44:31.874007 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:44:31.874007 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:31.874007 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:31.874007 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:31.874007 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:31.874007 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:31.874007 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:31.874007 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:31.874007 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:31.874007 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:31.874007 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:31.874007 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:31.874007 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:31.875410 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:31.875410 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:31.875410 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:31.875410 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:31.875410 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:44:31.875410 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:44:31.875410 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:44:31.875410 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:44:31.875410 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:44:31.875410 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:44:31.875410 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:44:31.875410 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:44:31.876033 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98de8b9-d967-41a7-b027-3f84f7562430 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:31.876033 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98de8b9-d967-41a7-b027-3f84f7562430 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:31.876033 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98de8b9-d967-41a7-b027-3f84f7562430 None admin] PATH_INFO: `/v3/services` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:31.876231 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 427/851] 10.222.0.72 () {56 vars in 1102 bytes} [Mon Sep 19 14:44:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:31.876231 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d80e2fd-a82a-4e46-a767-5c782c9559e0 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:31.876867 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98de8b9-d967-41a7-b027-3f84f7562430 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:31.877188 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98de8b9-d967-41a7-b027-3f84f7562430 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:31.878563 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98de8b9-d967-41a7-b027-3f84f7562430 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:31.883966 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 425/852] 10.222.0.72 () {56 vars in 1114 bytes} [Mon Sep 19 14:44:31 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:31.885123 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98de8b9-d967-41a7-b027-3f84f7562430 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:32.004470 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:32.031429 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d80e2fd-a82a-4e46-a767-5c782c9559e0 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:32.045383 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98de8b9-d967-41a7-b027-3f84f7562430 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:32.073423 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaa74cc-9742-40c7-b11c-4619aa626178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:32.075013 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa74cc-9742-40c7-b11c-4619aa626178 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:32.075539 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa74cc-9742-40c7-b11c-4619aa626178 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:32.075948 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa74cc-9742-40c7-b11c-4619aa626178 None admin] PATH_INFO: `/v3/projects` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:32.076851 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaa74cc-9742-40c7-b11c-4619aa626178 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:32.077306 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaa74cc-9742-40c7-b11c-4619aa626178 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:32.079576 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaa74cc-9742-40c7-b11c-4619aa626178 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:32.085246 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a390c14-dde1-464f-980d-5bb71b5e1a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:32.086002 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a390c14-dde1-464f-980d-5bb71b5e1a38 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:32.086285 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a390c14-dde1-464f-980d-5bb71b5e1a38 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:32.086557 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a390c14-dde1-464f-980d-5bb71b5e1a38 None admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:32.087261 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a390c14-dde1-464f-980d-5bb71b5e1a38 None admin] RBAC: Adding query filter params (name=service) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:32.087564 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a390c14-dde1-464f-980d-5bb71b5e1a38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:32.088960 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a390c14-dde1-464f-980d-5bb71b5e1a38 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:32.094720 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 428/853] 10.222.0.72 () {56 vars in 1148 bytes} [Mon Sep 19 14:44:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:32.099565 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 426/854] 10.222.0.72 () {56 vars in 1103 bytes} [Mon Sep 19 14:44:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:32.102688 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaa74cc-9742-40c7-b11c-4619aa626178 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:32.106087 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a390c14-dde1-464f-980d-5bb71b5e1a38 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:32.171523 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:32.233784 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a390c14-dde1-464f-980d-5bb71b5e1a38 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:32.235802 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaa74cc-9742-40c7-b11c-4619aa626178 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:32.272600 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978071b4-a399-4f1e-8f48-c254402930d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:32.273152 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978071b4-a399-4f1e-8f48-c254402930d8 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:32.273427 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978071b4-a399-4f1e-8f48-c254402930d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:32.273699 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978071b4-a399-4f1e-8f48-c254402930d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:32.279286 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12720142-e79a-4225-9e1b-7f050918c35b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:32.280048 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12720142-e79a-4225-9e1b-7f050918c35b None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:32.280360 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12720142-e79a-4225-9e1b-7f050918c35b None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:32.280628 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12720142-e79a-4225-9e1b-7f050918c35b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:32.281351 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12720142-e79a-4225-9e1b-7f050918c35b None admin] RBAC: Adding query filter params (role.id=ddb643577b2e4e478100ec370decfaeb, scope.project.id=51af3a14d665498c9b7a35b34dac0ef1, user.id=8504425c3a414608b030d0cf1af78af5) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:32.281657 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12720142-e79a-4225-9e1b-7f050918c35b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:32.283099 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12720142-e79a-4225-9e1b-7f050918c35b None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:32.285525 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978071b4-a399-4f1e-8f48-c254402930d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:32.287062 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978071b4-a399-4f1e-8f48-c254402930d8 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:32.292486 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 429/855] 10.222.0.72 () {56 vars in 1374 bytes} [Mon Sep 19 14:44:32 2022] GET /identity/v3/role_assignments?user.id=8504425c3a414608b030d0cf1af78af5&scope.project.id=51af3a14d665498c9b7a35b34dac0ef1&role.id=ddb643577b2e4e478100ec370decfaeb => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:32.293868 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f2cb7a-04e2-4299-a019-2f34e86b6063 None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:32.294155 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f2cb7a-04e2-4299-a019-2f34e86b6063 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:32.294437 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f2cb7a-04e2-4299-a019-2f34e86b6063 None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:32.295997 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 430/856] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:44:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:44:32.301757 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10075e4-9151-4a1d-9371-6cfffa28b2c2 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:32.302112 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10075e4-9151-4a1d-9371-6cfffa28b2c2 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:32.302457 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10075e4-9151-4a1d-9371-6cfffa28b2c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:32.311477 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-978071b4-a399-4f1e-8f48-c254402930d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:44:32.311477 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:32.311477 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:32.311477 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:32.311477 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:32.311477 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:32.311477 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:32.311477 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:32.311477 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:32.311477 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:32.311477 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:32.311477 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:32.311477 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:44:32.311477 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:44:32.311477 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:44:32.311477 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:44:32.313190 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:32.313190 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:32.313190 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:32.313190 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:32.313190 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:32.313190 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:32.313190 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:32.313190 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:32.313190 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:32.313190 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:32.313190 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:32.313190 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:32.313190 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:32.313190 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:32.313190 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:32.313190 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:32.313190 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:44:32.314259 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:44:32.314259 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:44:32.314259 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:44:32.320482 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 427/857] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:44:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:32.324732 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978071b4-a399-4f1e-8f48-c254402930d8 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:32.324972 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-c10075e4-9151-4a1d-9371-6cfffa28b2c2 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:44:32.326449 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-c10075e4-9151-4a1d-9371-6cfffa28b2c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:44:32.328920 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:32.416561 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 431/858] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:44:32 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 14:44:32.448764 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:32.454799 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978071b4-a399-4f1e-8f48-c254402930d8 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:32.496653 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039ec3de-7932-4edc-be63-df26a7f2044c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:32.497262 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039ec3de-7932-4edc-be63-df26a7f2044c None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:32.497536 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039ec3de-7932-4edc-be63-df26a7f2044c None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:32.497806 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039ec3de-7932-4edc-be63-df26a7f2044c None admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:32.498449 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039ec3de-7932-4edc-be63-df26a7f2044c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:32.498747 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039ec3de-7932-4edc-be63-df26a7f2044c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:32.500107 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039ec3de-7932-4edc-be63-df26a7f2044c None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:32.513275 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 428/859] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Sep 19 14:44:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:44:32.518835 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10075e4-9151-4a1d-9371-6cfffa28b2c2 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:32.625019 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10075e4-9151-4a1d-9371-6cfffa28b2c2 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:32.660059 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eb3f72-1316-434b-8d24-a7eeeee9de55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:32.660721 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb3f72-1316-434b-8d24-a7eeeee9de55 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:32.661000 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb3f72-1316-434b-8d24-a7eeeee9de55 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:32.661271 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb3f72-1316-434b-8d24-a7eeeee9de55 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:32.669159 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eb3f72-1316-434b-8d24-a7eeeee9de55 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:32.670612 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eb3f72-1316-434b-8d24-a7eeeee9de55 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:32.672480 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:32.683866 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-87eb3f72-1316-434b-8d24-a7eeeee9de55 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 14:44:32.683866 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:32.683866 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:32.683866 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:32.683866 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:32.683866 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:32.683866 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:32.683866 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:32.683866 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:32.683866 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:32.683866 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:32.683866 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:32.683866 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 14:44:32.683866 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 14:44:32.683866 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 14:44:32.683866 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 14:44:32.685039 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:32.685039 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:32.685039 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:44:32.685039 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:44:32.685039 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:44:32.685039 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:44:32.685039 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:32.685039 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:32.685039 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:32.685039 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:32.685039 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:32.685039 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:32.685039 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:32.685039 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:32.685039 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:32.685039 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:32.685039 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:32.685039 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:32.685988 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:32.685988 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:32.685988 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 14:44:32.685988 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 14:44:32.685988 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 14:44:32.685988 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 14:44:32.685988 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 14:44:32.685988 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 14:44:32.685988 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 14:44:32.685988 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:44:32.686507 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039ec3de-7932-4edc-be63-df26a7f2044c None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:32.686581 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 432/860] 10.222.0.72 () {56 vars in 1117 bytes} [Mon Sep 19 14:44:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:32.691135 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eb3f72-1316-434b-8d24-a7eeeee9de55 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:32.793250 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039ec3de-7932-4edc-be63-df26a7f2044c None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:32.815841 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eb3f72-1316-434b-8d24-a7eeeee9de55 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:32.828259 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b020ea9-0aab-46f6-8821-366442fdd0b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:32.828952 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b020ea9-0aab-46f6-8821-366442fdd0b5 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:32.829239 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b020ea9-0aab-46f6-8821-366442fdd0b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:32.829521 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b020ea9-0aab-46f6-8821-366442fdd0b5 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:32.830127 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b020ea9-0aab-46f6-8821-366442fdd0b5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:32.831741 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b020ea9-0aab-46f6-8821-366442fdd0b5 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:32.842312 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-4b020ea9-0aab-46f6-8821-366442fdd0b5 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 19 14:44:32.842312 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:32.842312 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 14:44:32.842312 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 14:44:32.842312 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 14:44:32.842312 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 14:44:32.842312 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 14:44:32.842312 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:44:32.842312 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 19 14:44:32.842312 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:44:32.842312 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 14:44:32.842312 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:44:32.842312 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:32.842312 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:32.842312 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:32.842312 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:32.843400 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:32.843400 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:32.843400 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:32.843400 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:32.843400 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:32.843400 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:32.843400 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:32.843400 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 14:44:32.843400 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 14:44:32.843400 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 14:44:32.843400 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 14:44:32.843400 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:32.843400 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:32.843400 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:32.843400 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:32.843400 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:32.843400 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:32.844309 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:32.844309 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:32.844309 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:32.844309 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:32.844309 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:32.844309 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:32.844309 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:32.844309 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:32.844309 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:32.844309 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:32.844309 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 14:44:32.844309 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:44:32.844309 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 19 14:44:32.844309 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:44:32.848569 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 429/861] 10.222.0.72 () {56 vars in 1132 bytes} [Mon Sep 19 14:44:32 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:44:32.849518 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b020ea9-0aab-46f6-8821-366442fdd0b5 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:32.860255 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bfdcd1-ad82-4c5f-8cd2-5f1867145ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:32.861255 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bfdcd1-ad82-4c5f-8cd2-5f1867145ae8 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:32.861537 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bfdcd1-ad82-4c5f-8cd2-5f1867145ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:32.861817 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bfdcd1-ad82-4c5f-8cd2-5f1867145ae8 None admin] PATH_INFO: `/v3/users` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:32.863153 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bfdcd1-ad82-4c5f-8cd2-5f1867145ae8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:32.863469 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bfdcd1-ad82-4c5f-8cd2-5f1867145ae8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:32.865102 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bfdcd1-ad82-4c5f-8cd2-5f1867145ae8 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:32.889515 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 433/862] 10.222.0.72 () {56 vars in 1149 bytes} [Mon Sep 19 14:44:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:32.895438 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bfdcd1-ad82-4c5f-8cd2-5f1867145ae8 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:32.895955 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:32.969108 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:32.979005 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b020ea9-0aab-46f6-8821-366442fdd0b5 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:33.026558 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bfdcd1-ad82-4c5f-8cd2-5f1867145ae8 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:33.029719 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e98ec7-6bcb-4467-a4ec-5d03ced46dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:33.030560 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e98ec7-6bcb-4467-a4ec-5d03ced46dc8 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:33.031087 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e98ec7-6bcb-4467-a4ec-5d03ced46dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:33.031598 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e98ec7-6bcb-4467-a4ec-5d03ced46dc8 None admin] PATH_INFO: `/v3/services` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:33.032511 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e98ec7-6bcb-4467-a4ec-5d03ced46dc8 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:33.033047 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e98ec7-6bcb-4467-a4ec-5d03ced46dc8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:33.034617 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e98ec7-6bcb-4467-a4ec-5d03ced46dc8 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:33.044607 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 430/863] 10.222.0.72 () {56 vars in 1126 bytes} [Mon Sep 19 14:44:32 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:33.045746 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e98ec7-6bcb-4467-a4ec-5d03ced46dc8 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:33.066371 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353673a4-9084-4994-8179-a395db1343f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:33.066988 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353673a4-9084-4994-8179-a395db1343f1 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:33.067271 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353673a4-9084-4994-8179-a395db1343f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:33.067547 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353673a4-9084-4994-8179-a395db1343f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:33.139883 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:33.147211 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353673a4-9084-4994-8179-a395db1343f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:33.149226 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353673a4-9084-4994-8179-a395db1343f1 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:33.158298 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e98ec7-6bcb-4467-a4ec-5d03ced46dc8 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:33.194660 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cce2a0-8b50-450a-bfcb-34a9dd947652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:33.196064 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cce2a0-8b50-450a-bfcb-34a9dd947652 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:33.196619 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cce2a0-8b50-450a-bfcb-34a9dd947652 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:33.197096 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cce2a0-8b50-450a-bfcb-34a9dd947652 None admin] PATH_INFO: `/v3/services` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:33.197920 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cce2a0-8b50-450a-bfcb-34a9dd947652 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:33.198422 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cce2a0-8b50-450a-bfcb-34a9dd947652 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:33.200811 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cce2a0-8b50-450a-bfcb-34a9dd947652 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:33.211012 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 431/864] 10.222.0.72 () {56 vars in 1126 bytes} [Mon Sep 19 14:44:33 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:33.222145 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:33.264556 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 434/865] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Sep 19 14:44:32 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 19 14:44:33.269454 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cce2a0-8b50-450a-bfcb-34a9dd947652 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:33.388788 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cce2a0-8b50-450a-bfcb-34a9dd947652 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:33.424358 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897ecb93-99a3-471d-a1cf-bd336ce944b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:33.424899 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897ecb93-99a3-471d-a1cf-bd336ce944b4 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:33.425173 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897ecb93-99a3-471d-a1cf-bd336ce944b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:33.425439 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897ecb93-99a3-471d-a1cf-bd336ce944b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:33.436517 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897ecb93-99a3-471d-a1cf-bd336ce944b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:33.437939 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897ecb93-99a3-471d-a1cf-bd336ce944b4 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:33.452053 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-897ecb93-99a3-471d-a1cf-bd336ce944b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:44:33.452053 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:33.452053 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:33.452053 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:33.452053 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:33.452053 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:33.452053 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:33.452053 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:33.452053 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:33.452053 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:33.452053 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:33.452053 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:33.452053 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:44:33.452053 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:44:33.452053 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:44:33.452053 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:44:33.453048 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:33.453048 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:33.453048 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:33.453048 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:33.453048 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:33.453048 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:33.453048 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:33.453048 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:33.453048 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:33.453048 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:33.453048 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:33.453048 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:33.453048 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:33.453048 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:33.453048 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:33.453048 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:33.453048 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:44:33.453957 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:44:33.453957 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:44:33.453957 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:44:33.453957 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 432/866] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:44:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:33.459075 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353673a4-9084-4994-8179-a395db1343f1 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:33.561133 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353673a4-9084-4994-8179-a395db1343f1 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:33.595373 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604fbe1d-f79b-4de0-b4a5-b5f4ee318e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:33.595980 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604fbe1d-f79b-4de0-b4a5-b5f4ee318e31 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:33.596259 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604fbe1d-f79b-4de0-b4a5-b5f4ee318e31 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:33.596565 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604fbe1d-f79b-4de0-b4a5-b5f4ee318e31 None admin] PATH_INFO: `/v3/domains` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:33.597208 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604fbe1d-f79b-4de0-b4a5-b5f4ee318e31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:33.597506 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604fbe1d-f79b-4de0-b4a5-b5f4ee318e31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:33.598853 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604fbe1d-f79b-4de0-b4a5-b5f4ee318e31 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:33.611374 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 435/867] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Sep 19 14:44:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:33.618351 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897ecb93-99a3-471d-a1cf-bd336ce944b4 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:33.624365 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:33.725220 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897ecb93-99a3-471d-a1cf-bd336ce944b4 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:33.760585 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6f276c-843c-4f25-bc34-66972d703b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:33.761818 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6f276c-843c-4f25-bc34-66972d703b66 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:33.762064 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6f276c-843c-4f25-bc34-66972d703b66 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:33.762329 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6f276c-843c-4f25-bc34-66972d703b66 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:33.769081 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6f276c-843c-4f25-bc34-66972d703b66 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:33.770514 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6f276c-843c-4f25-bc34-66972d703b66 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:33.782358 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-7a6f276c-843c-4f25-bc34-66972d703b66 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:44:33.782358 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:33.782358 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:33.782358 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:33.782358 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:33.782358 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:33.782358 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:33.782358 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:33.782358 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:33.782358 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:33.782358 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:33.782358 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:33.782358 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 14:44:33.782358 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 14:44:33.782358 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 14:44:33.783282 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 14:44:33.783282 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:33.783282 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:33.783282 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:33.783282 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:33.783282 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:33.783282 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:33.783282 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:33.783282 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:33.783282 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:33.783282 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:33.783282 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:33.783282 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:33.783282 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:33.783282 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:33.783282 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:33.783282 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:33.784193 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 14:44:33.784193 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 14:44:33.784193 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:44:33.784193 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:44:33.784193 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:44:33.784193 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:44:33.784193 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:44:33.784193 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:44:33.784193 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 433/868] 10.222.0.72 () {56 vars in 1111 bytes} [Mon Sep 19 14:44:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:33.789362 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604fbe1d-f79b-4de0-b4a5-b5f4ee318e31 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:33.820761 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:33.893780 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604fbe1d-f79b-4de0-b4a5-b5f4ee318e31 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:33.929640 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758e142e-6b65-4914-829f-f6dc09984667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:33.930245 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e142e-6b65-4914-829f-f6dc09984667 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:33.930548 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e142e-6b65-4914-829f-f6dc09984667 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:33.930801 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e142e-6b65-4914-829f-f6dc09984667 None admin] PATH_INFO: `/v3/projects` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:33.931446 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758e142e-6b65-4914-829f-f6dc09984667 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:33.931745 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758e142e-6b65-4914-829f-f6dc09984667 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:33.933692 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758e142e-6b65-4914-829f-f6dc09984667 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:33.945955 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 436/869] 10.222.0.72 () {56 vars in 1148 bytes} [Mon Sep 19 14:44:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:44:33.951954 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6f276c-843c-4f25-bc34-66972d703b66 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:34.024796 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:34.070988 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6f276c-843c-4f25-bc34-66972d703b66 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:34.108582 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88432d98-23e3-477f-99b1-71468c175448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:34.109182 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88432d98-23e3-477f-99b1-71468c175448 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:34.109454 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88432d98-23e3-477f-99b1-71468c175448 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:34.109719 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88432d98-23e3-477f-99b1-71468c175448 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:34.110428 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88432d98-23e3-477f-99b1-71468c175448 None admin] RBAC: Adding query filter params (role.id=537cde5f25284acca3c3ea9ff806d724, scope.project.id=51af3a14d665498c9b7a35b34dac0ef1, user.id=afbbbf11f3234297ab1dd509f064480f) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:34.110725 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88432d98-23e3-477f-99b1-71468c175448 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:34.112134 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88432d98-23e3-477f-99b1-71468c175448 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:34.118371 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 434/870] 10.222.0.72 () {56 vars in 1374 bytes} [Mon Sep 19 14:44:33 2022] GET /identity/v3/role_assignments?user.id=afbbbf11f3234297ab1dd509f064480f&scope.project.id=51af3a14d665498c9b7a35b34dac0ef1&role.id=537cde5f25284acca3c3ea9ff806d724 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:44:34.185655 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f8fda3-7076-4556-985c-d9acfb39aeb6 None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:34.185989 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f8fda3-7076-4556-985c-d9acfb39aeb6 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:34.186214 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f8fda3-7076-4556-985c-d9acfb39aeb6 None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:34.187896 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 437/871] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:44:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:44:34.193709 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ea120e-396c-44ac-889d-d770047ac621 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:34.194016 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ea120e-396c-44ac-889d-d770047ac621 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:34.194268 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ea120e-396c-44ac-889d-d770047ac621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:34.214762 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-01ea120e-396c-44ac-889d-d770047ac621 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:44:34.216446 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-01ea120e-396c-44ac-889d-d770047ac621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:44:34.297853 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 435/872] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:44:34 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:44:34.574547 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f8fda3-7076-4556-985c-d9acfb39aeb6 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:34.645212 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5389812-678c-4a16-882c-52529ba96a66 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:34.645573 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5389812-678c-4a16-882c-52529ba96a66 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:34.645750 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5389812-678c-4a16-882c-52529ba96a66 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:34.647322 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 436/873] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:44:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:44:34.653089 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8adfb92-1b07-412b-ae32-2c56f453a6d6 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:34.653370 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8adfb92-1b07-412b-ae32-2c56f453a6d6 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:34.653639 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8adfb92-1b07-412b-ae32-2c56f453a6d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:34.658351 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:34.680615 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-a8adfb92-1b07-412b-ae32-2c56f453a6d6 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:44:34.682499 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-a8adfb92-1b07-412b-ae32-2c56f453a6d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:44:34.688491 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f8fda3-7076-4556-985c-d9acfb39aeb6 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:34.726298 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad1c0d9-3499-46ed-8b71-8a56e4984bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:34.726911 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad1c0d9-3499-46ed-8b71-8a56e4984bd1 None admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:34.727201 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad1c0d9-3499-46ed-8b71-8a56e4984bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:34.727572 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad1c0d9-3499-46ed-8b71-8a56e4984bd1 None admin] PATH_INFO: `/v3/services` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:34.728235 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad1c0d9-3499-46ed-8b71-8a56e4984bd1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:34.729821 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad1c0d9-3499-46ed-8b71-8a56e4984bd1 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:34.752422 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 438/874] 10.222.0.72 () {60 vars in 1141 bytes} [Mon Sep 19 14:44:34 2022] POST /identity/v3/services => generated 251 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:44:34.757383 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:34.788154 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 437/875] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:44:34 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 14:44:35.071625 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad1c0d9-3499-46ed-8b71-8a56e4984bd1 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:35.181638 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad1c0d9-3499-46ed-8b71-8a56e4984bd1 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:35.217857 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90203b72-2955-4687-97ee-439e9d487116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:35.218500 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90203b72-2955-4687-97ee-439e9d487116 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:35.221764 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90203b72-2955-4687-97ee-439e9d487116 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:35.221764 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90203b72-2955-4687-97ee-439e9d487116 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:35.221764 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90203b72-2955-4687-97ee-439e9d487116 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:35.221764 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90203b72-2955-4687-97ee-439e9d487116 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:35.223796 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:35.233862 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-90203b72-2955-4687-97ee-439e9d487116 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 14:44:35.233862 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:35.233862 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 14:44:35.233862 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 14:44:35.233862 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 14:44:35.233862 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 14:44:35.233862 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 14:44:35.233862 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:44:35.233862 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 14:44:35.233862 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:44:35.233862 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 14:44:35.233862 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:44:35.233862 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:35.233862 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:35.233862 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:35.233862 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:35.233862 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:35.236710 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:35.236710 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:35.236710 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:35.236710 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:35.236710 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:35.236710 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:35.236710 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 14:44:35.236710 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 14:44:35.236710 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 14:44:35.236710 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 14:44:35.236710 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:35.236710 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:35.236710 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:35.236710 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:35.236710 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:35.236710 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:35.238777 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:35.238777 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:35.238777 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:35.238777 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:35.238777 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:35.238777 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:35.238777 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:35.238777 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:35.238777 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:35.238777 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:35.238777 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 14:44:35.238777 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:44:35.238777 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 14:44:35.238777 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:44:35.238777 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 439/876] 10.222.0.72 () {56 vars in 1126 bytes} [Mon Sep 19 14:44:35 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:35.244426 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8adfb92-1b07-412b-ae32-2c56f453a6d6 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:35.347322 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8adfb92-1b07-412b-ae32-2c56f453a6d6 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:35.382924 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb0e59a-88a2-4082-a8c6-32b43d39875c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:35.383536 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb0e59a-88a2-4082-a8c6-32b43d39875c None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:35.383815 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb0e59a-88a2-4082-a8c6-32b43d39875c None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:35.384085 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb0e59a-88a2-4082-a8c6-32b43d39875c None admin] PATH_INFO: `/v3/services` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:35.384758 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb0e59a-88a2-4082-a8c6-32b43d39875c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:35.385042 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb0e59a-88a2-4082-a8c6-32b43d39875c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:35.386565 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb0e59a-88a2-4082-a8c6-32b43d39875c None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:35.391636 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 438/877] 10.222.0.72 () {56 vars in 1122 bytes} [Mon Sep 19 14:44:35 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:35.397242 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90203b72-2955-4687-97ee-439e9d487116 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:35.510341 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90203b72-2955-4687-97ee-439e9d487116 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:35.548361 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365b9467-2f27-4364-80c1-ee7128947420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:35.548985 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365b9467-2f27-4364-80c1-ee7128947420 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:35.549309 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365b9467-2f27-4364-80c1-ee7128947420 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:35.549589 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365b9467-2f27-4364-80c1-ee7128947420 None admin] PATH_INFO: `/v3/services` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:35.550214 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365b9467-2f27-4364-80c1-ee7128947420 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:35.550522 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365b9467-2f27-4364-80c1-ee7128947420 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:35.551882 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365b9467-2f27-4364-80c1-ee7128947420 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:35.556868 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 440/878] 10.222.0.72 () {56 vars in 1122 bytes} [Mon Sep 19 14:44:35 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:35.596479 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b726b3-caa0-4b83-b2dd-2ce0e1132c70 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:35.596479 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b726b3-caa0-4b83-b2dd-2ce0e1132c70 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:35.596479 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b726b3-caa0-4b83-b2dd-2ce0e1132c70 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:35.597405 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 439/879] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:44:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:44:35.603299 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a123203-47ff-4ff9-95b6-9c0c87a243e5 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:35.604235 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a123203-47ff-4ff9-95b6-9c0c87a243e5 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:35.604769 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a123203-47ff-4ff9-95b6-9c0c87a243e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:35.626079 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-2a123203-47ff-4ff9-95b6-9c0c87a243e5 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:44:35.627669 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-2a123203-47ff-4ff9-95b6-9c0c87a243e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:44:35.704568 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:35.716153 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 441/880] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:44:35 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:44:35.999138 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b726b3-caa0-4b83-b2dd-2ce0e1132c70 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:36.053383 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:36.123466 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b726b3-caa0-4b83-b2dd-2ce0e1132c70 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:36.160546 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa740305-5cb8-40b7-a567-210bd30a5d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:36.161484 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa740305-5cb8-40b7-a567-210bd30a5d08 None admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:36.161965 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa740305-5cb8-40b7-a567-210bd30a5d08 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:36.162473 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa740305-5cb8-40b7-a567-210bd30a5d08 None admin] PATH_INFO: `/v3/services` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:36.163329 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa740305-5cb8-40b7-a567-210bd30a5d08 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:36.164910 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa740305-5cb8-40b7-a567-210bd30a5d08 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:36.182715 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 440/881] 10.222.0.72 () {60 vars in 1141 bytes} [Mon Sep 19 14:44:35 2022] POST /identity/v3/services => generated 269 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:44:36.403681 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a05da-c664-4aad-a9a6-2ebbeca05691 None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:36.404073 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a05da-c664-4aad-a9a6-2ebbeca05691 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:36.404261 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a05da-c664-4aad-a9a6-2ebbeca05691 None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:36.405864 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 442/882] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:44:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:44:36.411343 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b6e619-a229-4496-8e04-b9cdc25966e3 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:36.411801 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b6e619-a229-4496-8e04-b9cdc25966e3 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:36.411801 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b6e619-a229-4496-8e04-b9cdc25966e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:36.435262 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-87b6e619-a229-4496-8e04-b9cdc25966e3 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:44:36.436470 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-87b6e619-a229-4496-8e04-b9cdc25966e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:44:36.512649 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 441/883] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:44:36 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:44:36.782186 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32a05da-c664-4aad-a9a6-2ebbeca05691 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:36.896179 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32a05da-c664-4aad-a9a6-2ebbeca05691 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:36.933997 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9315bb7-55e7-4289-90c8-e55c90ea715c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:36.934645 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9315bb7-55e7-4289-90c8-e55c90ea715c None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:36.934925 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9315bb7-55e7-4289-90c8-e55c90ea715c None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:36.935189 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9315bb7-55e7-4289-90c8-e55c90ea715c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:36.946369 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9315bb7-55e7-4289-90c8-e55c90ea715c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:44:36.951887 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-b9315bb7-55e7-4289-90c8-e55c90ea715c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 14:44:36.951887 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:36.951887 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:36.951887 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:36.951887 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:36.951887 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:36.951887 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:36.951887 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:36.951887 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:36.951887 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:36.951887 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:36.951887 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:36.951887 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:44:36.951887 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:44:36.951887 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:44:36.951887 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:44:36.952868 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:44:36.952868 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:44:36.952868 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:44:36.952868 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:44:36.952868 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:36.952868 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:36.952868 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:36.952868 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:36.952868 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:36.952868 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:36.952868 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:36.952868 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:36.952868 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:36.952868 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:36.952868 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:36.952868 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:36.953712 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:36.953712 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:36.953712 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:36.953712 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:36.953712 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:44:36.953712 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:44:36.953712 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:44:36.953712 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:44:36.953712 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:44:36.953712 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:44:36.953712 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 14:44:36.953712 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:44:36.953712 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 443/884] 10.222.0.72 () {56 vars in 1120 bytes} [Mon Sep 19 14:44:36 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:36.961701 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b6e619-a229-4496-8e04-b9cdc25966e3 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:36.968836 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f759449-2586-49b7-8337-8a356a370d88 None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:36.969125 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f759449-2586-49b7-8337-8a356a370d88 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:36.969404 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f759449-2586-49b7-8337-8a356a370d88 None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:36.975934 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 444/885] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:44:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 14:44:36.977462 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c83da5e-47db-4ac7-b7fc-d103d95b8b2a None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:36.977751 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c83da5e-47db-4ac7-b7fc-d103d95b8b2a None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:36.978033 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c83da5e-47db-4ac7-b7fc-d103d95b8b2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:36.993848 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:36.998757 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-5c83da5e-47db-4ac7-b7fc-d103d95b8b2a None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:44:37.000395 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-5c83da5e-47db-4ac7-b7fc-d103d95b8b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:44:37.057978 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:37.078041 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b6e619-a229-4496-8e04-b9cdc25966e3 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:37.078983 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 445/886] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:44:36 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 14:44:37.116120 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1157b5c-6924-4160-8b6d-e17b017947c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:37.117272 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1157b5c-6924-4160-8b6d-e17b017947c6 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:37.117741 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1157b5c-6924-4160-8b6d-e17b017947c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:37.118232 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1157b5c-6924-4160-8b6d-e17b017947c6 None admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:37.119150 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1157b5c-6924-4160-8b6d-e17b017947c6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:37.119644 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1157b5c-6924-4160-8b6d-e17b017947c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:37.121527 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1157b5c-6924-4160-8b6d-e17b017947c6 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:37.131902 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 442/887] 10.222.0.72 () {56 vars in 1115 bytes} [Mon Sep 19 14:44:36 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:37.137865 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c83da5e-47db-4ac7-b7fc-d103d95b8b2a None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:37.237584 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c83da5e-47db-4ac7-b7fc-d103d95b8b2a None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:37.271546 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d690e3b-1b11-42d0-aadb-3d97895c3391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:37.272174 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d690e3b-1b11-42d0-aadb-3d97895c3391 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:37.272506 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d690e3b-1b11-42d0-aadb-3d97895c3391 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:37.272779 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d690e3b-1b11-42d0-aadb-3d97895c3391 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:37.283090 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d690e3b-1b11-42d0-aadb-3d97895c3391 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:37.284718 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d690e3b-1b11-42d0-aadb-3d97895c3391 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:37.300185 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-7d690e3b-1b11-42d0-aadb-3d97895c3391 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:44:37.300185 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:37.300185 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:37.300185 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:37.300185 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:37.300185 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:37.300185 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:37.300185 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:37.300185 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:37.300185 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:37.300185 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:37.300185 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:37.300185 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:44:37.300185 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:44:37.300185 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:44:37.300185 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:44:37.301183 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:37.301183 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:37.301183 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:37.301183 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:37.301183 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:37.301183 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:37.301183 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:37.301183 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:37.301183 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:37.301183 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:37.301183 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:37.301183 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:37.301183 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:37.301183 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:37.301183 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:37.301183 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:37.301183 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:44:37.302077 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:44:37.302077 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:44:37.302077 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:44:37.302077 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 446/888] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:44:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:37.307363 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1157b5c-6924-4160-8b6d-e17b017947c6 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:37.359255 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d690e3b-1b11-42d0-aadb-3d97895c3391 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:37.396917 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:37.406547 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:37.413590 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1157b5c-6924-4160-8b6d-e17b017947c6 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:37.451157 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c575f906-e96b-4560-beae-c1112fe50cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:37.451775 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c575f906-e96b-4560-beae-c1112fe50cc5 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:37.452059 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c575f906-e96b-4560-beae-c1112fe50cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:37.452369 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c575f906-e96b-4560-beae-c1112fe50cc5 None admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:37.453018 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c575f906-e96b-4560-beae-c1112fe50cc5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:37.453324 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c575f906-e96b-4560-beae-c1112fe50cc5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:37.454697 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c575f906-e96b-4560-beae-c1112fe50cc5 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:37.468377 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 443/889] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Sep 19 14:44:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:37.474337 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c575f906-e96b-4560-beae-c1112fe50cc5 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:37.497930 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d690e3b-1b11-42d0-aadb-3d97895c3391 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:37.539029 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0252d6-6cca-4222-b98c-7c23b380e895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:37.540168 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0252d6-6cca-4222-b98c-7c23b380e895 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:37.540769 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0252d6-6cca-4222-b98c-7c23b380e895 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:37.541245 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0252d6-6cca-4222-b98c-7c23b380e895 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:37.542026 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0252d6-6cca-4222-b98c-7c23b380e895 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:37.545266 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0252d6-6cca-4222-b98c-7c23b380e895 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:37.556166 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-3f0252d6-6cca-4222-b98c-7c23b380e895 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 19 14:44:37.556166 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:37.556166 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 14:44:37.556166 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 14:44:37.556166 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 14:44:37.556166 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 14:44:37.556166 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 14:44:37.556166 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:44:37.556166 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 19 14:44:37.556166 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:44:37.556166 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 14:44:37.556166 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:44:37.556166 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:37.556166 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:37.556166 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:37.556166 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:37.556166 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:37.557237 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:37.557237 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:37.557237 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:37.557237 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:37.557237 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:37.557237 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:37.557237 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 14:44:37.557237 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 14:44:37.557237 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 14:44:37.557237 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 14:44:37.557237 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:37.557237 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:37.557237 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:37.557237 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:37.557237 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:37.557237 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:37.558070 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:37.558070 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:37.558070 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:37.558070 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:37.558070 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:37.558070 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:37.558070 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:37.558070 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:37.558070 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:37.558070 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:37.558070 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 14:44:37.558070 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:44:37.558070 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 19 14:44:37.558070 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:44:37.561629 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 447/890] 10.222.0.72 () {56 vars in 1114 bytes} [Mon Sep 19 14:44:37 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:44:37.570890 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0252d6-6cca-4222-b98c-7c23b380e895 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:37.588683 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c575f906-e96b-4560-beae-c1112fe50cc5 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:37.624588 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b345f9-95dd-45a8-beda-e68322dc852c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:37.625294 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b345f9-95dd-45a8-beda-e68322dc852c None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:37.625434 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b345f9-95dd-45a8-beda-e68322dc852c None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:37.625702 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b345f9-95dd-45a8-beda-e68322dc852c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:37.632910 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b345f9-95dd-45a8-beda-e68322dc852c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:37.634374 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b345f9-95dd-45a8-beda-e68322dc852c None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:37.646268 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-22b345f9-95dd-45a8-beda-e68322dc852c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 14:44:37.646268 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:37.646268 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:37.646268 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:37.646268 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:37.646268 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:37.646268 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:37.646268 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:37.646268 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:37.646268 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:37.646268 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:37.646268 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:37.646268 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 14:44:37.646268 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 14:44:37.646268 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 14:44:37.646268 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 14:44:37.647225 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:37.647225 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:37.647225 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:44:37.647225 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:44:37.647225 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:44:37.647225 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:44:37.647225 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:37.647225 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:37.647225 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:37.647225 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:37.647225 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:37.647225 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:37.647225 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:37.647225 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:37.647225 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:37.647225 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:37.647225 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:37.647225 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:37.648172 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:37.648172 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:37.648172 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 14:44:37.648172 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 14:44:37.648172 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 14:44:37.648172 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 14:44:37.648172 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 14:44:37.648172 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 14:44:37.648172 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 14:44:37.648172 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:44:37.648172 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 444/891] 10.222.0.72 () {56 vars in 1117 bytes} [Mon Sep 19 14:44:37 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:37.656143 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b345f9-95dd-45a8-beda-e68322dc852c None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:37.670486 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:37.700517 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:37.705321 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0252d6-6cca-4222-b98c-7c23b380e895 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:37.749865 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c30a1e-0ac6-4f4b-a652-8c49d883dceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:37.750551 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c30a1e-0ac6-4f4b-a652-8c49d883dceb None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:37.750835 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c30a1e-0ac6-4f4b-a652-8c49d883dceb None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:37.751109 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c30a1e-0ac6-4f4b-a652-8c49d883dceb None admin] PATH_INFO: `/v3/services` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:37.751743 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c30a1e-0ac6-4f4b-a652-8c49d883dceb None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:37.752047 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c30a1e-0ac6-4f4b-a652-8c49d883dceb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:37.754037 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c30a1e-0ac6-4f4b-a652-8c49d883dceb None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:37.760482 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 448/892] 10.222.0.72 () {56 vars in 1114 bytes} [Mon Sep 19 14:44:37 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:37.766095 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c30a1e-0ac6-4f4b-a652-8c49d883dceb None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:37.771734 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b345f9-95dd-45a8-beda-e68322dc852c None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:37.807293 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8390f9d0-7385-4f33-b354-31315c1c3346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:37.807938 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390f9d0-7385-4f33-b354-31315c1c3346 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:37.809065 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390f9d0-7385-4f33-b354-31315c1c3346 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:37.809338 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390f9d0-7385-4f33-b354-31315c1c3346 None admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:37.810060 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8390f9d0-7385-4f33-b354-31315c1c3346 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:37.810360 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8390f9d0-7385-4f33-b354-31315c1c3346 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:37.811788 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8390f9d0-7385-4f33-b354-31315c1c3346 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:37.836413 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 445/893] 10.222.0.72 () {56 vars in 1149 bytes} [Mon Sep 19 14:44:37 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:44:37.837568 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8390f9d0-7385-4f33-b354-31315c1c3346 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:37.902944 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c30a1e-0ac6-4f4b-a652-8c49d883dceb None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:37.919854 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:37.950846 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d138af7-8aee-4dfb-8fe5-bea6e328178a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:37.951754 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d138af7-8aee-4dfb-8fe5-bea6e328178a None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:37.952208 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d138af7-8aee-4dfb-8fe5-bea6e328178a None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:37.952850 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d138af7-8aee-4dfb-8fe5-bea6e328178a None admin] PATH_INFO: `/v3/services` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:37.953190 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8390f9d0-7385-4f33-b354-31315c1c3346 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:37.953494 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d138af7-8aee-4dfb-8fe5-bea6e328178a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:37.953801 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d138af7-8aee-4dfb-8fe5-bea6e328178a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:37.955308 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d138af7-8aee-4dfb-8fe5-bea6e328178a None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:37.963001 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 449/894] 10.222.0.72 () {56 vars in 1114 bytes} [Mon Sep 19 14:44:37 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:37.965035 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc14bba-7524-498c-946d-b0f5b4437cd5 None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:37.965787 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc14bba-7524-498c-946d-b0f5b4437cd5 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:37.966243 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc14bba-7524-498c-946d-b0f5b4437cd5 None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:37.967642 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 450/895] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:44:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:44:37.969512 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc14bba-7524-498c-946d-b0f5b4437cd5 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:37.989910 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043fe9fd-f524-4ae4-89ea-e6f6fa9b4bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:37.990517 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043fe9fd-f524-4ae4-89ea-e6f6fa9b4bd8 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:37.990793 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043fe9fd-f524-4ae4-89ea-e6f6fa9b4bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:37.991062 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043fe9fd-f524-4ae4-89ea-e6f6fa9b4bd8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:38.005209 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:38.062870 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043fe9fd-f524-4ae4-89ea-e6f6fa9b4bd8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:38.064362 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043fe9fd-f524-4ae4-89ea-e6f6fa9b4bd8 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:38.087017 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc14bba-7524-498c-946d-b0f5b4437cd5 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:38.123308 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099aa9ca-1492-428e-81d4-930e89ad33ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:38.123922 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099aa9ca-1492-428e-81d4-930e89ad33ce None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:38.124207 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099aa9ca-1492-428e-81d4-930e89ad33ce None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:38.124505 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099aa9ca-1492-428e-81d4-930e89ad33ce None admin] PATH_INFO: `/v3/endpoints` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:38.125197 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099aa9ca-1492-428e-81d4-930e89ad33ce None admin] RBAC: Adding query filter params (interface=public, service_id=7f31847f11944e609779399d3da5b8aa, region_id=RegionOne) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:38.125504 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099aa9ca-1492-428e-81d4-930e89ad33ce None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:38.126853 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099aa9ca-1492-428e-81d4-930e89ad33ce None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:38.134154 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 451/896] 10.222.0.72 () {56 vars in 1251 bytes} [Mon Sep 19 14:44:37 2022] GET /identity/v3/endpoints?service_id=7f31847f11944e609779399d3da5b8aa&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:38.139111 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30edd60d-81c6-41cf-a3b8-f7d2b75071eb None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:38.139111 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30edd60d-81c6-41cf-a3b8-f7d2b75071eb None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:38.139111 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30edd60d-81c6-41cf-a3b8-f7d2b75071eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:38.140722 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:38.154482 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-30edd60d-81c6-41cf-a3b8-f7d2b75071eb None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:44:38.155597 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-30edd60d-81c6-41cf-a3b8-f7d2b75071eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:44:38.180856 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 446/897] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Sep 19 14:44:37 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 14:44:38.180856 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043fe9fd-f524-4ae4-89ea-e6f6fa9b4bd8 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:38.236955 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 452/898] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:44:38 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:44:38.236955 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30edd60d-81c6-41cf-a3b8-f7d2b75071eb None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:38.262273 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:38.309881 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043fe9fd-f524-4ae4-89ea-e6f6fa9b4bd8 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:38.350085 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667b7d33-b019-4a57-9156-2abbcd544633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:38.351376 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667b7d33-b019-4a57-9156-2abbcd544633 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:38.352085 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667b7d33-b019-4a57-9156-2abbcd544633 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:38.352530 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667b7d33-b019-4a57-9156-2abbcd544633 None admin] PATH_INFO: `/v3/services` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:38.353435 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667b7d33-b019-4a57-9156-2abbcd544633 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:38.355565 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667b7d33-b019-4a57-9156-2abbcd544633 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:38.360555 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30edd60d-81c6-41cf-a3b8-f7d2b75071eb None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:38.363929 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 447/899] 10.222.0.72 () {56 vars in 1087 bytes} [Mon Sep 19 14:44:38 2022] GET /identity/v3/services => generated 1268 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:44:38.401093 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4507793-14e2-4d5a-9029-6af0a3299e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:38.402666 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4507793-14e2-4d5a-9029-6af0a3299e79 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:38.403122 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4507793-14e2-4d5a-9029-6af0a3299e79 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:38.403541 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4507793-14e2-4d5a-9029-6af0a3299e79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:38.415685 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4507793-14e2-4d5a-9029-6af0a3299e79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:38.417486 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4507793-14e2-4d5a-9029-6af0a3299e79 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:38.426314 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204bbc7b-1d33-44fd-b8fa-8ffd335551c5 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:38.426875 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204bbc7b-1d33-44fd-b8fa-8ffd335551c5 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:38.426875 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204bbc7b-1d33-44fd-b8fa-8ffd335551c5 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:38.428431 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 448/900] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:44:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 14:44:38.434682 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cece2b88-b0e0-4f2d-8897-7f8810aa2268 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:38.435002 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cece2b88-b0e0-4f2d-8897-7f8810aa2268 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:38.435214 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cece2b88-b0e0-4f2d-8897-7f8810aa2268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:38.441590 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-d4507793-14e2-4d5a-9029-6af0a3299e79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:44:38.441590 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:38.441590 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:38.441590 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:38.441590 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:38.441590 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:38.441590 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:38.441590 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:38.441590 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:38.441590 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:38.441590 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:38.441590 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:38.441590 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:44:38.441590 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:44:38.441590 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:44:38.441590 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:44:38.442598 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:38.442598 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:38.442598 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:38.442598 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:38.442598 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:38.442598 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:38.442598 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:38.442598 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:38.442598 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:38.442598 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:38.442598 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:38.442598 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:38.442598 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:38.442598 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:38.442598 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:38.442598 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:38.442598 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:44:38.443477 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:44:38.443477 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:44:38.443477 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:44:38.445719 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 453/901] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:44:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:38.459869 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-cece2b88-b0e0-4f2d-8897-7f8810aa2268 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:44:38.459869 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-cece2b88-b0e0-4f2d-8897-7f8810aa2268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:44:38.460200 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4507793-14e2-4d5a-9029-6af0a3299e79 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:38.498880 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:38.549337 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 449/902] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:44:38 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 14:44:38.550323 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cece2b88-b0e0-4f2d-8897-7f8810aa2268 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:38.565536 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:38.593816 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4507793-14e2-4d5a-9029-6af0a3299e79 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:38.632121 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610db16b-91a0-4291-9007-d0b89cc33a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:38.633177 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610db16b-91a0-4291-9007-d0b89cc33a79 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:38.633643 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610db16b-91a0-4291-9007-d0b89cc33a79 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:38.634127 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610db16b-91a0-4291-9007-d0b89cc33a79 None admin] PATH_INFO: `/v3/domains` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:38.634951 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610db16b-91a0-4291-9007-d0b89cc33a79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:38.635558 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610db16b-91a0-4291-9007-d0b89cc33a79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:38.637004 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610db16b-91a0-4291-9007-d0b89cc33a79 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:38.656144 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 454/903] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Sep 19 14:44:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:38.657429 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610db16b-91a0-4291-9007-d0b89cc33a79 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:38.670142 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cece2b88-b0e0-4f2d-8897-7f8810aa2268 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:38.718099 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4df25ca-2269-48f4-872a-168eb5c65070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:38.719220 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4df25ca-2269-48f4-872a-168eb5c65070 None admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:38.719662 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4df25ca-2269-48f4-872a-168eb5c65070 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:38.720262 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4df25ca-2269-48f4-872a-168eb5c65070 None admin] PATH_INFO: `/v3/services` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:38.721396 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4df25ca-2269-48f4-872a-168eb5c65070 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:38.723340 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4df25ca-2269-48f4-872a-168eb5c65070 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:38.742336 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 450/904] 10.222.0.72 () {60 vars in 1141 bytes} [Mon Sep 19 14:44:38 2022] POST /identity/v3/services => generated 241 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:44:38.774455 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610db16b-91a0-4291-9007-d0b89cc33a79 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:38.817355 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:38.824306 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00e84a5-f463-4115-9577-7f3cb12fb10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:38.825115 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e84a5-f463-4115-9577-7f3cb12fb10a None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:38.825563 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e84a5-f463-4115-9577-7f3cb12fb10a None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:38.825835 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e84a5-f463-4115-9577-7f3cb12fb10a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:38.833873 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00e84a5-f463-4115-9577-7f3cb12fb10a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:38.835570 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00e84a5-f463-4115-9577-7f3cb12fb10a None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:38.841891 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4df25ca-2269-48f4-872a-168eb5c65070 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:38.849135 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-f00e84a5-f463-4115-9577-7f3cb12fb10a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:44:38.849135 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:38.849135 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:38.849135 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:38.849135 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:38.849135 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:38.849135 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:38.849135 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:38.849135 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:38.849135 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:38.849135 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:38.849135 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:38.849135 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 14:44:38.849135 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 14:44:38.849135 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 14:44:38.850089 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 14:44:38.850089 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:38.850089 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:38.850089 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:38.850089 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:38.850089 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:38.850089 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:38.850089 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:38.850089 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:38.850089 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:38.850089 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:38.850089 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:38.850089 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:38.850089 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:38.850089 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:38.850089 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:38.850089 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:38.850943 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 14:44:38.850943 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 14:44:38.850943 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:44:38.850943 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:44:38.850943 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:44:38.850943 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:44:38.850943 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:44:38.850943 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:44:38.855584 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 455/905] 10.222.0.72 () {56 vars in 1111 bytes} [Mon Sep 19 14:44:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:38.857388 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00e84a5-f463-4115-9577-7f3cb12fb10a None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:38.881468 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:38.973031 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4df25ca-2269-48f4-872a-168eb5c65070 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:38.978355 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00e84a5-f463-4115-9577-7f3cb12fb10a None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:39.016508 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf93be0e-c9ec-4854-a25a-1f93604fa729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:39.017708 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf93be0e-c9ec-4854-a25a-1f93604fa729 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:39.018199 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf93be0e-c9ec-4854-a25a-1f93604fa729 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:39.018340 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69702398-8a53-4bb6-b6ee-935fbbe96d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:39.018931 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69702398-8a53-4bb6-b6ee-935fbbe96d25 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:39.019214 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf93be0e-c9ec-4854-a25a-1f93604fa729 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:39.019343 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69702398-8a53-4bb6-b6ee-935fbbe96d25 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:39.019469 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69702398-8a53-4bb6-b6ee-935fbbe96d25 None admin] PATH_INFO: `/v3/projects` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:39.020140 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69702398-8a53-4bb6-b6ee-935fbbe96d25 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:39.020488 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69702398-8a53-4bb6-b6ee-935fbbe96d25 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:39.021104 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf93be0e-c9ec-4854-a25a-1f93604fa729 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:39.021905 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69702398-8a53-4bb6-b6ee-935fbbe96d25 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:39.023841 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf93be0e-c9ec-4854-a25a-1f93604fa729 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:39.035210 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 456/906] 10.222.0.72 () {56 vars in 1148 bytes} [Mon Sep 19 14:44:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:44:39.037565 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-cf93be0e-c9ec-4854-a25a-1f93604fa729 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 19 14:44:39.037565 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:39.037565 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 14:44:39.037565 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 14:44:39.037565 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 14:44:39.037565 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 14:44:39.037565 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 14:44:39.037565 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:44:39.037565 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 19 14:44:39.037565 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:44:39.037565 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 14:44:39.037565 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:44:39.037565 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:39.037565 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:39.037565 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:39.037565 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:39.038527 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:39.038527 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:39.038527 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:39.038527 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:39.038527 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:39.038527 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:39.038527 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:39.038527 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 14:44:39.038527 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 14:44:39.038527 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 14:44:39.038527 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 14:44:39.038527 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:39.038527 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:39.038527 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:39.038527 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:39.038527 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:39.038527 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:39.039881 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:39.039881 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:39.039881 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:39.039881 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:39.039881 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:39.039881 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:39.039881 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:39.039881 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:39.039881 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:39.039881 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:39.039881 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 14:44:39.039881 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:44:39.039881 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 19 14:44:39.039881 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:44:39.041835 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 451/907] 10.222.0.72 () {56 vars in 1132 bytes} [Mon Sep 19 14:44:38 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:39.043530 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69702398-8a53-4bb6-b6ee-935fbbe96d25 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:39.048944 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf93be0e-c9ec-4854-a25a-1f93604fa729 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:39.098739 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:39.152880 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:39.158608 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69702398-8a53-4bb6-b6ee-935fbbe96d25 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:39.168380 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf93be0e-c9ec-4854-a25a-1f93604fa729 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:39.199963 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8e760b-1c07-4dc5-a826-ef17326102d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:39.200627 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e760b-1c07-4dc5-a826-ef17326102d4 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:39.200895 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e760b-1c07-4dc5-a826-ef17326102d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:39.201174 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e760b-1c07-4dc5-a826-ef17326102d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:39.202015 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8e760b-1c07-4dc5-a826-ef17326102d4 None admin] RBAC: Adding query filter params (role.id=3ff0804c348f4f9fb91749835805a83a, scope.project.id=51af3a14d665498c9b7a35b34dac0ef1, user.id=afbbbf11f3234297ab1dd509f064480f) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:39.202408 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8e760b-1c07-4dc5-a826-ef17326102d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:39.203946 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8e760b-1c07-4dc5-a826-ef17326102d4 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:39.204968 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5850354a-ecd2-4fdc-a05b-4760a7c04975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:39.206032 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5850354a-ecd2-4fdc-a05b-4760a7c04975 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:39.206461 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5850354a-ecd2-4fdc-a05b-4760a7c04975 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:39.207415 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5850354a-ecd2-4fdc-a05b-4760a7c04975 None admin] PATH_INFO: `/v3/services` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:39.208497 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5850354a-ecd2-4fdc-a05b-4760a7c04975 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:39.208951 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5850354a-ecd2-4fdc-a05b-4760a7c04975 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:39.210467 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5850354a-ecd2-4fdc-a05b-4760a7c04975 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:39.212412 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 457/908] 10.222.0.72 () {56 vars in 1374 bytes} [Mon Sep 19 14:44:39 2022] GET /identity/v3/role_assignments?user.id=afbbbf11f3234297ab1dd509f064480f&scope.project.id=51af3a14d665498c9b7a35b34dac0ef1&role.id=3ff0804c348f4f9fb91749835805a83a => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:39.221314 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 452/909] 10.222.0.72 () {56 vars in 1126 bytes} [Mon Sep 19 14:44:39 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:39.227112 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8e760b-1c07-4dc5-a826-ef17326102d4 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:39.345777 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8e760b-1c07-4dc5-a826-ef17326102d4 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:39.369152 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:39.386132 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7a872f-7826-498f-93da-bf89b42ba59d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:39.387627 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7a872f-7826-498f-93da-bf89b42ba59d None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:39.388079 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7a872f-7826-498f-93da-bf89b42ba59d None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:39.388525 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7a872f-7826-498f-93da-bf89b42ba59d None admin] PATH_INFO: `/v3/services` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:39.389305 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7a872f-7826-498f-93da-bf89b42ba59d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:39.389773 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7a872f-7826-498f-93da-bf89b42ba59d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:39.391282 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7a872f-7826-498f-93da-bf89b42ba59d None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:39.397143 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 458/910] 10.222.0.72 () {56 vars in 1126 bytes} [Mon Sep 19 14:44:39 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:44:39.403398 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5850354a-ecd2-4fdc-a05b-4760a7c04975 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:39.507763 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5850354a-ecd2-4fdc-a05b-4760a7c04975 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:39.545376 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc18974-ab8e-41a7-967a-7abd76ae219f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:39.545991 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc18974-ab8e-41a7-967a-7abd76ae219f None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:39.546268 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc18974-ab8e-41a7-967a-7abd76ae219f None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:39.546547 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc18974-ab8e-41a7-967a-7abd76ae219f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:39.547244 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc18974-ab8e-41a7-967a-7abd76ae219f None admin] RBAC: Adding query filter params (interface=public, service_id=434b2fa27a6f4ea5b4e1b7cf9eac0c17, region_id=RegionOne) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:39.547554 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc18974-ab8e-41a7-967a-7abd76ae219f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:39.548961 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc18974-ab8e-41a7-967a-7abd76ae219f None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:39.554842 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 453/911] 10.222.0.72 () {56 vars in 1251 bytes} [Mon Sep 19 14:44:39 2022] GET /identity/v3/endpoints?service_id=434b2fa27a6f4ea5b4e1b7cf9eac0c17&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:39.560798 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7a872f-7826-498f-93da-bf89b42ba59d None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:39.666337 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7a872f-7826-498f-93da-bf89b42ba59d None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:39.702544 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb0641f-3b1d-4ad7-ac54-2e198e5491fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:39.703502 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb0641f-3b1d-4ad7-ac54-2e198e5491fe None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:39.703987 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb0641f-3b1d-4ad7-ac54-2e198e5491fe None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:39.704510 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb0641f-3b1d-4ad7-ac54-2e198e5491fe None admin] PATH_INFO: `/v3/services` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:39.705332 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb0641f-3b1d-4ad7-ac54-2e198e5491fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:39.706904 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb0641f-3b1d-4ad7-ac54-2e198e5491fe None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:39.713777 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 459/912] 10.222.0.72 () {56 vars in 1087 bytes} [Mon Sep 19 14:44:39 2022] GET /identity/v3/services => generated 1497 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:44:40.622551 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c78d3e8-cf4d-462d-9ae2-c08c29828f08 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:40.623112 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c78d3e8-cf4d-462d-9ae2-c08c29828f08 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:40.623112 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c78d3e8-cf4d-462d-9ae2-c08c29828f08 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:40.624725 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 454/913] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:44:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:44:40.630305 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8694da-b86c-4877-9069-d98ab7e408f1 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:40.630721 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8694da-b86c-4877-9069-d98ab7e408f1 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:40.630900 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8694da-b86c-4877-9069-d98ab7e408f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:40.649320 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-7e8694da-b86c-4877-9069-d98ab7e408f1 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:44:40.650491 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-7e8694da-b86c-4877-9069-d98ab7e408f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:44:40.687462 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:40.721072 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 460/914] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:44:40 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 14:44:40.992309 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c78d3e8-cf4d-462d-9ae2-c08c29828f08 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:41.012306 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:41.052974 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33333793-cb65-4e2d-861c-5083378a007b None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:41.053656 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33333793-cb65-4e2d-861c-5083378a007b None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:41.053995 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33333793-cb65-4e2d-861c-5083378a007b None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:41.055636 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 461/915] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:44:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:44:41.061640 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67400571-f046-4bf4-ae00-a70794a32773 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:41.062000 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67400571-f046-4bf4-ae00-a70794a32773 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:41.062344 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67400571-f046-4bf4-ae00-a70794a32773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:41.080363 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-67400571-f046-4bf4-ae00-a70794a32773 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:44:41.081645 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-67400571-f046-4bf4-ae00-a70794a32773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:44:41.108256 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c78d3e8-cf4d-462d-9ae2-c08c29828f08 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:41.147269 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ec305c-3fb5-40e1-a9a1-d010fe18c4d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:41.148004 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ec305c-3fb5-40e1-a9a1-d010fe18c4d7 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:41.148361 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ec305c-3fb5-40e1-a9a1-d010fe18c4d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:41.148782 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ec305c-3fb5-40e1-a9a1-d010fe18c4d7 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:41.149430 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ec305c-3fb5-40e1-a9a1-d010fe18c4d7 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:41.151310 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ec305c-3fb5-40e1-a9a1-d010fe18c4d7 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:41.163341 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-d2ec305c-3fb5-40e1-a9a1-d010fe18c4d7 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 19 14:44:41.163341 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:41.163341 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 14:44:41.163341 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 14:44:41.163341 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 14:44:41.163341 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 14:44:41.163341 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 14:44:41.163341 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:44:41.163341 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 19 14:44:41.163341 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:44:41.163341 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 14:44:41.163341 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:44:41.163341 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:41.163341 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:41.163341 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:41.163341 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:41.163341 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:41.164301 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:41.164301 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:41.164301 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:41.164301 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:41.164301 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:41.164301 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:41.164301 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 14:44:41.164301 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 14:44:41.164301 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 14:44:41.164301 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 14:44:41.164301 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:41.164301 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:41.164301 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:41.164301 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:41.164301 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:41.164301 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:41.165452 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:41.165452 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:41.165452 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:41.165452 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:41.165452 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:41.165452 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:41.165452 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:41.165452 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:41.165452 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:41.165452 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:41.165452 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 14:44:41.165452 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:44:41.165452 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 19 14:44:41.165452 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:44:41.165452 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 455/916] 10.222.0.72 () {56 vars in 1114 bytes} [Mon Sep 19 14:44:40 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:41.172445 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ec305c-3fb5-40e1-a9a1-d010fe18c4d7 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:41.174261 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 462/917] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:44:41 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 14:44:41.258561 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:41.278442 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ec305c-3fb5-40e1-a9a1-d010fe18c4d7 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:41.312693 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3720912-6eb3-4a15-abab-ca9ee3da2405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:41.313668 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3720912-6eb3-4a15-abab-ca9ee3da2405 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:41.314142 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3720912-6eb3-4a15-abab-ca9ee3da2405 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:41.314605 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3720912-6eb3-4a15-abab-ca9ee3da2405 None admin] PATH_INFO: `/v3/services` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:41.315432 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3720912-6eb3-4a15-abab-ca9ee3da2405 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:41.315925 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3720912-6eb3-4a15-abab-ca9ee3da2405 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:41.317511 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3720912-6eb3-4a15-abab-ca9ee3da2405 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:41.322895 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 456/918] 10.222.0.72 () {56 vars in 1114 bytes} [Mon Sep 19 14:44:41 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:44:41.329617 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67400571-f046-4bf4-ae00-a70794a32773 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:41.437258 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67400571-f046-4bf4-ae00-a70794a32773 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:41.439091 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:41.459378 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe71a92-5c3c-437d-93fd-9a7233faff17 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:41.459683 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe71a92-5c3c-437d-93fd-9a7233faff17 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:41.459938 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe71a92-5c3c-437d-93fd-9a7233faff17 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:41.462610 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 457/919] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:44:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 14:44:41.467607 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4343e35-40cd-47fa-b12f-c12a4396eb53 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:41.467897 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4343e35-40cd-47fa-b12f-c12a4396eb53 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:41.468177 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4343e35-40cd-47fa-b12f-c12a4396eb53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:41.481136 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b92d3a-ad1e-465c-bc99-e8de6fb5c1d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:41.481759 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b92d3a-ad1e-465c-bc99-e8de6fb5c1d8 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:41.482038 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b92d3a-ad1e-465c-bc99-e8de6fb5c1d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:41.482309 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b92d3a-ad1e-465c-bc99-e8de6fb5c1d8 None admin] PATH_INFO: `/v3/services` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:41.482939 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b92d3a-ad1e-465c-bc99-e8de6fb5c1d8 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:41.483243 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b92d3a-ad1e-465c-bc99-e8de6fb5c1d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:41.484668 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b92d3a-ad1e-465c-bc99-e8de6fb5c1d8 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:41.489827 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 463/920] 10.222.0.72 () {56 vars in 1114 bytes} [Mon Sep 19 14:44:41 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:41.490512 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-e4343e35-40cd-47fa-b12f-c12a4396eb53 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:44:41.490635 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b92d3a-ad1e-465c-bc99-e8de6fb5c1d8 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:41.492084 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-e4343e35-40cd-47fa-b12f-c12a4396eb53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:44:41.572378 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 458/921] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:44:41 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 14:44:41.572378 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4343e35-40cd-47fa-b12f-c12a4396eb53 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:41.608218 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b92d3a-ad1e-465c-bc99-e8de6fb5c1d8 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:41.652643 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc855a0-09a1-4e8f-b0c0-f62b90255bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:41.654086 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc855a0-09a1-4e8f-b0c0-f62b90255bd4 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:41.654518 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc855a0-09a1-4e8f-b0c0-f62b90255bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:41.654944 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc855a0-09a1-4e8f-b0c0-f62b90255bd4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:41.655694 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc855a0-09a1-4e8f-b0c0-f62b90255bd4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:41.657226 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc855a0-09a1-4e8f-b0c0-f62b90255bd4 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:41.665220 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:41.667373 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-9fc855a0-09a1-4e8f-b0c0-f62b90255bd4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 14:44:41.667373 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:41.667373 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 14:44:41.667373 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 14:44:41.667373 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 14:44:41.667373 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 14:44:41.667373 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 14:44:41.667373 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:44:41.667373 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 14:44:41.667373 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:44:41.667373 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 14:44:41.667373 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:44:41.667373 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:41.667373 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:41.667373 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:41.667373 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:41.667373 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:41.669283 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:41.669283 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:41.669283 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:41.669283 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:41.669283 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:41.669283 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:41.669283 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 14:44:41.669283 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 14:44:41.669283 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 14:44:41.669283 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 14:44:41.669283 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:41.669283 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:41.669283 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:41.669283 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:41.669283 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:41.669283 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:41.670105 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:41.670105 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:41.670105 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:41.670105 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:41.670105 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:41.670105 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:41.670105 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:41.670105 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:41.670105 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:41.670105 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:41.670105 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 14:44:41.670105 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:44:41.670105 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 14:44:41.670105 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:44:41.672872 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 464/922] 10.222.0.72 () {56 vars in 1126 bytes} [Mon Sep 19 14:44:41 2022] GET /identity/v3/services/object-store => generated 93 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:41.678196 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc855a0-09a1-4e8f-b0c0-f62b90255bd4 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:41.694225 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4343e35-40cd-47fa-b12f-c12a4396eb53 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:41.715928 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:41.737423 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912f7955-3b11-484d-9213-9757585531ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:41.738432 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f7955-3b11-484d-9213-9757585531ff None admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:41.738916 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f7955-3b11-484d-9213-9757585531ff None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:41.739469 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f7955-3b11-484d-9213-9757585531ff None admin] PATH_INFO: `/v3/endpoints` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:41.740350 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912f7955-3b11-484d-9213-9757585531ff None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:41.741942 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912f7955-3b11-484d-9213-9757585531ff None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:41.767575 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 459/923] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Sep 19 14:44:41 2022] POST /identity/v3/endpoints => generated 346 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:44:41.805172 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc855a0-09a1-4e8f-b0c0-f62b90255bd4 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:41.853290 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912f7955-3b11-484d-9213-9757585531ff None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:41.867838 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591d92d6-9f5f-4143-a071-05989a1ad921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:41.869094 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591d92d6-9f5f-4143-a071-05989a1ad921 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:41.869380 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591d92d6-9f5f-4143-a071-05989a1ad921 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:41.869661 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591d92d6-9f5f-4143-a071-05989a1ad921 None admin] PATH_INFO: `/v3/services` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:41.870376 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591d92d6-9f5f-4143-a071-05989a1ad921 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:41.870738 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591d92d6-9f5f-4143-a071-05989a1ad921 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:41.872447 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591d92d6-9f5f-4143-a071-05989a1ad921 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:41.882722 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 465/924] 10.222.0.72 () {56 vars in 1122 bytes} [Mon Sep 19 14:44:41 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:41.883707 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591d92d6-9f5f-4143-a071-05989a1ad921 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:41.995967 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912f7955-3b11-484d-9213-9757585531ff None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:42.000148 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:42.013662 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591d92d6-9f5f-4143-a071-05989a1ad921 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:42.031418 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:42.039799 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f65318-a50c-4f57-8202-270475fbe78f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:42.040660 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f65318-a50c-4f57-8202-270475fbe78f None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:42.041672 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f65318-a50c-4f57-8202-270475fbe78f None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:42.042024 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f65318-a50c-4f57-8202-270475fbe78f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:42.055613 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f65318-a50c-4f57-8202-270475fbe78f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:44:42.057100 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c67ba9-3e86-43f9-ac21-a8bf9fa277f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:42.057714 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c67ba9-3e86-43f9-ac21-a8bf9fa277f9 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:42.057995 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c67ba9-3e86-43f9-ac21-a8bf9fa277f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:42.058270 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c67ba9-3e86-43f9-ac21-a8bf9fa277f9 None admin] PATH_INFO: `/v3/services` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:42.059201 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c67ba9-3e86-43f9-ac21-a8bf9fa277f9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:42.059503 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c67ba9-3e86-43f9-ac21-a8bf9fa277f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:42.060891 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c67ba9-3e86-43f9-ac21-a8bf9fa277f9 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:42.061367 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-55f65318-a50c-4f57-8202-270475fbe78f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 14:44:42.061367 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:42.061367 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:42.061367 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:42.061367 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:42.061367 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:42.061367 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:42.061367 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:42.061367 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:42.061367 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:42.061367 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:42.061367 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:42.061367 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:44:42.061367 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:44:42.061367 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:44:42.061367 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:44:42.062248 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:44:42.062248 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:44:42.062248 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:44:42.062248 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:44:42.062248 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:42.062248 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:42.062248 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:42.062248 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:42.062248 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:42.062248 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:42.062248 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:42.062248 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:42.062248 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:42.062248 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:42.062248 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:42.062248 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:42.063086 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:42.063086 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:42.063086 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:42.063086 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:42.063086 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:44:42.063086 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:44:42.063086 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:44:42.063086 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:44:42.063086 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:44:42.063086 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:44:42.063086 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 14:44:42.063086 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:44:42.063086 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 460/925] 10.222.0.72 () {56 vars in 1120 bytes} [Mon Sep 19 14:44:41 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:44:42.063773 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9584ea-4cac-4368-a0bf-70585f2fdd89 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:42.064514 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9584ea-4cac-4368-a0bf-70585f2fdd89 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:42.064514 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9584ea-4cac-4368-a0bf-70585f2fdd89 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:42.065550 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 461/926] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:44:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:44:42.070431 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9584ea-4cac-4368-a0bf-70585f2fdd89 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:42.076722 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 466/927] 10.222.0.72 () {56 vars in 1122 bytes} [Mon Sep 19 14:44:41 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:42.076722 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14591d33-e142-4cf6-9ba3-d620a43e112a None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:42.076722 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14591d33-e142-4cf6-9ba3-d620a43e112a None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:42.076722 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14591d33-e142-4cf6-9ba3-d620a43e112a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:42.092545 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-14591d33-e142-4cf6-9ba3-d620a43e112a None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:44:42.093738 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-14591d33-e142-4cf6-9ba3-d620a43e112a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:44:42.176272 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 467/928] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:44:42 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:44:42.177606 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14591d33-e142-4cf6-9ba3-d620a43e112a None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:42.192741 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9584ea-4cac-4368-a0bf-70585f2fdd89 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:42.234479 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1500474-0a4d-4748-965b-53b7bbc337d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:42.235201 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1500474-0a4d-4748-965b-53b7bbc337d9 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:42.235479 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1500474-0a4d-4748-965b-53b7bbc337d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:42.235749 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1500474-0a4d-4748-965b-53b7bbc337d9 None admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:42.236437 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1500474-0a4d-4748-965b-53b7bbc337d9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:42.236740 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1500474-0a4d-4748-965b-53b7bbc337d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:42.238899 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1500474-0a4d-4748-965b-53b7bbc337d9 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:42.252544 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 462/929] 10.222.0.72 () {56 vars in 1115 bytes} [Mon Sep 19 14:44:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:42.257007 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1500474-0a4d-4748-965b-53b7bbc337d9 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:42.287642 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:42.311848 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14591d33-e142-4cf6-9ba3-d620a43e112a None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:42.333153 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:42.354444 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f428805-fdbf-4363-976b-4779f99f6c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:42.355526 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f428805-fdbf-4363-976b-4779f99f6c2a None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:42.356168 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f428805-fdbf-4363-976b-4779f99f6c2a None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:42.356632 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f428805-fdbf-4363-976b-4779f99f6c2a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:42.357532 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f428805-fdbf-4363-976b-4779f99f6c2a None admin] RBAC: Adding query filter params (interface=public, service_id=447fb3cd021e43259fad731ac6a16338, region_id=RegionOne) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:42.358010 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f428805-fdbf-4363-976b-4779f99f6c2a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:42.360181 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f428805-fdbf-4363-976b-4779f99f6c2a None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:42.372850 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 468/930] 10.222.0.72 () {56 vars in 1251 bytes} [Mon Sep 19 14:44:42 2022] GET /identity/v3/endpoints?service_id=447fb3cd021e43259fad731ac6a16338&interface=public®ion_id=RegionOne => generated 194 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:42.374340 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f428805-fdbf-4363-976b-4779f99f6c2a None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:42.393712 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1500474-0a4d-4748-965b-53b7bbc337d9 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:42.429444 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc83c5d-a891-47bc-ab50-4411e8bed206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:42.430332 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc83c5d-a891-47bc-ab50-4411e8bed206 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:42.430838 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc83c5d-a891-47bc-ab50-4411e8bed206 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:42.431347 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc83c5d-a891-47bc-ab50-4411e8bed206 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:42.443502 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc83c5d-a891-47bc-ab50-4411e8bed206 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:42.445298 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc83c5d-a891-47bc-ab50-4411e8bed206 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:42.461761 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-9fc83c5d-a891-47bc-ab50-4411e8bed206 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:44:42.461761 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:42.461761 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:42.461761 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:42.461761 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:42.461761 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:42.461761 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:42.461761 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:42.461761 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:42.461761 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:42.461761 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:42.461761 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:42.461761 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:44:42.461761 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:44:42.461761 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:44:42.461761 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:44:42.462733 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:42.462733 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:42.462733 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:42.462733 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:42.462733 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:42.462733 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:42.462733 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:42.462733 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:42.462733 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:42.462733 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:42.462733 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:42.462733 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:42.462733 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:42.462733 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:42.462733 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:42.462733 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:42.462733 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:44:42.463613 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:44:42.463613 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:44:42.463613 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:44:42.466584 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 463/931] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:44:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:44:42.467771 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc83c5d-a891-47bc-ab50-4411e8bed206 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:42.487907 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f428805-fdbf-4363-976b-4779f99f6c2a None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:42.525946 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed0949a-db89-4fe9-8fea-783131159e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:42.526515 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed0949a-db89-4fe9-8fea-783131159e6f None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:42.526791 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed0949a-db89-4fe9-8fea-783131159e6f None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:42.527128 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed0949a-db89-4fe9-8fea-783131159e6f None admin] PATH_INFO: `/v3/services` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:42.528591 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed0949a-db89-4fe9-8fea-783131159e6f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:42.529951 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed0949a-db89-4fe9-8fea-783131159e6f None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:42.536268 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 469/932] 10.222.0.72 () {56 vars in 1087 bytes} [Mon Sep 19 14:44:42 2022] GET /identity/v3/services => generated 1497 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:44:42.537080 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed0949a-db89-4fe9-8fea-783131159e6f None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:42.554547 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:42.600813 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc83c5d-a891-47bc-ab50-4411e8bed206 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:42.610112 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:42.643609 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c266325-858f-4b07-8e3b-38654be3e93f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:42.644232 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c266325-858f-4b07-8e3b-38654be3e93f None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:42.644541 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c266325-858f-4b07-8e3b-38654be3e93f None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:42.644813 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c266325-858f-4b07-8e3b-38654be3e93f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:42.645439 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c266325-858f-4b07-8e3b-38654be3e93f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:42.646851 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c266325-858f-4b07-8e3b-38654be3e93f None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:42.658343 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-8c266325-858f-4b07-8e3b-38654be3e93f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 19 14:44:42.658343 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:42.658343 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 14:44:42.658343 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 14:44:42.658343 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 14:44:42.658343 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 14:44:42.658343 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 14:44:42.658343 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:44:42.658343 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 19 14:44:42.658343 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:44:42.658343 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 14:44:42.658343 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:44:42.658343 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:42.658343 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:42.658343 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:42.658343 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:42.659348 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:42.659348 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:42.659348 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:42.659348 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:42.659348 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:42.659348 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:42.659348 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:42.659348 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 14:44:42.659348 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 14:44:42.659348 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 14:44:42.659348 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 14:44:42.659348 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:42.659348 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:42.659348 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:42.659348 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:42.659348 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:42.659348 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:42.660669 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:42.660669 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:42.660669 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:42.660669 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:42.660669 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:42.660669 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:42.660669 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:42.660669 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:42.660669 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:42.660669 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:42.660669 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 14:44:42.660669 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:44:42.660669 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 19 14:44:42.660669 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:44:42.660669 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 464/933] 10.222.0.72 () {56 vars in 1132 bytes} [Mon Sep 19 14:44:42 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:42.669257 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c266325-858f-4b07-8e3b-38654be3e93f None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:42.677759 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed0949a-db89-4fe9-8fea-783131159e6f None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:42.721880 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f7c56a-13d3-4e9d-91e3-654d5217030a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:42.723978 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f7c56a-13d3-4e9d-91e3-654d5217030a None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:42.723978 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f7c56a-13d3-4e9d-91e3-654d5217030a None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:42.723978 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f7c56a-13d3-4e9d-91e3-654d5217030a None admin] PATH_INFO: `/v3/domains` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:42.723978 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f7c56a-13d3-4e9d-91e3-654d5217030a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:42.724532 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f7c56a-13d3-4e9d-91e3-654d5217030a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:42.726918 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f7c56a-13d3-4e9d-91e3-654d5217030a None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:42.739947 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 470/934] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Sep 19 14:44:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:42.745985 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f7c56a-13d3-4e9d-91e3-654d5217030a None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:42.799822 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c266325-858f-4b07-8e3b-38654be3e93f None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:42.841575 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:42.851509 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad793d6-051f-430b-9cd9-318bd1716111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:42.852607 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad793d6-051f-430b-9cd9-318bd1716111 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:42.852898 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad793d6-051f-430b-9cd9-318bd1716111 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:42.853175 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad793d6-051f-430b-9cd9-318bd1716111 None admin] PATH_INFO: `/v3/services` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:42.853809 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad793d6-051f-430b-9cd9-318bd1716111 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:42.854115 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad793d6-051f-430b-9cd9-318bd1716111 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:42.856204 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad793d6-051f-430b-9cd9-318bd1716111 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:42.866890 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 465/935] 10.222.0.72 () {56 vars in 1126 bytes} [Mon Sep 19 14:44:42 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:44:42.868422 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad793d6-051f-430b-9cd9-318bd1716111 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:42.881639 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f7c56a-13d3-4e9d-91e3-654d5217030a None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:42.908925 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:42.922930 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e13364-eb3a-4123-8f45-bc859aed251e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:42.923578 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e13364-eb3a-4123-8f45-bc859aed251e None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:42.923865 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e13364-eb3a-4123-8f45-bc859aed251e None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:42.924165 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e13364-eb3a-4123-8f45-bc859aed251e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:42.932259 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e13364-eb3a-4123-8f45-bc859aed251e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:42.934811 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e13364-eb3a-4123-8f45-bc859aed251e None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:42.946581 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-d0e13364-eb3a-4123-8f45-bc859aed251e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 14:44:42.946581 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:42.946581 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:42.946581 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:42.946581 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:42.946581 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:42.946581 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:42.946581 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:42.946581 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:42.946581 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:42.946581 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:42.946581 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:42.946581 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 14:44:42.946581 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 14:44:42.946581 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 14:44:42.946581 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 14:44:42.947543 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:42.947543 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:42.947543 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:44:42.947543 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:44:42.947543 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:44:42.947543 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:44:42.947543 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:42.947543 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:42.947543 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:42.947543 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:42.947543 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:42.947543 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:42.947543 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:42.947543 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:42.947543 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:42.947543 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:42.947543 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:42.947543 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:42.949677 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:42.949677 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:42.949677 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 14:44:42.949677 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 14:44:42.949677 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 14:44:42.949677 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 14:44:42.949677 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 14:44:42.949677 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 14:44:42.949677 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 14:44:42.949677 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:44:42.949677 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 471/936] 10.222.0.72 () {56 vars in 1117 bytes} [Mon Sep 19 14:44:42 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:44:42.953991 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e13364-eb3a-4123-8f45-bc859aed251e None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:42.995391 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad793d6-051f-430b-9cd9-318bd1716111 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:43.044673 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec80ca9f-b4ca-401d-8fac-da245221326f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:43.045543 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec80ca9f-b4ca-401d-8fac-da245221326f None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:43.045827 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec80ca9f-b4ca-401d-8fac-da245221326f None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:43.046104 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec80ca9f-b4ca-401d-8fac-da245221326f None admin] PATH_INFO: `/v3/services` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:43.046739 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec80ca9f-b4ca-401d-8fac-da245221326f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:43.047044 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec80ca9f-b4ca-401d-8fac-da245221326f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:43.049615 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec80ca9f-b4ca-401d-8fac-da245221326f None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:43.056441 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 466/937] 10.222.0.72 () {56 vars in 1126 bytes} [Mon Sep 19 14:44:42 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:44:43.062501 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec80ca9f-b4ca-401d-8fac-da245221326f None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:43.087538 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e13364-eb3a-4123-8f45-bc859aed251e None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:43.123755 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:43.128937 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f45d56d-3422-4495-888c-d6404f113da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:43.129817 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f45d56d-3422-4495-888c-d6404f113da3 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:43.130309 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f45d56d-3422-4495-888c-d6404f113da3 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:43.130780 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f45d56d-3422-4495-888c-d6404f113da3 None admin] PATH_INFO: `/v3/users` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:43.131822 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f45d56d-3422-4495-888c-d6404f113da3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:43.132275 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f45d56d-3422-4495-888c-d6404f113da3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:43.134471 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f45d56d-3422-4495-888c-d6404f113da3 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:43.155217 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 472/938] 10.222.0.72 () {56 vars in 1149 bytes} [Mon Sep 19 14:44:42 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:44:43.160412 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f45d56d-3422-4495-888c-d6404f113da3 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:43.170528 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:43.174404 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec80ca9f-b4ca-401d-8fac-da245221326f None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:43.231277 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5c2333-61de-4bed-be0d-4da0cb7a813f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:43.232146 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5c2333-61de-4bed-be0d-4da0cb7a813f None admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:43.232450 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5c2333-61de-4bed-be0d-4da0cb7a813f None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:43.232969 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5c2333-61de-4bed-be0d-4da0cb7a813f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:43.234070 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5c2333-61de-4bed-be0d-4da0cb7a813f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:43.235743 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5c2333-61de-4bed-be0d-4da0cb7a813f None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:43.262527 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 467/939] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Sep 19 14:44:43 2022] POST /identity/v3/endpoints => generated 347 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 14:44:43.278256 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f45d56d-3422-4495-888c-d6404f113da3 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:43.325593 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85cb240-919a-452d-a403-278a04839bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:43.326204 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85cb240-919a-452d-a403-278a04839bda None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:43.326486 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85cb240-919a-452d-a403-278a04839bda None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:43.326754 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85cb240-919a-452d-a403-278a04839bda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:43.338862 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85cb240-919a-452d-a403-278a04839bda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:43.341030 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85cb240-919a-452d-a403-278a04839bda None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:43.358200 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-a85cb240-919a-452d-a403-278a04839bda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:44:43.358200 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:43.358200 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:43.358200 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:43.358200 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:43.358200 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:43.358200 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:43.358200 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:43.358200 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:43.358200 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:43.358200 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:43.358200 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:43.358200 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:44:43.358200 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:44:43.358200 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:44:43.358200 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:44:43.359195 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:43.359195 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:43.359195 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:43.359195 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:43.359195 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:43.359195 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:43.359195 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:43.359195 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:43.359195 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:43.359195 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:43.359195 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:43.359195 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:43.359195 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:43.359195 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:43.359195 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:43.359195 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:43.359195 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:44:43.360716 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:44:43.360716 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:44:43.360716 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:44:43.360716 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 473/940] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:44:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:43.365307 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5c2333-61de-4bed-be0d-4da0cb7a813f None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:43.484370 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5c2333-61de-4bed-be0d-4da0cb7a813f None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:43.524537 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75198334-8ae1-4699-9773-7d75b71d73b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:43.525587 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75198334-8ae1-4699-9773-7d75b71d73b5 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:43.526070 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75198334-8ae1-4699-9773-7d75b71d73b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:43.526542 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75198334-8ae1-4699-9773-7d75b71d73b5 None admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:43.527508 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75198334-8ae1-4699-9773-7d75b71d73b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:43.528024 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75198334-8ae1-4699-9773-7d75b71d73b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:43.529724 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75198334-8ae1-4699-9773-7d75b71d73b5 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:43.543277 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 468/941] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Sep 19 14:44:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:43.548765 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85cb240-919a-452d-a403-278a04839bda None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:43.597250 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:43.658441 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85cb240-919a-452d-a403-278a04839bda None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:43.693280 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7628c35-9bf0-4243-9072-698fb765eb07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:43.693930 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7628c35-9bf0-4243-9072-698fb765eb07 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:43.694225 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7628c35-9bf0-4243-9072-698fb765eb07 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:43.694500 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7628c35-9bf0-4243-9072-698fb765eb07 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:43.701490 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7628c35-9bf0-4243-9072-698fb765eb07 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:43.702920 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7628c35-9bf0-4243-9072-698fb765eb07 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:43.714289 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-d7628c35-9bf0-4243-9072-698fb765eb07 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:44:43.714289 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:43.714289 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:43.714289 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:43.714289 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:43.714289 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:43.714289 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:43.714289 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:43.714289 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:43.714289 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:43.714289 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:43.714289 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:43.714289 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 14:44:43.714289 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 14:44:43.714289 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 14:44:43.715724 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 14:44:43.715724 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:43.715724 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:43.715724 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:43.715724 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:43.715724 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:43.715724 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:43.715724 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:43.715724 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:43.715724 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:43.715724 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:43.715724 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:43.715724 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:43.715724 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:43.715724 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:43.715724 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:43.715724 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:43.716801 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 14:44:43.716801 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 14:44:43.716801 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:44:43.716801 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:44:43.716801 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:44:43.716801 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:44:43.716801 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:44:43.716801 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:44:43.716801 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 474/942] 10.222.0.72 () {56 vars in 1111 bytes} [Mon Sep 19 14:44:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:43.721853 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75198334-8ae1-4699-9773-7d75b71d73b5 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:43.738860 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:43.832166 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75198334-8ae1-4699-9773-7d75b71d73b5 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:43.873840 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e47b2b2-8956-49f6-9928-58b6c613307c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:43.874366 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e47b2b2-8956-49f6-9928-58b6c613307c None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:43.874643 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e47b2b2-8956-49f6-9928-58b6c613307c None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:43.874914 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e47b2b2-8956-49f6-9928-58b6c613307c None admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:43.875603 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e47b2b2-8956-49f6-9928-58b6c613307c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:43.875905 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e47b2b2-8956-49f6-9928-58b6c613307c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:43.877361 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e47b2b2-8956-49f6-9928-58b6c613307c None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:43.890417 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 469/943] 10.222.0.72 () {56 vars in 1148 bytes} [Mon Sep 19 14:44:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:43.896001 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7628c35-9bf0-4243-9072-698fb765eb07 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:44.000060 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:44.004933 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7628c35-9bf0-4243-9072-698fb765eb07 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:44.039948 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcebe1a7-f8c1-47dc-97e5-e4f20f60a199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:44.040636 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcebe1a7-f8c1-47dc-97e5-e4f20f60a199 None admin] REQUEST_METHOD: `PUT` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:44.040912 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcebe1a7-f8c1-47dc-97e5-e4f20f60a199 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:44.041180 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcebe1a7-f8c1-47dc-97e5-e4f20f60a199 None admin] PATH_INFO: `/v3/projects/51af3a14d665498c9b7a35b34dac0ef1/users/afbbbf11f3234297ab1dd509f064480f/roles/3ff0804c348f4f9fb91749835805a83a` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:44.044389 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcebe1a7-f8c1-47dc-97e5-e4f20f60a199 None admin] RBAC: Authorizing `identity:create_grant(project_id=51af3a14d665498c9b7a35b34dac0ef1, user_id=afbbbf11f3234297ab1dd509f064480f, role_id=3ff0804c348f4f9fb91749835805a83a)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:44.045879 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcebe1a7-f8c1-47dc-97e5-e4f20f60a199 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:44.060989 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 475/944] 10.222.0.72 () {58 vars in 1439 bytes} [Mon Sep 19 14:44:43 2022] PUT /identity/v3/projects/51af3a14d665498c9b7a35b34dac0ef1/users/afbbbf11f3234297ab1dd509f064480f/roles/3ff0804c348f4f9fb91749835805a83a => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:44:44.077088 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984bf06f-39dc-4d81-8ec3-f306bda2db63 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:44.077725 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984bf06f-39dc-4d81-8ec3-f306bda2db63 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:44.078207 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984bf06f-39dc-4d81-8ec3-f306bda2db63 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:44.081714 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 470/945] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:44:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:44:44.087004 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b127c70-d0dd-4ccf-8d78-b72b1b0d248e None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:44.087640 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b127c70-d0dd-4ccf-8d78-b72b1b0d248e None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:44.088177 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b127c70-d0dd-4ccf-8d78-b72b1b0d248e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:44.109326 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-4b127c70-d0dd-4ccf-8d78-b72b1b0d248e None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:44:44.110945 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-4b127c70-d0dd-4ccf-8d78-b72b1b0d248e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:44:44.191987 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 476/946] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:44:44 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:44:44.465602 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984bf06f-39dc-4d81-8ec3-f306bda2db63 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:44.545223 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:44.573816 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984bf06f-39dc-4d81-8ec3-f306bda2db63 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:44.608986 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ca5c4e-bc75-4cec-b10a-3bbf0c66ba51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:44.609594 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca5c4e-bc75-4cec-b10a-3bbf0c66ba51 None admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:44.609869 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca5c4e-bc75-4cec-b10a-3bbf0c66ba51 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:44.610140 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca5c4e-bc75-4cec-b10a-3bbf0c66ba51 None admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:44.610790 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ca5c4e-bc75-4cec-b10a-3bbf0c66ba51 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:44.612279 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ca5c4e-bc75-4cec-b10a-3bbf0c66ba51 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:44.614952 dv-cinder-756711-11-smb devstack@keystone.service[81451]: WARNING keystone.server.flask.common [None req-d5ca5c4e-bc75-4cec-b10a-3bbf0c66ba51 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 19 14:44:44.635217 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.sql.core [None req-d5ca5c4e-bc75-4cec-b10a-3bbf0c66ba51 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 19 14:44:44.635217 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 19 14:44:44.635217 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [parameters: {'id': 'd5a6c98859cb4a3eb6de40c62d470914', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 19 14:44:44.635217 dv-cinder-756711-11-smb devstack@keystone.service[81451]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81451) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 19 14:44:44.652832 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-d5ca5c4e-bc75-4cec-b10a-3bbf0c66ba51 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d5a6c98859cb4a3eb6de40c62d470914.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d5a6c98859cb4a3eb6de40c62d470914. Sep 19 14:44:44.652832 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:44.652832 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 19 14:44:44.652832 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 19 14:44:44.652832 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 19 14:44:44.652832 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 19 14:44:44.652832 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 19 14:44:44.652832 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application result = self._query(query) Sep 19 14:44:44.652832 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 19 14:44:44.652832 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application conn.query(q) Sep 19 14:44:44.652832 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 19 14:44:44.652832 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 19 14:44:44.652832 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 19 14:44:44.653678 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application result.read() Sep 19 14:44:44.653678 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 19 14:44:44.653678 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 19 14:44:44.653678 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 19 14:44:44.653678 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 19 14:44:44.653678 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 19 14:44:44.653678 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 19 14:44:44.653678 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 19 14:44:44.653678 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 19 14:44:44.653678 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 19 14:44:44.653678 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:44:44.653678 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 19 14:44:44.653678 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:44:44.653678 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:44.653678 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 19 14:44:44.653678 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 19 14:44:44.653678 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 19 14:44:44.653678 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 19 14:44:44.654605 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 19 14:44:44.654605 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application next(self.gen) Sep 19 14:44:44.654605 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 19 14:44:44.654605 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application yield resource Sep 19 14:44:44.654605 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 19 14:44:44.654605 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application next(self.gen) Sep 19 14:44:44.654605 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 19 14:44:44.654605 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application self.session.rollback() Sep 19 14:44:44.654605 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 19 14:44:44.654605 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application self.force_reraise() Sep 19 14:44:44.654605 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 19 14:44:44.654605 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise self.value Sep 19 14:44:44.654605 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 19 14:44:44.654605 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 19 14:44:44.654605 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 19 14:44:44.654605 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application session.commit() Sep 19 14:44:44.654605 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 19 14:44:44.655473 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 19 14:44:44.655473 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 19 14:44:44.655473 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application self._prepare_impl() Sep 19 14:44:44.655473 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 19 14:44:44.655473 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application self.session.flush() Sep 19 14:44:44.655473 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 19 14:44:44.655473 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application self._flush(objects) Sep 19 14:44:44.655473 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 19 14:44:44.655473 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 19 14:44:44.655473 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 19 14:44:44.655473 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application compat.raise_( Sep 19 14:44:44.655473 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 19 14:44:44.655473 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception Sep 19 14:44:44.655473 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 19 14:44:44.655473 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application flush_context.execute() Sep 19 14:44:44.655473 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 19 14:44:44.655473 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rec.execute(self) Sep 19 14:44:44.657235 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 19 14:44:44.657235 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 19 14:44:44.657235 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 19 14:44:44.657235 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 19 14:44:44.657235 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 19 14:44:44.657235 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 19 14:44:44.657235 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 19 14:44:44.657235 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 19 14:44:44.657235 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 19 14:44:44.657235 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 19 14:44:44.657235 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 19 14:44:44.657235 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 19 14:44:44.657235 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 19 14:44:44.657235 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 19 14:44:44.657235 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 19 14:44:44.659038 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 19 14:44:44.659038 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 19 14:44:44.659038 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception Sep 19 14:44:44.659038 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 19 14:44:44.659038 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 19 14:44:44.659038 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 19 14:44:44.659038 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 19 14:44:44.659038 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 19 14:44:44.659038 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application result = self._query(query) Sep 19 14:44:44.659038 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 19 14:44:44.659038 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application conn.query(q) Sep 19 14:44:44.659038 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 19 14:44:44.659038 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 19 14:44:44.659038 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 19 14:44:44.659038 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application result.read() Sep 19 14:44:44.659038 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 19 14:44:44.659038 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 19 14:44:44.665269 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 19 14:44:44.665269 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 19 14:44:44.665269 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 19 14:44:44.665269 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 19 14:44:44.665269 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 19 14:44:44.665269 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 19 14:44:44.665269 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 19 14:44:44.665269 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 19 14:44:44.665269 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [parameters: {'id': 'd5a6c98859cb4a3eb6de40c62d470914', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 19 14:44:44.665269 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 19 14:44:44.665269 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:44:44.665269 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 14:44:44.665269 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:44:44.665269 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:44.665269 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 19 14:44:44.667114 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 19 14:44:44.667114 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 19 14:44:44.667114 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 19 14:44:44.667114 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 19 14:44:44.667114 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:44:44.667114 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 14:44:44.667114 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:44:44.667114 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:44.667114 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:44.667114 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:44.667114 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:44.667114 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:44.667114 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:44.667114 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:44.667114 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:44.667114 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:44.667114 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:44.669366 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:44.669366 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 19 14:44:44.669366 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 19 14:44:44.669366 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:44.669366 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:44.669366 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 19 14:44:44.669366 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 19 14:44:44.669366 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d5a6c98859cb4a3eb6de40c62d470914. Sep 19 14:44:44.669366 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:44:44.669366 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 471/947] 10.222.0.72 () {60 vars in 1140 bytes} [Mon Sep 19 14:44:44 2022] POST /identity/v3/projects => generated 262 bytes in 190 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:44.670622 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b127c70-d0dd-4ccf-8d78-b72b1b0d248e None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:44.761236 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:44.774385 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b127c70-d0dd-4ccf-8d78-b72b1b0d248e None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:44.812116 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d777afe8-b06a-42c4-bb2c-e1e76f8e7b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:44.812820 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d777afe8-b06a-42c4-bb2c-e1e76f8e7b9d None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:44.813102 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d777afe8-b06a-42c4-bb2c-e1e76f8e7b9d None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:44.813377 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d777afe8-b06a-42c4-bb2c-e1e76f8e7b9d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:44.820647 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d777afe8-b06a-42c4-bb2c-e1e76f8e7b9d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:44.822157 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d777afe8-b06a-42c4-bb2c-e1e76f8e7b9d None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:44.826581 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f49c664-0079-4557-b151-729749ad800c None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:44.827117 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f49c664-0079-4557-b151-729749ad800c None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:44.827117 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f49c664-0079-4557-b151-729749ad800c None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:44.834379 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-d777afe8-b06a-42c4-bb2c-e1e76f8e7b9d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:44:44.834379 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:44.834379 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:44.834379 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:44.834379 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:44.834379 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:44.834379 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:44.834379 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:44.834379 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:44.834379 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:44.834379 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:44.834379 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:44.834379 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 14:44:44.834379 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 14:44:44.834379 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 14:44:44.836346 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 14:44:44.836346 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:44.836346 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:44.836346 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:44.836346 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:44.836346 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:44.836346 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:44.836346 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:44.836346 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:44.836346 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:44.836346 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:44.836346 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:44.836346 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:44.836346 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:44.836346 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:44.836346 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:44.836346 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:44.838392 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 14:44:44.838392 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 14:44:44.838392 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:44:44.838392 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:44:44.838392 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:44:44.838392 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:44:44.838392 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:44:44.838392 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:44:44.839355 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 472/948] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:44:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 14:44:44.839355 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9276e065-a206-4c3c-8a40-578c3f509f74 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:44.839355 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9276e065-a206-4c3c-8a40-578c3f509f74 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:44.839355 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9276e065-a206-4c3c-8a40-578c3f509f74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:44.840072 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 477/949] 10.222.0.72 () {56 vars in 1111 bytes} [Mon Sep 19 14:44:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:44:44.844348 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d777afe8-b06a-42c4-bb2c-e1e76f8e7b9d None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:44.857246 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-9276e065-a206-4c3c-8a40-578c3f509f74 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:44:44.858970 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-9276e065-a206-4c3c-8a40-578c3f509f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:44:44.948449 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 473/950] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:44:44 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:44:44.957779 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d777afe8-b06a-42c4-bb2c-e1e76f8e7b9d None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:44.993484 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b846e8-3176-47e4-95b8-5c8ddfa4c8ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:44.994109 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b846e8-3176-47e4-95b8-5c8ddfa4c8ec None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:44.994386 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b846e8-3176-47e4-95b8-5c8ddfa4c8ec None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:44.994656 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b846e8-3176-47e4-95b8-5c8ddfa4c8ec None admin] PATH_INFO: `/v3/projects` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:44.995344 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b846e8-3176-47e4-95b8-5c8ddfa4c8ec None admin] RBAC: Adding query filter params (name=service) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:44.995673 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b846e8-3176-47e4-95b8-5c8ddfa4c8ec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:44.997830 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b846e8-3176-47e4-95b8-5c8ddfa4c8ec None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:45.022395 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 478/951] 10.222.0.72 () {56 vars in 1112 bytes} [Mon Sep 19 14:44:44 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:44:45.222830 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9276e065-a206-4c3c-8a40-578c3f509f74 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:45.292616 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:45.335983 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9276e065-a206-4c3c-8a40-578c3f509f74 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:45.373097 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b00718-8576-4692-9af7-0a7e00b1abf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:45.373741 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b00718-8576-4692-9af7-0a7e00b1abf2 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:45.374016 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b00718-8576-4692-9af7-0a7e00b1abf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:45.374282 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b00718-8576-4692-9af7-0a7e00b1abf2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:45.374868 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b00718-8576-4692-9af7-0a7e00b1abf2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:45.376433 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b00718-8576-4692-9af7-0a7e00b1abf2 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:45.385727 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-69b00718-8576-4692-9af7-0a7e00b1abf2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 14:44:45.385727 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:45.385727 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 14:44:45.385727 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 14:44:45.385727 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 14:44:45.385727 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 14:44:45.385727 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 14:44:45.385727 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:44:45.385727 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 14:44:45.385727 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:44:45.385727 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 14:44:45.385727 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:44:45.385727 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:45.385727 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:45.385727 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:45.385727 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:45.385727 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:45.386717 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:45.386717 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:45.386717 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:45.386717 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:45.386717 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:45.386717 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:45.386717 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 14:44:45.386717 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 14:44:45.386717 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 14:44:45.386717 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 14:44:45.386717 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:45.386717 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:45.386717 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:45.386717 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:45.386717 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:45.386717 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:45.387778 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:45.387778 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:45.387778 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:45.387778 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:45.387778 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:45.387778 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:45.387778 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:45.387778 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:45.387778 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:45.387778 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:45.387778 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 14:44:45.387778 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:44:45.387778 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 14:44:45.387778 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:44:45.387778 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 474/952] 10.222.0.72 () {56 vars in 1126 bytes} [Mon Sep 19 14:44:45 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:45.395017 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b846e8-3176-47e4-95b8-5c8ddfa4c8ec None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:45.407034 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:45.504816 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b846e8-3176-47e4-95b8-5c8ddfa4c8ec None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:45.544818 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffb880a-94cb-46ec-b664-1facc973752c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:45.545351 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb880a-94cb-46ec-b664-1facc973752c None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:45.545632 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb880a-94cb-46ec-b664-1facc973752c None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:45.545904 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb880a-94cb-46ec-b664-1facc973752c None admin] PATH_INFO: `/v3/services` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:45.546534 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffb880a-94cb-46ec-b664-1facc973752c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:45.546834 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffb880a-94cb-46ec-b664-1facc973752c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:45.548248 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffb880a-94cb-46ec-b664-1facc973752c None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:45.553715 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 479/953] 10.222.0.72 () {56 vars in 1122 bytes} [Mon Sep 19 14:44:45 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:45.560042 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b00718-8576-4692-9af7-0a7e00b1abf2 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:45.625534 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a7e148-a931-49ab-aa3e-2a639fc7664a None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:45.625860 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a7e148-a931-49ab-aa3e-2a639fc7664a None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:45.626338 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a7e148-a931-49ab-aa3e-2a639fc7664a None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:45.628111 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 480/954] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:44:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:44:45.634291 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116998d9-8ded-4348-be1c-cad3de5e9e22 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:45.634572 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116998d9-8ded-4348-be1c-cad3de5e9e22 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:45.634913 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116998d9-8ded-4348-be1c-cad3de5e9e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:45.654192 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-116998d9-8ded-4348-be1c-cad3de5e9e22 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:44:45.655372 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-116998d9-8ded-4348-be1c-cad3de5e9e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:44:45.670462 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b00718-8576-4692-9af7-0a7e00b1abf2 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:45.695604 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:45.719686 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fcb4a1-0498-4251-a0b6-43587fd5ea9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:45.720710 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fcb4a1-0498-4251-a0b6-43587fd5ea9c None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:45.721049 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fcb4a1-0498-4251-a0b6-43587fd5ea9c None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:45.721326 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fcb4a1-0498-4251-a0b6-43587fd5ea9c None admin] PATH_INFO: `/v3/services` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:45.722393 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fcb4a1-0498-4251-a0b6-43587fd5ea9c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:45.722697 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fcb4a1-0498-4251-a0b6-43587fd5ea9c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:45.724627 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fcb4a1-0498-4251-a0b6-43587fd5ea9c None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:45.732561 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 475/955] 10.222.0.72 () {56 vars in 1122 bytes} [Mon Sep 19 14:44:45 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:45.738279 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fcb4a1-0498-4251-a0b6-43587fd5ea9c None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:45.738546 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 481/956] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:44:45 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 14:44:45.848467 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fcb4a1-0498-4251-a0b6-43587fd5ea9c None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:45.886112 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1889a99e-abf4-41f2-b28a-b56bb0f9ed7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:45.887655 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889a99e-abf4-41f2-b28a-b56bb0f9ed7f None admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:45.888136 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889a99e-abf4-41f2-b28a-b56bb0f9ed7f None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:45.888628 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889a99e-abf4-41f2-b28a-b56bb0f9ed7f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:45.889559 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1889a99e-abf4-41f2-b28a-b56bb0f9ed7f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:45.891261 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1889a99e-abf4-41f2-b28a-b56bb0f9ed7f None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:45.914245 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 476/957] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Sep 19 14:44:45 2022] POST /identity/v3/endpoints => generated 349 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 14:44:46.031140 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116998d9-8ded-4348-be1c-cad3de5e9e22 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:46.033504 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:46.145573 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116998d9-8ded-4348-be1c-cad3de5e9e22 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:46.188086 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4720987-b12d-4314-8053-5cd2fdea658b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:46.188757 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4720987-b12d-4314-8053-5cd2fdea658b None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:46.189033 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4720987-b12d-4314-8053-5cd2fdea658b None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:46.189302 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4720987-b12d-4314-8053-5cd2fdea658b None admin] PATH_INFO: `/v3/services/compute` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:46.189882 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4720987-b12d-4314-8053-5cd2fdea658b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:46.191677 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4720987-b12d-4314-8053-5cd2fdea658b None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:46.201789 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-e4720987-b12d-4314-8053-5cd2fdea658b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 19 14:44:46.201789 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:46.201789 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 14:44:46.201789 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 14:44:46.201789 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 14:44:46.201789 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 14:44:46.201789 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 14:44:46.201789 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:44:46.201789 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 19 14:44:46.201789 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:44:46.201789 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 14:44:46.201789 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:44:46.201789 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:46.201789 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:46.201789 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:46.201789 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:46.201789 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:46.202941 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:46.202941 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:46.202941 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:46.202941 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:46.202941 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:46.202941 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:46.202941 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 14:44:46.202941 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 14:44:46.202941 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 14:44:46.202941 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 14:44:46.202941 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:46.202941 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:46.202941 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:46.202941 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:46.202941 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:46.202941 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:46.203811 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:46.203811 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:46.203811 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:46.203811 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:46.203811 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:46.203811 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:46.203811 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:46.203811 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:46.203811 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:46.203811 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:46.203811 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 14:44:46.203811 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:44:46.203811 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 19 14:44:46.203811 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:44:46.208241 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 482/958] 10.222.0.72 () {56 vars in 1111 bytes} [Mon Sep 19 14:44:46 2022] GET /identity/v3/services/compute => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:46.209723 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1889a99e-abf4-41f2-b28a-b56bb0f9ed7f None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:46.262183 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:46.321388 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1889a99e-abf4-41f2-b28a-b56bb0f9ed7f None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:46.328415 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91a55d-f86a-48cb-baca-389b947f2e8d None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:46.328701 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91a55d-f86a-48cb-baca-389b947f2e8d None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:46.328979 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91a55d-f86a-48cb-baca-389b947f2e8d None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:46.331060 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 483/959] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:44:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 14:44:46.337478 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5af393c-c6e7-4628-9027-ee5ebaac96a1 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:46.338235 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5af393c-c6e7-4628-9027-ee5ebaac96a1 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:46.338610 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5af393c-c6e7-4628-9027-ee5ebaac96a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:46.359818 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9cc360-e895-4fd9-a306-4b5487723773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:46.360363 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-b5af393c-c6e7-4628-9027-ee5ebaac96a1 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:44:46.360486 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9cc360-e895-4fd9-a306-4b5487723773 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:46.360724 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9cc360-e895-4fd9-a306-4b5487723773 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:46.361001 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9cc360-e895-4fd9-a306-4b5487723773 None admin] PATH_INFO: `/v3/services` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:46.361632 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9cc360-e895-4fd9-a306-4b5487723773 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:46.361938 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9cc360-e895-4fd9-a306-4b5487723773 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:46.362045 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-b5af393c-c6e7-4628-9027-ee5ebaac96a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:44:46.363305 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9cc360-e895-4fd9-a306-4b5487723773 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:46.368504 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 477/960] 10.222.0.72 () {56 vars in 1112 bytes} [Mon Sep 19 14:44:46 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:46.374769 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9cc360-e895-4fd9-a306-4b5487723773 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:46.439111 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:46.452475 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 484/961] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:44:46 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 14:44:46.504690 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9cc360-e895-4fd9-a306-4b5487723773 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:46.514295 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:46.541052 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cada877-35b8-4432-bb2c-36a14588773c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:46.542058 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cada877-35b8-4432-bb2c-36a14588773c None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:46.543093 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cada877-35b8-4432-bb2c-36a14588773c None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:46.543570 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cada877-35b8-4432-bb2c-36a14588773c None admin] PATH_INFO: `/v3/services` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:46.544426 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cada877-35b8-4432-bb2c-36a14588773c None admin] RBAC: Adding query filter params (type=compute) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:46.544934 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cada877-35b8-4432-bb2c-36a14588773c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:46.546535 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cada877-35b8-4432-bb2c-36a14588773c None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:46.551853 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 478/962] 10.222.0.72 () {56 vars in 1112 bytes} [Mon Sep 19 14:44:46 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:44:46.734767 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5af393c-c6e7-4628-9027-ee5ebaac96a1 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:46.840751 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5af393c-c6e7-4628-9027-ee5ebaac96a1 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:46.876784 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e8805c-3b5f-43ab-a40c-cb0b5007725d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:46.877810 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e8805c-3b5f-43ab-a40c-cb0b5007725d None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:46.878321 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e8805c-3b5f-43ab-a40c-cb0b5007725d None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:46.878799 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e8805c-3b5f-43ab-a40c-cb0b5007725d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:46.891462 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e8805c-3b5f-43ab-a40c-cb0b5007725d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:44:46.897003 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-67e8805c-3b5f-43ab-a40c-cb0b5007725d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 14:44:46.897003 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:46.897003 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:46.897003 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:46.897003 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:46.897003 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:46.897003 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:46.897003 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:46.897003 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:46.897003 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:46.897003 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:46.897003 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:46.897003 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:44:46.897003 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:44:46.897003 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:44:46.897003 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:44:46.898000 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:44:46.898000 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:44:46.898000 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:44:46.898000 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:44:46.898000 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:46.898000 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:46.898000 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:46.898000 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:46.898000 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:46.898000 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:46.898000 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:46.898000 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:46.898000 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:46.898000 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:46.898000 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:46.898000 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:46.898838 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:46.898838 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:46.898838 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:46.898838 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:46.898838 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:44:46.898838 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:44:46.898838 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:44:46.898838 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:44:46.898838 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:44:46.898838 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:44:46.898838 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 14:44:46.898838 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:44:46.901711 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 485/963] 10.222.0.72 () {56 vars in 1120 bytes} [Mon Sep 19 14:44:46 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:46.908472 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cada877-35b8-4432-bb2c-36a14588773c None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:47.016410 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cada877-35b8-4432-bb2c-36a14588773c None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:47.052122 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e372ff-240d-43e1-8033-f8a10cd74410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:47.052765 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e372ff-240d-43e1-8033-f8a10cd74410 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:47.053048 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e372ff-240d-43e1-8033-f8a10cd74410 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:47.053323 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e372ff-240d-43e1-8033-f8a10cd74410 None admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:47.054048 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e372ff-240d-43e1-8033-f8a10cd74410 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:47.054359 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e372ff-240d-43e1-8033-f8a10cd74410 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:47.055798 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e372ff-240d-43e1-8033-f8a10cd74410 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:47.064943 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 479/964] 10.222.0.72 () {56 vars in 1115 bytes} [Mon Sep 19 14:44:46 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:47.070663 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e8805c-3b5f-43ab-a40c-cb0b5007725d None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:47.128831 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:47.176969 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e8805c-3b5f-43ab-a40c-cb0b5007725d None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:47.212533 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc348d3-3248-491c-b53b-7951f503840c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:47.213170 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc348d3-3248-491c-b53b-7951f503840c None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:47.213452 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc348d3-3248-491c-b53b-7951f503840c None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:47.213723 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc348d3-3248-491c-b53b-7951f503840c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:47.224917 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc348d3-3248-491c-b53b-7951f503840c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:47.226553 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc348d3-3248-491c-b53b-7951f503840c None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:47.244182 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-6dc348d3-3248-491c-b53b-7951f503840c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:44:47.244182 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:47.244182 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:47.244182 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:47.244182 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:47.244182 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:47.244182 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:47.244182 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:47.244182 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:47.244182 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:47.244182 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:47.244182 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:47.244182 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:44:47.244182 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:44:47.244182 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:44:47.244182 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:44:47.245226 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:47.245226 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:47.245226 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:47.245226 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:47.245226 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:47.245226 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:47.245226 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:47.245226 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:47.245226 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:47.245226 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:47.245226 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:47.245226 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:47.245226 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:47.245226 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:47.245226 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:47.245226 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:47.245226 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:44:47.246904 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:44:47.246904 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:44:47.246904 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:44:47.246904 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 486/965] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:44:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:47.252238 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e372ff-240d-43e1-8033-f8a10cd74410 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:47.296933 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:47.351367 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f52fb3-276d-4068-8656-850c2621374a None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:47.351703 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f52fb3-276d-4068-8656-850c2621374a None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:47.351905 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f52fb3-276d-4068-8656-850c2621374a None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:47.353502 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 487/966] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:44:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 14:44:47.358418 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a29a0e-fe74-43a6-b965-676997229761 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:47.358696 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a29a0e-fe74-43a6-b965-676997229761 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:47.358967 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a29a0e-fe74-43a6-b965-676997229761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:47.362166 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e372ff-240d-43e1-8033-f8a10cd74410 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:47.377610 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-30a29a0e-fe74-43a6-b965-676997229761 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:44:47.378783 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-30a29a0e-fe74-43a6-b965-676997229761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:44:47.404550 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f102c1-fae8-4069-a437-dd5273e7aad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:47.405323 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f102c1-fae8-4069-a437-dd5273e7aad1 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:47.405606 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f102c1-fae8-4069-a437-dd5273e7aad1 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:47.406203 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f102c1-fae8-4069-a437-dd5273e7aad1 None admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:47.407127 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f102c1-fae8-4069-a437-dd5273e7aad1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:47.407431 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f102c1-fae8-4069-a437-dd5273e7aad1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:47.409627 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f102c1-fae8-4069-a437-dd5273e7aad1 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:47.425187 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 480/967] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Sep 19 14:44:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:47.430763 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f102c1-fae8-4069-a437-dd5273e7aad1 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:47.459177 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 488/968] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:44:47 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 14:44:47.535702 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:47.542392 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f102c1-fae8-4069-a437-dd5273e7aad1 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:47.578232 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d628d8d6-0a82-4ef5-a7cc-da0f21a0553e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:47.578783 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d628d8d6-0a82-4ef5-a7cc-da0f21a0553e None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:47.579064 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d628d8d6-0a82-4ef5-a7cc-da0f21a0553e None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:47.579337 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d628d8d6-0a82-4ef5-a7cc-da0f21a0553e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:47.586656 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d628d8d6-0a82-4ef5-a7cc-da0f21a0553e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:47.588108 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d628d8d6-0a82-4ef5-a7cc-da0f21a0553e None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:47.600363 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-d628d8d6-0a82-4ef5-a7cc-da0f21a0553e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 14:44:47.600363 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:47.600363 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:47.600363 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:47.600363 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:47.600363 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:47.600363 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:47.600363 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:47.600363 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:47.600363 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:47.600363 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:47.600363 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:47.600363 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 14:44:47.600363 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 14:44:47.600363 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 14:44:47.600363 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 14:44:47.602475 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:47.602475 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:47.602475 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:44:47.602475 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:44:47.602475 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:44:47.602475 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:44:47.602475 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:47.602475 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:47.602475 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:47.602475 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:47.602475 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:47.602475 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:47.602475 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:47.602475 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:47.602475 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:47.602475 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:47.602475 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:47.602475 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:47.604724 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:47.604724 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:47.604724 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 14:44:47.604724 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 14:44:47.604724 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 14:44:47.604724 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 14:44:47.604724 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 14:44:47.604724 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 14:44:47.604724 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 14:44:47.604724 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:44:47.604724 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 481/969] 10.222.0.72 () {56 vars in 1117 bytes} [Mon Sep 19 14:44:47 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:47.612361 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a29a0e-fe74-43a6-b965-676997229761 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:47.643144 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:47.709542 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a29a0e-fe74-43a6-b965-676997229761 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:47.744189 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98ad236-edf7-4848-9eb6-bce686ba97d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:47.744839 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98ad236-edf7-4848-9eb6-bce686ba97d1 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:47.745118 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98ad236-edf7-4848-9eb6-bce686ba97d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:47.745391 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98ad236-edf7-4848-9eb6-bce686ba97d1 None admin] PATH_INFO: `/v3/users` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:47.746686 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98ad236-edf7-4848-9eb6-bce686ba97d1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:47.746993 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98ad236-edf7-4848-9eb6-bce686ba97d1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:47.748502 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98ad236-edf7-4848-9eb6-bce686ba97d1 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:47.765905 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d628d8d6-0a82-4ef5-a7cc-da0f21a0553e None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:47.766300 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 489/970] 10.222.0.72 () {56 vars in 1149 bytes} [Mon Sep 19 14:44:47 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:47.773008 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98ad236-edf7-4848-9eb6-bce686ba97d1 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:47.889996 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:47.900582 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d628d8d6-0a82-4ef5-a7cc-da0f21a0553e None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:47.905059 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98ad236-edf7-4848-9eb6-bce686ba97d1 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:47.942620 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb46e7a-a311-49ff-949a-acbd77f13012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:47.944000 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb46e7a-a311-49ff-949a-acbd77f13012 None admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:47.944537 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb46e7a-a311-49ff-949a-acbd77f13012 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:47.945116 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb46e7a-a311-49ff-949a-acbd77f13012 None admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:47.946091 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb46e7a-a311-49ff-949a-acbd77f13012 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:47.946900 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c0836a-7e14-489b-8e97-2880078ead1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:47.947584 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c0836a-7e14-489b-8e97-2880078ead1d None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:47.947938 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c0836a-7e14-489b-8e97-2880078ead1d None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:47.948230 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb46e7a-a311-49ff-949a-acbd77f13012 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:47.948371 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c0836a-7e14-489b-8e97-2880078ead1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:47.963696 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.sql.core [None req-bfb46e7a-a311-49ff-949a-acbd77f13012 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 19 14:44:47.963696 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 19 14:44:47.963696 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [parameters: {'user_id': '15f22c13e5aa49aa8b15e9d77ab89d49', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 19 14:44:47.963696 dv-cinder-756711-11-smb devstack@keystone.service[81451]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81451) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 19 14:44:47.972337 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-bfb46e7a-a311-49ff-949a-acbd77f13012 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 19 14:44:47.972337 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:47.972337 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 19 14:44:47.972337 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 19 14:44:47.972337 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 19 14:44:47.972337 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 19 14:44:47.972337 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 19 14:44:47.972337 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application result = self._query(query) Sep 19 14:44:47.972337 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 19 14:44:47.972337 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application conn.query(q) Sep 19 14:44:47.972337 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 19 14:44:47.972337 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 19 14:44:47.972337 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 19 14:44:47.972337 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application result.read() Sep 19 14:44:47.972337 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 19 14:44:47.973203 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 19 14:44:47.973203 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 19 14:44:47.973203 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 19 14:44:47.973203 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 19 14:44:47.973203 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 19 14:44:47.973203 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 19 14:44:47.973203 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 19 14:44:47.973203 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 19 14:44:47.973203 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:44:47.973203 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 19 14:44:47.973203 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:44:47.973203 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:47.973203 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 19 14:44:47.973203 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 19 14:44:47.973203 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 19 14:44:47.973203 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 19 14:44:47.973203 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 19 14:44:47.973203 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application next(self.gen) Sep 19 14:44:47.974197 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 19 14:44:47.974197 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application yield resource Sep 19 14:44:47.974197 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 19 14:44:47.974197 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application next(self.gen) Sep 19 14:44:47.974197 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 19 14:44:47.974197 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application self.session.rollback() Sep 19 14:44:47.974197 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 19 14:44:47.974197 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application self.force_reraise() Sep 19 14:44:47.974197 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 19 14:44:47.974197 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise self.value Sep 19 14:44:47.974197 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 19 14:44:47.974197 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 19 14:44:47.974197 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 19 14:44:47.974197 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application session.commit() Sep 19 14:44:47.974197 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 19 14:44:47.974197 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 19 14:44:47.974197 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 19 14:44:47.975111 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application self._prepare_impl() Sep 19 14:44:47.975111 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 19 14:44:47.975111 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application self.session.flush() Sep 19 14:44:47.975111 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 19 14:44:47.975111 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application self._flush(objects) Sep 19 14:44:47.975111 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 19 14:44:47.975111 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 19 14:44:47.975111 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 19 14:44:47.975111 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application compat.raise_( Sep 19 14:44:47.975111 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 19 14:44:47.975111 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception Sep 19 14:44:47.975111 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 19 14:44:47.975111 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application flush_context.execute() Sep 19 14:44:47.975111 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 19 14:44:47.975111 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rec.execute(self) Sep 19 14:44:47.975111 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 19 14:44:47.975111 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 19 14:44:47.976008 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 19 14:44:47.976008 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 19 14:44:47.976008 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 19 14:44:47.976008 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 19 14:44:47.976008 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 19 14:44:47.976008 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 19 14:44:47.976008 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 19 14:44:47.976008 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 19 14:44:47.976008 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 19 14:44:47.976008 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 19 14:44:47.976008 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 19 14:44:47.976008 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 19 14:44:47.976008 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 19 14:44:47.976008 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 19 14:44:47.976008 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 19 14:44:47.976008 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception Sep 19 14:44:47.977320 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 19 14:44:47.977320 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 19 14:44:47.977320 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 19 14:44:47.977320 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 19 14:44:47.977320 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 19 14:44:47.977320 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application result = self._query(query) Sep 19 14:44:47.977320 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 19 14:44:47.977320 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application conn.query(q) Sep 19 14:44:47.977320 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 19 14:44:47.977320 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 19 14:44:47.977320 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 19 14:44:47.977320 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application result.read() Sep 19 14:44:47.977320 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 19 14:44:47.977320 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 19 14:44:47.977320 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 19 14:44:47.977320 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 19 14:44:47.978144 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 19 14:44:47.978144 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 19 14:44:47.978144 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 19 14:44:47.978144 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 19 14:44:47.978144 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 19 14:44:47.978144 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 19 14:44:47.978144 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [parameters: {'user_id': '15f22c13e5aa49aa8b15e9d77ab89d49', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 19 14:44:47.978144 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 19 14:44:47.978144 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:44:47.978144 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 14:44:47.978144 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:44:47.978144 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:47.978144 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:47.978144 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:47.978144 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:47.978959 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:47.978959 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:47.978959 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:47.978959 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:47.978959 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:47.978959 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:47.978959 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:47.978959 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 19 14:44:47.978959 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 19 14:44:47.978959 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:47.978959 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:47.978959 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:44:47.978959 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:44:47.978959 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:44:47.978959 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:44:47.978959 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 19 14:44:47.978959 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 19 14:44:47.979872 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 19 14:44:47.979872 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 19 14:44:47.979872 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 19 14:44:47.979872 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 19 14:44:47.979872 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 19 14:44:47.979872 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:44:47.982753 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 482/971] 10.222.0.72 () {60 vars in 1131 bytes} [Mon Sep 19 14:44:47 2022] POST /identity/v3/users => generated 160 bytes in 217 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:44:47.992373 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb46e7a-a311-49ff-949a-acbd77f13012 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:48.015666 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:48.025119 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c0836a-7e14-489b-8e97-2880078ead1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:48.027195 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c0836a-7e14-489b-8e97-2880078ead1d None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:48.138145 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb46e7a-a311-49ff-949a-acbd77f13012 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:48.139639 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:48.158365 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 490/972] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Sep 19 14:44:47 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 19 14:44:48.159363 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c0836a-7e14-489b-8e97-2880078ead1d None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:48.191076 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e99d83-c57e-4b0e-a2de-3ccaaa1331eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:48.192514 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e99d83-c57e-4b0e-a2de-3ccaaa1331eb None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:48.192829 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e99d83-c57e-4b0e-a2de-3ccaaa1331eb None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:48.193110 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e99d83-c57e-4b0e-a2de-3ccaaa1331eb None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:48.203648 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e99d83-c57e-4b0e-a2de-3ccaaa1331eb None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:48.206061 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e99d83-c57e-4b0e-a2de-3ccaaa1331eb None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:48.224580 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-34e99d83-c57e-4b0e-a2de-3ccaaa1331eb None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 19 14:44:48.224580 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:48.224580 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:48.224580 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:48.224580 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:48.224580 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:48.224580 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:48.224580 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:48.224580 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:48.224580 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:48.224580 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:48.224580 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:48.224580 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 14:44:48.224580 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 14:44:48.224580 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 14:44:48.224580 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 14:44:48.225598 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:48.225598 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:48.225598 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:44:48.225598 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:44:48.225598 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:44:48.225598 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:44:48.225598 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:48.225598 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:48.225598 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:48.225598 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:48.225598 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:48.225598 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:48.225598 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:48.225598 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:48.225598 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:48.225598 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:48.225598 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:48.225598 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:48.226520 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:48.226520 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:48.226520 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 14:44:48.226520 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 14:44:48.226520 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 14:44:48.226520 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 14:44:48.226520 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 14:44:48.226520 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 14:44:48.226520 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 19 14:44:48.226520 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:44:48.234403 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 483/973] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Sep 19 14:44:47 2022] GET /identity/v3/users/cinder => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:48.236108 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e99d83-c57e-4b0e-a2de-3ccaaa1331eb None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:48.284040 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c0836a-7e14-489b-8e97-2880078ead1d None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:48.319350 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0eb247-ed28-4a3d-a8c2-548260211ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:48.319961 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0eb247-ed28-4a3d-a8c2-548260211ee0 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:48.320244 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0eb247-ed28-4a3d-a8c2-548260211ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:48.320542 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0eb247-ed28-4a3d-a8c2-548260211ee0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:48.320748 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:48.332132 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0eb247-ed28-4a3d-a8c2-548260211ee0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:48.334021 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0eb247-ed28-4a3d-a8c2-548260211ee0 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:48.346210 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e99d83-c57e-4b0e-a2de-3ccaaa1331eb None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:48.349505 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-aa0eb247-ed28-4a3d-a8c2-548260211ee0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:44:48.349505 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:48.349505 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:48.349505 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:48.349505 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:48.349505 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:48.349505 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:48.349505 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:48.349505 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:48.349505 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:48.349505 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:48.349505 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:48.349505 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:44:48.349505 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:44:48.349505 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:44:48.349505 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:44:48.350425 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:48.350425 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:48.350425 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:48.350425 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:48.350425 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:48.350425 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:48.350425 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:48.350425 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:48.350425 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:48.350425 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:48.350425 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:48.350425 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:48.350425 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:48.350425 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:48.350425 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:48.350425 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:48.350425 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:44:48.351332 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:44:48.351332 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:44:48.351332 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:44:48.351332 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 491/974] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:44:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:48.352086 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1d02a8-c37f-4540-bb5b-337318968161 None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:48.352382 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1d02a8-c37f-4540-bb5b-337318968161 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:48.352656 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1d02a8-c37f-4540-bb5b-337318968161 None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:48.358136 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 492/975] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:44:48 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:44:48.358136 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1d02a8-c37f-4540-bb5b-337318968161 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:48.388119 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1095b26-2850-42af-b16e-1eb8de770c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:48.388759 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1095b26-2850-42af-b16e-1eb8de770c98 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:48.389041 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1095b26-2850-42af-b16e-1eb8de770c98 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:48.389319 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1095b26-2850-42af-b16e-1eb8de770c98 None admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:48.390007 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1095b26-2850-42af-b16e-1eb8de770c98 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:48.390312 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1095b26-2850-42af-b16e-1eb8de770c98 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:48.391744 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1095b26-2850-42af-b16e-1eb8de770c98 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:48.405325 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:48.440618 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 484/976] 10.222.0.72 () {56 vars in 1101 bytes} [Mon Sep 19 14:44:48 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:44:48.442100 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47306e3d-2695-4238-b082-bfd79700782d None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:48.452389 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47306e3d-2695-4238-b082-bfd79700782d None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:48.452389 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47306e3d-2695-4238-b082-bfd79700782d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:48.462937 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-47306e3d-2695-4238-b082-bfd79700782d None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:44:48.464642 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-47306e3d-2695-4238-b082-bfd79700782d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:44:48.486074 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1d02a8-c37f-4540-bb5b-337318968161 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:48.531655 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d66130-7b2a-4659-9ea1-1ea0ee93e702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:48.532878 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d66130-7b2a-4659-9ea1-1ea0ee93e702 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:48.533379 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d66130-7b2a-4659-9ea1-1ea0ee93e702 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:48.534451 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d66130-7b2a-4659-9ea1-1ea0ee93e702 None admin] PATH_INFO: `/v3/domains` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:48.535589 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d66130-7b2a-4659-9ea1-1ea0ee93e702 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:48.536079 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d66130-7b2a-4659-9ea1-1ea0ee93e702 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:48.537894 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d66130-7b2a-4659-9ea1-1ea0ee93e702 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:48.555537 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 493/977] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Sep 19 14:44:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:48.568365 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d66130-7b2a-4659-9ea1-1ea0ee93e702 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:48.568559 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 485/978] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:44:48 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:44:48.674496 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d66130-7b2a-4659-9ea1-1ea0ee93e702 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:48.677781 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:48.717874 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3029a65f-306e-4a79-80e9-e2cae10a9139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:48.718538 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3029a65f-306e-4a79-80e9-e2cae10a9139 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:48.718821 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3029a65f-306e-4a79-80e9-e2cae10a9139 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:48.719090 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3029a65f-306e-4a79-80e9-e2cae10a9139 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:48.727051 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3029a65f-306e-4a79-80e9-e2cae10a9139 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:48.728541 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3029a65f-306e-4a79-80e9-e2cae10a9139 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:48.740941 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-3029a65f-306e-4a79-80e9-e2cae10a9139 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:44:48.740941 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:48.740941 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:48.740941 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:48.740941 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:48.740941 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:48.740941 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:48.740941 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:48.740941 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:48.740941 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:48.740941 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:48.740941 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:48.740941 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 14:44:48.740941 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 14:44:48.740941 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 14:44:48.741874 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 14:44:48.741874 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:48.741874 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:48.741874 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:48.741874 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:48.741874 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:48.741874 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:48.741874 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:48.741874 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:48.741874 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:48.741874 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:48.741874 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:48.741874 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:48.741874 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:48.741874 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:48.741874 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:48.741874 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:48.742756 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 14:44:48.742756 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 14:44:48.742756 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:44:48.742756 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:44:48.742756 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:44:48.742756 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:44:48.742756 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:44:48.742756 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:44:48.742756 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 494/979] 10.222.0.72 () {56 vars in 1111 bytes} [Mon Sep 19 14:44:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:48.748155 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47306e3d-2695-4238-b082-bfd79700782d None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:48.811097 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:48.814852 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53b851c-737a-4fd9-b87d-60ca3f81b973 None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:48.815137 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53b851c-737a-4fd9-b87d-60ca3f81b973 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:48.815425 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53b851c-737a-4fd9-b87d-60ca3f81b973 None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:48.816837 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 495/980] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:44:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 14:44:48.821955 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51fcce3-9bdc-437f-b8b0-8bb869fb81b7 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:48.822241 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51fcce3-9bdc-437f-b8b0-8bb869fb81b7 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:48.822515 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51fcce3-9bdc-437f-b8b0-8bb869fb81b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:48.842293 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-c51fcce3-9bdc-437f-b8b0-8bb869fb81b7 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:44:48.843482 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-c51fcce3-9bdc-437f-b8b0-8bb869fb81b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:44:48.852602 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47306e3d-2695-4238-b082-bfd79700782d None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:48.887104 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525078db-63fe-417d-846f-3da8cbde2919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:48.887857 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525078db-63fe-417d-846f-3da8cbde2919 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:48.890903 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525078db-63fe-417d-846f-3da8cbde2919 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:48.890903 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525078db-63fe-417d-846f-3da8cbde2919 None admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:48.890903 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525078db-63fe-417d-846f-3da8cbde2919 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:48.890903 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525078db-63fe-417d-846f-3da8cbde2919 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:48.890903 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525078db-63fe-417d-846f-3da8cbde2919 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:48.902837 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 486/981] 10.222.0.72 () {56 vars in 1148 bytes} [Mon Sep 19 14:44:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:48.903650 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525078db-63fe-417d-846f-3da8cbde2919 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:48.918206 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 496/982] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:44:48 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 14:44:48.919047 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51fcce3-9bdc-437f-b8b0-8bb869fb81b7 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:49.011917 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525078db-63fe-417d-846f-3da8cbde2919 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:49.022156 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:49.029448 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51fcce3-9bdc-437f-b8b0-8bb869fb81b7 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:49.037621 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:49.048918 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0845f2b0-c601-431e-aefc-441057343098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:49.049551 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0845f2b0-c601-431e-aefc-441057343098 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:49.049836 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0845f2b0-c601-431e-aefc-441057343098 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:49.050162 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0845f2b0-c601-431e-aefc-441057343098 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:49.050956 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0845f2b0-c601-431e-aefc-441057343098 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:49.052154 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0845f2b0-c601-431e-aefc-441057343098 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:49.062545 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-0845f2b0-c601-431e-aefc-441057343098 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 14:44:49.062545 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:49.062545 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 14:44:49.062545 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 14:44:49.062545 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 14:44:49.062545 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 14:44:49.062545 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 14:44:49.062545 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:44:49.062545 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 14:44:49.062545 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:44:49.062545 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 14:44:49.062545 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:44:49.062545 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:49.062545 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:49.062545 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:49.062545 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:49.062545 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:49.063525 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:49.063525 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:49.063525 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:49.063525 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:49.063525 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:49.063525 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:49.063525 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 14:44:49.063525 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 14:44:49.063525 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 14:44:49.063525 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 14:44:49.063525 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:49.063525 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:49.063525 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:49.063525 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:49.063525 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:49.063525 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:49.064408 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:49.064408 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:49.064408 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:49.064408 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:49.064408 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:49.064408 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:49.064408 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:49.064408 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:49.064408 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:49.064408 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:49.064408 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 14:44:49.064408 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:44:49.064408 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 14:44:49.064408 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:44:49.064408 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 487/983] 10.222.0.72 () {56 vars in 1126 bytes} [Mon Sep 19 14:44:48 2022] GET /identity/v3/services/object-store => generated 93 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:49.069352 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0845f2b0-c601-431e-aefc-441057343098 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:49.071698 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c97cbd-6cc1-4a30-a01f-4297d098a13d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:49.072541 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c97cbd-6cc1-4a30-a01f-4297d098a13d None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:49.072827 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c97cbd-6cc1-4a30-a01f-4297d098a13d None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:49.073100 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c97cbd-6cc1-4a30-a01f-4297d098a13d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:49.074716 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c97cbd-6cc1-4a30-a01f-4297d098a13d None admin] RBAC: Adding query filter params (role.id=3ff0804c348f4f9fb91749835805a83a, scope.project.id=51af3a14d665498c9b7a35b34dac0ef1, user.id=afbbbf11f3234297ab1dd509f064480f) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:49.075029 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c97cbd-6cc1-4a30-a01f-4297d098a13d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:49.076472 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c97cbd-6cc1-4a30-a01f-4297d098a13d None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:49.083784 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 497/984] 10.222.0.72 () {56 vars in 1374 bytes} [Mon Sep 19 14:44:48 2022] GET /identity/v3/role_assignments?user.id=afbbbf11f3234297ab1dd509f064480f&scope.project.id=51af3a14d665498c9b7a35b34dac0ef1&role.id=3ff0804c348f4f9fb91749835805a83a => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:49.188436 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c97cbd-6cc1-4a30-a01f-4297d098a13d None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:49.195988 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0845f2b0-c601-431e-aefc-441057343098 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:49.246094 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297be65a-d457-4eef-ba2f-a6aa1564cceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:49.247129 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297be65a-d457-4eef-ba2f-a6aa1564cceb None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:49.247697 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297be65a-d457-4eef-ba2f-a6aa1564cceb None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:49.247980 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297be65a-d457-4eef-ba2f-a6aa1564cceb None admin] PATH_INFO: `/v3/services` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:49.248657 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297be65a-d457-4eef-ba2f-a6aa1564cceb None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:49.249124 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297be65a-d457-4eef-ba2f-a6aa1564cceb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:49.250809 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297be65a-d457-4eef-ba2f-a6aa1564cceb None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:49.257782 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 488/985] 10.222.0.72 () {56 vars in 1122 bytes} [Mon Sep 19 14:44:49 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:44:49.264651 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297be65a-d457-4eef-ba2f-a6aa1564cceb None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:49.311848 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c97cbd-6cc1-4a30-a01f-4297d098a13d None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:49.325811 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:49.352454 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c621294-68f8-4a24-b14e-d95fe00f4f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:49.353069 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c621294-68f8-4a24-b14e-d95fe00f4f02 None admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:49.353352 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c621294-68f8-4a24-b14e-d95fe00f4f02 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:49.353649 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c621294-68f8-4a24-b14e-d95fe00f4f02 None admin] PATH_INFO: `/v3/services` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:49.354286 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c621294-68f8-4a24-b14e-d95fe00f4f02 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:49.355761 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c621294-68f8-4a24-b14e-d95fe00f4f02 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:49.371574 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 498/986] 10.222.0.72 () {60 vars in 1141 bytes} [Mon Sep 19 14:44:49 2022] POST /identity/v3/services => generated 242 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 14:44:49.379434 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297be65a-d457-4eef-ba2f-a6aa1564cceb None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:49.427696 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0951775c-2827-4bca-b27d-6e6f85b855e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:49.428429 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0951775c-2827-4bca-b27d-6e6f85b855e9 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:49.428715 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0951775c-2827-4bca-b27d-6e6f85b855e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:49.428988 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0951775c-2827-4bca-b27d-6e6f85b855e9 None admin] PATH_INFO: `/v3/services` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:49.429637 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0951775c-2827-4bca-b27d-6e6f85b855e9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:49.429944 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0951775c-2827-4bca-b27d-6e6f85b855e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:49.431369 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0951775c-2827-4bca-b27d-6e6f85b855e9 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:49.442637 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 489/987] 10.222.0.72 () {56 vars in 1122 bytes} [Mon Sep 19 14:44:49 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:44:49.444368 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c621294-68f8-4a24-b14e-d95fe00f4f02 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:49.467990 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:49.561897 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c621294-68f8-4a24-b14e-d95fe00f4f02 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:49.597320 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56c5f7d-0c8c-4809-961f-09470f3674bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:49.597938 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c5f7d-0c8c-4809-961f-09470f3674bf None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:49.598220 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c5f7d-0c8c-4809-961f-09470f3674bf None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:49.598495 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c5f7d-0c8c-4809-961f-09470f3674bf None admin] PATH_INFO: `/v3/endpoints` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:49.599205 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56c5f7d-0c8c-4809-961f-09470f3674bf None admin] RBAC: Adding query filter params (interface=admin, service_id=447fb3cd021e43259fad731ac6a16338, region_id=RegionOne) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:49.599518 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56c5f7d-0c8c-4809-961f-09470f3674bf None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:49.600910 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56c5f7d-0c8c-4809-961f-09470f3674bf None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:49.606985 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 499/988] 10.222.0.72 () {56 vars in 1249 bytes} [Mon Sep 19 14:44:49 2022] GET /identity/v3/endpoints?service_id=447fb3cd021e43259fad731ac6a16338&interface=admin®ion_id=RegionOne => generated 193 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:49.612722 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0951775c-2827-4bca-b27d-6e6f85b855e9 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:49.718713 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0951775c-2827-4bca-b27d-6e6f85b855e9 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:49.733186 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:49.755935 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91e9d7a-0aa7-410b-8d0d-c79fffe8d661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:49.756585 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e9d7a-0aa7-410b-8d0d-c79fffe8d661 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:49.756866 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e9d7a-0aa7-410b-8d0d-c79fffe8d661 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:49.757199 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e9d7a-0aa7-410b-8d0d-c79fffe8d661 None admin] PATH_INFO: `/v3/services` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:49.757807 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91e9d7a-0aa7-410b-8d0d-c79fffe8d661 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:49.759171 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91e9d7a-0aa7-410b-8d0d-c79fffe8d661 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:49.768422 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 490/989] 10.222.0.72 () {56 vars in 1087 bytes} [Mon Sep 19 14:44:49 2022] GET /identity/v3/services => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:44:51.262459 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2810a444-3e3f-4477-a524-b934b1895d73 None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:51.263007 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2810a444-3e3f-4477-a524-b934b1895d73 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:51.263007 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2810a444-3e3f-4477-a524-b934b1895d73 None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:51.264311 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 500/990] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:44:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:44:51.269658 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfca6f5a-5725-4af1-a0e4-a0f0217fe7cd None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:51.270039 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfca6f5a-5725-4af1-a0e4-a0f0217fe7cd None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:51.270217 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfca6f5a-5725-4af1-a0e4-a0f0217fe7cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:51.288968 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-dfca6f5a-5725-4af1-a0e4-a0f0217fe7cd None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:44:51.290134 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-dfca6f5a-5725-4af1-a0e4-a0f0217fe7cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:44:51.362983 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 491/991] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:44:51 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:44:51.552789 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce74a477-9b0f-4870-a289-d0e521ce5b6e None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:51.552978 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce74a477-9b0f-4870-a289-d0e521ce5b6e None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:51.553258 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce74a477-9b0f-4870-a289-d0e521ce5b6e None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:51.554710 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 501/992] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:44:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:44:51.560554 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b117807-8eca-4bf1-8fd9-706d1950f3be None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:51.560851 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b117807-8eca-4bf1-8fd9-706d1950f3be None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:51.561132 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b117807-8eca-4bf1-8fd9-706d1950f3be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:51.580069 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-3b117807-8eca-4bf1-8fd9-706d1950f3be None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:44:51.581293 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-3b117807-8eca-4bf1-8fd9-706d1950f3be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:44:51.633911 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce74a477-9b0f-4870-a289-d0e521ce5b6e None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:51.650877 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 492/993] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:44:51 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:44:51.723282 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:51.742941 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce74a477-9b0f-4870-a289-d0e521ce5b6e None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:51.778299 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1602a8-7967-4097-84ae-5f9a82807b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:51.778962 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1602a8-7967-4097-84ae-5f9a82807b71 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:51.779239 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1602a8-7967-4097-84ae-5f9a82807b71 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:51.779509 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1602a8-7967-4097-84ae-5f9a82807b71 None admin] PATH_INFO: `/v3/services/image` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:51.780085 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1602a8-7967-4097-84ae-5f9a82807b71 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:51.781475 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1602a8-7967-4097-84ae-5f9a82807b71 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:51.790557 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-2e1602a8-7967-4097-84ae-5f9a82807b71 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 19 14:44:51.790557 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:51.790557 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 14:44:51.790557 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 14:44:51.790557 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 14:44:51.790557 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 14:44:51.790557 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 14:44:51.790557 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:44:51.790557 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 19 14:44:51.790557 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:44:51.790557 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 14:44:51.790557 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:44:51.790557 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:51.790557 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:51.790557 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:51.790557 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:51.790557 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:51.791537 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:51.791537 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:51.791537 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:51.791537 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:51.791537 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:51.791537 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:51.791537 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 14:44:51.791537 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 14:44:51.791537 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 14:44:51.791537 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 14:44:51.791537 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:51.791537 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:51.791537 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:51.791537 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:51.791537 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:51.791537 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:51.797396 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:51.797396 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:51.797396 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:51.797396 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:51.797396 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:51.797396 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:51.797396 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:51.797396 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:51.797396 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:51.797396 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:51.797396 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 14:44:51.797396 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:44:51.797396 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 19 14:44:51.797396 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:44:51.797396 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 502/994] 10.222.0.72 () {56 vars in 1105 bytes} [Mon Sep 19 14:44:51 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:51.799671 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b117807-8eca-4bf1-8fd9-706d1950f3be None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:51.840271 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:51.913499 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b117807-8eca-4bf1-8fd9-706d1950f3be None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:51.923689 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1602a8-7967-4097-84ae-5f9a82807b71 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:51.950356 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f0e77e-d088-4213-a56f-4588d370163e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:51.950962 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f0e77e-d088-4213-a56f-4588d370163e None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:51.951243 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f0e77e-d088-4213-a56f-4588d370163e None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:51.951518 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f0e77e-d088-4213-a56f-4588d370163e None admin] PATH_INFO: `/v3/services` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:51.952145 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f0e77e-d088-4213-a56f-4588d370163e None admin] RBAC: Adding query filter params (name=image) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:51.952492 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f0e77e-d088-4213-a56f-4588d370163e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:51.953842 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f0e77e-d088-4213-a56f-4588d370163e None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:51.958494 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 493/995] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:44:51 2022] GET /identity/v3/services?name=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:51.959755 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9b4e5e-908f-41c6-9b5d-c5665a0ec98f None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:51.960041 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9b4e5e-908f-41c6-9b5d-c5665a0ec98f None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:51.960318 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9b4e5e-908f-41c6-9b5d-c5665a0ec98f None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:51.961674 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 494/996] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:44:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:44:51.964012 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9b4e5e-908f-41c6-9b5d-c5665a0ec98f None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:52.027529 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1602a8-7967-4097-84ae-5f9a82807b71 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:52.061777 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7f4259-a636-4089-9f3b-c3c44058c379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:52.062396 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7f4259-a636-4089-9f3b-c3c44058c379 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:52.062515 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:52.062673 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7f4259-a636-4089-9f3b-c3c44058c379 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:52.062941 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7f4259-a636-4089-9f3b-c3c44058c379 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:52.063544 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7f4259-a636-4089-9f3b-c3c44058c379 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:52.064895 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7f4259-a636-4089-9f3b-c3c44058c379 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:52.066883 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9b4e5e-908f-41c6-9b5d-c5665a0ec98f None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:52.073532 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-bf7f4259-a636-4089-9f3b-c3c44058c379 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 19 14:44:52.073532 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:52.073532 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 14:44:52.073532 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 14:44:52.073532 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 14:44:52.073532 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 14:44:52.073532 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 14:44:52.073532 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:44:52.073532 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 19 14:44:52.073532 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:44:52.073532 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 14:44:52.073532 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:44:52.073532 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:52.073532 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:52.073532 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:52.073532 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:52.073532 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:52.074674 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:52.074674 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:52.074674 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:52.074674 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:52.074674 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:52.074674 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:52.074674 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 14:44:52.074674 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 14:44:52.074674 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 14:44:52.074674 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 14:44:52.074674 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:52.074674 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:52.074674 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:52.074674 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:52.074674 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:52.074674 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:52.075495 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:52.075495 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:52.075495 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:52.075495 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:52.075495 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:52.075495 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:52.075495 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:52.075495 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:52.075495 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:52.075495 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:52.075495 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 14:44:52.075495 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:44:52.075495 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 19 14:44:52.075495 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:44:52.075495 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 503/997] 10.222.0.72 () {56 vars in 1111 bytes} [Mon Sep 19 14:44:51 2022] GET /identity/v3/services/compute => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:44:52.077341 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d90fa0a-45dd-44f8-a0c7-a7042ae1b56a None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:52.077620 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d90fa0a-45dd-44f8-a0c7-a7042ae1b56a None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:52.077893 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d90fa0a-45dd-44f8-a0c7-a7042ae1b56a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:52.095911 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-7d90fa0a-45dd-44f8-a0c7-a7042ae1b56a None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:44:52.097070 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-7d90fa0a-45dd-44f8-a0c7-a7042ae1b56a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:44:52.099763 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:52.104204 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fc1db2-c1b3-43f3-9286-6ad013936a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:52.104831 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc1db2-c1b3-43f3-9286-6ad013936a8e None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:52.105252 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc1db2-c1b3-43f3-9286-6ad013936a8e None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:52.105546 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc1db2-c1b3-43f3-9286-6ad013936a8e None admin] PATH_INFO: `/v3/services` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:52.106770 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fc1db2-c1b3-43f3-9286-6ad013936a8e None admin] RBAC: Adding query filter params (type=image) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:52.107073 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fc1db2-c1b3-43f3-9286-6ad013936a8e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:52.108450 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fc1db2-c1b3-43f3-9286-6ad013936a8e None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:52.113054 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 495/998] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:44:51 2022] GET /identity/v3/services?type=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:44:52.113831 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fc1db2-c1b3-43f3-9286-6ad013936a8e None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:52.177532 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 504/999] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:44:52 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:44:52.231195 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fc1db2-c1b3-43f3-9286-6ad013936a8e None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:52.268629 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f023fbe-ef7c-4103-abd2-e11e8046c8b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:52.269248 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f023fbe-ef7c-4103-abd2-e11e8046c8b1 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:52.269526 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f023fbe-ef7c-4103-abd2-e11e8046c8b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:52.269796 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f023fbe-ef7c-4103-abd2-e11e8046c8b1 None admin] PATH_INFO: `/v3/services` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:52.270433 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f023fbe-ef7c-4103-abd2-e11e8046c8b1 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:52.270734 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f023fbe-ef7c-4103-abd2-e11e8046c8b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:52.272145 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f023fbe-ef7c-4103-abd2-e11e8046c8b1 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:52.282739 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 496/1000] 10.222.0.72 () {56 vars in 1112 bytes} [Mon Sep 19 14:44:52 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:52.284576 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d90fa0a-45dd-44f8-a0c7-a7042ae1b56a None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:52.388544 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d90fa0a-45dd-44f8-a0c7-a7042ae1b56a None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:52.422273 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b3659b-7806-4958-b685-65b9fe7604dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:52.422883 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b3659b-7806-4958-b685-65b9fe7604dc None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:52.423162 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b3659b-7806-4958-b685-65b9fe7604dc None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:52.423431 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b3659b-7806-4958-b685-65b9fe7604dc None admin] PATH_INFO: `/v3/services` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:52.424052 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b3659b-7806-4958-b685-65b9fe7604dc None admin] RBAC: Adding query filter params (type=compute) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:52.424372 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b3659b-7806-4958-b685-65b9fe7604dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:52.425746 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b3659b-7806-4958-b685-65b9fe7604dc None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:52.430752 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 505/1001] 10.222.0.72 () {56 vars in 1112 bytes} [Mon Sep 19 14:44:52 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:52.437348 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f023fbe-ef7c-4103-abd2-e11e8046c8b1 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:52.458578 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b3659b-7806-4958-b685-65b9fe7604dc None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:52.462354 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:52.467694 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:52.549748 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f023fbe-ef7c-4103-abd2-e11e8046c8b1 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:52.565512 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b3659b-7806-4958-b685-65b9fe7604dc None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:52.586296 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a458e94-4658-4206-ab85-781bd295400b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:52.586913 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a458e94-4658-4206-ab85-781bd295400b None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:52.587225 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a458e94-4658-4206-ab85-781bd295400b None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:52.587469 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a458e94-4658-4206-ab85-781bd295400b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:52.588167 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a458e94-4658-4206-ab85-781bd295400b None admin] RBAC: Adding query filter params (interface=public, service_id=7c08f1a0ccaa40f1ae9c0bc25c0fdb4d, region_id=RegionOne) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:52.588501 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a458e94-4658-4206-ab85-781bd295400b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:52.590449 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a458e94-4658-4206-ab85-781bd295400b None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:52.599021 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 497/1002] 10.222.0.72 () {56 vars in 1251 bytes} [Mon Sep 19 14:44:52 2022] GET /identity/v3/endpoints?service_id=7c08f1a0ccaa40f1ae9c0bc25c0fdb4d&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:44:52.601152 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a458e94-4658-4206-ab85-781bd295400b None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:52.605823 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f03185-8d8b-4735-a780-06037000ce30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:52.606461 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f03185-8d8b-4735-a780-06037000ce30 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:52.606743 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f03185-8d8b-4735-a780-06037000ce30 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:52.607075 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f03185-8d8b-4735-a780-06037000ce30 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:52.607657 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f03185-8d8b-4735-a780-06037000ce30 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:52.609029 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f03185-8d8b-4735-a780-06037000ce30 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:52.618240 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-f2f03185-8d8b-4735-a780-06037000ce30 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 14:44:52.618240 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:52.618240 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 14:44:52.618240 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 14:44:52.618240 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 14:44:52.618240 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 14:44:52.618240 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 14:44:52.618240 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:44:52.618240 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 14:44:52.618240 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:44:52.618240 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 14:44:52.618240 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:44:52.618240 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:52.618240 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:52.618240 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:52.618240 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:52.618240 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:52.619419 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:52.619419 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:52.619419 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:52.619419 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:52.619419 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:52.619419 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:52.619419 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 14:44:52.619419 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 14:44:52.619419 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 14:44:52.619419 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 14:44:52.619419 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:52.619419 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:52.619419 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:52.619419 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:52.619419 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:52.619419 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:52.620466 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:52.620466 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:52.620466 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:52.620466 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:52.620466 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:52.620466 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:52.620466 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:52.620466 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:52.620466 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:52.620466 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:52.620466 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 14:44:52.620466 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:44:52.620466 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 14:44:52.620466 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:44:52.622629 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 506/1003] 10.222.0.72 () {56 vars in 1126 bytes} [Mon Sep 19 14:44:52 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:44:52.628545 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f03185-8d8b-4735-a780-06037000ce30 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:52.699601 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:52.702380 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:52.711580 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a458e94-4658-4206-ab85-781bd295400b None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:52.739628 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f03185-8d8b-4735-a780-06037000ce30 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:52.748014 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14395b77-ccba-4284-a780-8ad93ad9343e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:52.748685 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14395b77-ccba-4284-a780-8ad93ad9343e None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:52.748965 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14395b77-ccba-4284-a780-8ad93ad9343e None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:52.749240 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14395b77-ccba-4284-a780-8ad93ad9343e None admin] PATH_INFO: `/v3/services` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:52.749845 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14395b77-ccba-4284-a780-8ad93ad9343e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:52.751352 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14395b77-ccba-4284-a780-8ad93ad9343e None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:52.757981 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 498/1004] 10.222.0.72 () {56 vars in 1087 bytes} [Mon Sep 19 14:44:52 2022] GET /identity/v3/services => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:44:52.779556 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2294b2b4-c9d7-48e2-98be-a399b1d842a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:52.780196 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2294b2b4-c9d7-48e2-98be-a399b1d842a2 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:52.780515 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2294b2b4-c9d7-48e2-98be-a399b1d842a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:52.780792 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2294b2b4-c9d7-48e2-98be-a399b1d842a2 None admin] PATH_INFO: `/v3/services` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:52.781440 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2294b2b4-c9d7-48e2-98be-a399b1d842a2 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:52.781747 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2294b2b4-c9d7-48e2-98be-a399b1d842a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:52.783154 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2294b2b4-c9d7-48e2-98be-a399b1d842a2 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:52.789165 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 507/1005] 10.222.0.72 () {56 vars in 1122 bytes} [Mon Sep 19 14:44:52 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:44:52.795697 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14395b77-ccba-4284-a780-8ad93ad9343e None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:52.911891 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14395b77-ccba-4284-a780-8ad93ad9343e None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:52.950988 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4285faca-aea9-446c-a8d3-c053ad0f27f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:52.951522 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4285faca-aea9-446c-a8d3-c053ad0f27f2 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:52.951799 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4285faca-aea9-446c-a8d3-c053ad0f27f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:52.952071 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4285faca-aea9-446c-a8d3-c053ad0f27f2 None admin] PATH_INFO: `/v3/services` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:52.952731 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4285faca-aea9-446c-a8d3-c053ad0f27f2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:52.953035 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4285faca-aea9-446c-a8d3-c053ad0f27f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:52.954385 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4285faca-aea9-446c-a8d3-c053ad0f27f2 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:52.959513 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 499/1006] 10.222.0.72 () {56 vars in 1122 bytes} [Mon Sep 19 14:44:52 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:52.965918 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2294b2b4-c9d7-48e2-98be-a399b1d842a2 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:53.072581 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2294b2b4-c9d7-48e2-98be-a399b1d842a2 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:53.102188 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:53.108609 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79ea072-536e-4e01-8e78-8bf943fcc310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:53.109217 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79ea072-536e-4e01-8e78-8bf943fcc310 None admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:53.109493 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79ea072-536e-4e01-8e78-8bf943fcc310 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:53.109760 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79ea072-536e-4e01-8e78-8bf943fcc310 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:53.110425 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79ea072-536e-4e01-8e78-8bf943fcc310 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:53.111788 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79ea072-536e-4e01-8e78-8bf943fcc310 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:53.136758 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 508/1007] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Sep 19 14:44:52 2022] POST /identity/v3/endpoints => generated 325 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 14:44:54.329994 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3957901c-9ed1-48b6-9f49-10b759effc9b None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:54.330789 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3957901c-9ed1-48b6-9f49-10b759effc9b None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:54.330789 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3957901c-9ed1-48b6-9f49-10b759effc9b None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:54.332083 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 500/1008] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:44:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:44:54.337688 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589cc68f-9761-4555-bbd3-b3deef4477cd None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:54.338098 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589cc68f-9761-4555-bbd3-b3deef4477cd None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:54.338288 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589cc68f-9761-4555-bbd3-b3deef4477cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:54.357727 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-589cc68f-9761-4555-bbd3-b3deef4477cd None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:44:54.358908 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-589cc68f-9761-4555-bbd3-b3deef4477cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:44:54.431207 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 509/1009] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:44:54 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:44:54.699404 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3957901c-9ed1-48b6-9f49-10b759effc9b None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:54.721673 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:54.803897 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3957901c-9ed1-48b6-9f49-10b759effc9b None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:54.841531 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54282474-0b18-4b8e-9c44-b6572ce295d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:54.842156 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54282474-0b18-4b8e-9c44-b6572ce295d5 None admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:54.842436 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54282474-0b18-4b8e-9c44-b6572ce295d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:54.842708 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54282474-0b18-4b8e-9c44-b6572ce295d5 None admin] PATH_INFO: `/v3/services` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:54.843377 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54282474-0b18-4b8e-9c44-b6572ce295d5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:54.844814 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54282474-0b18-4b8e-9c44-b6572ce295d5 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:54.864128 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 501/1010] 10.222.0.72 () {60 vars in 1141 bytes} [Mon Sep 19 14:44:54 2022] POST /identity/v3/services => generated 242 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:44:54.955475 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a44a412-ab6c-4c2c-85c5-47343268d068 None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:54.955659 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a44a412-ab6c-4c2c-85c5-47343268d068 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:54.955939 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a44a412-ab6c-4c2c-85c5-47343268d068 None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:54.957577 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 510/1011] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:44:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:44:54.963116 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb920ed-7621-413d-bb45-611051b7f1d9 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:54.963414 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb920ed-7621-413d-bb45-611051b7f1d9 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:54.963695 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb920ed-7621-413d-bb45-611051b7f1d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:54.983813 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-8cb920ed-7621-413d-bb45-611051b7f1d9 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:44:54.985074 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-8cb920ed-7621-413d-bb45-611051b7f1d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:44:55.069761 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 502/1012] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:44:54 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 14:44:55.310521 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d652a175-feaf-4889-a79d-b8821af8e428 None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:55.310857 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d652a175-feaf-4889-a79d-b8821af8e428 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:55.311086 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d652a175-feaf-4889-a79d-b8821af8e428 None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:55.312753 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 511/1013] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:44:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:44:55.318103 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9f24e-7f11-41b5-bdc9-0a837cfeb4a7 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:55.318396 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9f24e-7f11-41b5-bdc9-0a837cfeb4a7 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:55.318676 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9f24e-7f11-41b5-bdc9-0a837cfeb4a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:55.330900 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:55.337352 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-2af9f24e-7f11-41b5-bdc9-0a837cfeb4a7 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:44:55.339765 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-2af9f24e-7f11-41b5-bdc9-0a837cfeb4a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:44:55.346067 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d652a175-feaf-4889-a79d-b8821af8e428 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:55.410017 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 503/1014] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:44:55 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:44:55.460350 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d652a175-feaf-4889-a79d-b8821af8e428 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:55.477923 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:55.497366 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aba205-d783-43ff-b9a6-66b9e9cd9678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:55.498001 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aba205-d783-43ff-b9a6-66b9e9cd9678 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:55.498280 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aba205-d783-43ff-b9a6-66b9e9cd9678 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:55.498552 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aba205-d783-43ff-b9a6-66b9e9cd9678 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:55.499131 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aba205-d783-43ff-b9a6-66b9e9cd9678 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:55.500513 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aba205-d783-43ff-b9a6-66b9e9cd9678 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:55.509353 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-c4aba205-d783-43ff-b9a6-66b9e9cd9678 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 19 14:44:55.509353 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:55.509353 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 14:44:55.509353 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 14:44:55.509353 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 14:44:55.509353 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 14:44:55.509353 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 14:44:55.509353 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:44:55.509353 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 19 14:44:55.509353 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:44:55.509353 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 14:44:55.509353 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:44:55.509353 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:55.509353 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:55.509353 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:55.509353 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:55.509353 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:55.510302 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:55.510302 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:55.510302 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:55.510302 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:55.510302 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:55.510302 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:55.510302 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 14:44:55.510302 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 14:44:55.510302 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 14:44:55.510302 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 14:44:55.510302 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:55.510302 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:55.510302 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:55.510302 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:55.510302 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:55.510302 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:55.513337 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:55.513337 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:55.513337 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:55.513337 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:55.513337 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:55.513337 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:55.513337 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:55.513337 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:55.513337 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:55.513337 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:55.513337 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 14:44:55.513337 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:44:55.513337 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 19 14:44:55.513337 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:44:55.513337 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 512/1015] 10.222.0.72 () {56 vars in 1111 bytes} [Mon Sep 19 14:44:55 2022] GET /identity/v3/services/compute => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:44:55.516512 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af9f24e-7f11-41b5-bdc9-0a837cfeb4a7 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:55.620417 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af9f24e-7f11-41b5-bdc9-0a837cfeb4a7 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:55.655469 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feb2baf-c5c8-4a93-aa1f-b17613e49a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:55.656079 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feb2baf-c5c8-4a93-aa1f-b17613e49a73 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:55.656385 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feb2baf-c5c8-4a93-aa1f-b17613e49a73 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:55.656665 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feb2baf-c5c8-4a93-aa1f-b17613e49a73 None admin] PATH_INFO: `/v3/services` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:55.657292 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feb2baf-c5c8-4a93-aa1f-b17613e49a73 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:55.657599 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feb2baf-c5c8-4a93-aa1f-b17613e49a73 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:55.658974 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feb2baf-c5c8-4a93-aa1f-b17613e49a73 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:55.660783 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:55.665150 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 504/1016] 10.222.0.72 () {56 vars in 1112 bytes} [Mon Sep 19 14:44:55 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:44:55.671531 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aba205-d783-43ff-b9a6-66b9e9cd9678 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:55.709927 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feb2baf-c5c8-4a93-aa1f-b17613e49a73 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:55.781328 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aba205-d783-43ff-b9a6-66b9e9cd9678 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:55.817416 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d564297-4311-4b01-949b-2f76e9369457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:55.818017 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d564297-4311-4b01-949b-2f76e9369457 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:55.818287 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d564297-4311-4b01-949b-2f76e9369457 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:55.818558 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d564297-4311-4b01-949b-2f76e9369457 None admin] PATH_INFO: `/v3/services` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:55.819170 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d564297-4311-4b01-949b-2f76e9369457 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:55.819466 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d564297-4311-4b01-949b-2f76e9369457 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:55.820836 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d564297-4311-4b01-949b-2f76e9369457 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:55.825194 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feb2baf-c5c8-4a93-aa1f-b17613e49a73 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:55.826027 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 513/1017] 10.222.0.72 () {56 vars in 1112 bytes} [Mon Sep 19 14:44:55 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:55.831376 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d564297-4311-4b01-949b-2f76e9369457 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:55.861443 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43955478-8eb9-46a4-a55f-4a2d5adbb45d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:55.862145 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43955478-8eb9-46a4-a55f-4a2d5adbb45d None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:55.862425 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43955478-8eb9-46a4-a55f-4a2d5adbb45d None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:55.862693 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43955478-8eb9-46a4-a55f-4a2d5adbb45d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:55.863949 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43955478-8eb9-46a4-a55f-4a2d5adbb45d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:55.865260 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43955478-8eb9-46a4-a55f-4a2d5adbb45d None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:55.866957 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 505/1018] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:44:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:44:55.873179 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43955478-8eb9-46a4-a55f-4a2d5adbb45d None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:55.881768 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:55.944254 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:55.950122 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d564297-4311-4b01-949b-2f76e9369457 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:55.978112 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43955478-8eb9-46a4-a55f-4a2d5adbb45d None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:55.989474 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0be44c0-84b8-4430-b9d8-f500132b02b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:55.990077 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0be44c0-84b8-4430-b9d8-f500132b02b5 None admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:55.990353 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0be44c0-84b8-4430-b9d8-f500132b02b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:55.990618 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0be44c0-84b8-4430-b9d8-f500132b02b5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:55.991334 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0be44c0-84b8-4430-b9d8-f500132b02b5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:55.993511 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0be44c0-84b8-4430-b9d8-f500132b02b5 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:56.015168 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 514/1019] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Sep 19 14:44:55 2022] POST /identity/v3/endpoints => generated 334 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 14:44:56.023141 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea8a037-eba3-469f-81d2-af7a7ac62a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:56.023770 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea8a037-eba3-469f-81d2-af7a7ac62a7a None admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:56.024167 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea8a037-eba3-469f-81d2-af7a7ac62a7a None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:56.024542 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea8a037-eba3-469f-81d2-af7a7ac62a7a None admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:56.025211 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea8a037-eba3-469f-81d2-af7a7ac62a7a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:56.026943 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea8a037-eba3-469f-81d2-af7a7ac62a7a None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:56.068357 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 506/1020] 10.222.0.72 () {60 vars in 1141 bytes} [Mon Sep 19 14:44:55 2022] POST /identity/v3/projects => generated 311 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 14:44:57.110220 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3407177-d32a-4d59-8ded-dc5188e18cc4 None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:57.110735 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3407177-d32a-4d59-8ded-dc5188e18cc4 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:57.111017 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3407177-d32a-4d59-8ded-dc5188e18cc4 None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:57.115029 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 515/1021] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:44:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:44:57.118199 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07bc7e1-f7f9-4e98-a1c1-0b5cc70fbf78 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:57.118636 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07bc7e1-f7f9-4e98-a1c1-0b5cc70fbf78 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:57.118772 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07bc7e1-f7f9-4e98-a1c1-0b5cc70fbf78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:57.142501 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-e07bc7e1-f7f9-4e98-a1c1-0b5cc70fbf78 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:44:57.143710 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-e07bc7e1-f7f9-4e98-a1c1-0b5cc70fbf78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:44:57.224354 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 507/1022] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:44:57 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:44:57.538991 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3407177-d32a-4d59-8ded-dc5188e18cc4 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:57.658374 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3407177-d32a-4d59-8ded-dc5188e18cc4 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:57.659936 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:57.696840 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5808c0-58df-42ea-9dff-61c4eb1ff678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:57.697471 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5808c0-58df-42ea-9dff-61c4eb1ff678 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:57.697751 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5808c0-58df-42ea-9dff-61c4eb1ff678 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:57.698025 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5808c0-58df-42ea-9dff-61c4eb1ff678 None admin] PATH_INFO: `/v3/services/image` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:57.698609 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5808c0-58df-42ea-9dff-61c4eb1ff678 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:57.700462 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5808c0-58df-42ea-9dff-61c4eb1ff678 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:57.709356 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-8c5808c0-58df-42ea-9dff-61c4eb1ff678 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 19 14:44:57.709356 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:57.709356 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 14:44:57.709356 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 14:44:57.709356 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 14:44:57.709356 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 14:44:57.709356 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 14:44:57.709356 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:44:57.709356 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 19 14:44:57.709356 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:44:57.709356 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 14:44:57.709356 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:44:57.709356 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:57.709356 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:57.709356 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:57.709356 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:57.709356 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:57.710291 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:57.710291 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:57.710291 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:57.710291 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:57.710291 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:57.710291 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:57.710291 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 14:44:57.710291 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 14:44:57.710291 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 14:44:57.710291 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 14:44:57.710291 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:57.710291 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:57.710291 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:57.710291 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:57.710291 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:57.710291 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:57.711124 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:57.711124 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:57.711124 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:57.711124 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:57.711124 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:57.711124 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:57.711124 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:57.711124 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:57.711124 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:57.711124 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:57.711124 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 14:44:57.711124 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:44:57.711124 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 19 14:44:57.711124 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:44:57.716066 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 516/1023] 10.222.0.72 () {56 vars in 1105 bytes} [Mon Sep 19 14:44:57 2022] GET /identity/v3/services/image => generated 86 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:57.717323 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07bc7e1-f7f9-4e98-a1c1-0b5cc70fbf78 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:57.766094 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:57.822575 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07bc7e1-f7f9-4e98-a1c1-0b5cc70fbf78 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:57.857923 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28fd5df-7947-439d-bfd5-830ff613622b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:57.858521 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28fd5df-7947-439d-bfd5-830ff613622b None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:57.858794 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28fd5df-7947-439d-bfd5-830ff613622b None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:57.859059 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28fd5df-7947-439d-bfd5-830ff613622b None admin] PATH_INFO: `/v3/services` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:57.859674 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28fd5df-7947-439d-bfd5-830ff613622b None admin] RBAC: Adding query filter params (name=image) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:57.860317 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28fd5df-7947-439d-bfd5-830ff613622b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:57.861711 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28fd5df-7947-439d-bfd5-830ff613622b None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:57.872219 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 508/1024] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:44:57 2022] GET /identity/v3/services?name=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:57.873538 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5808c0-58df-42ea-9dff-61c4eb1ff678 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:57.989396 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5808c0-58df-42ea-9dff-61c4eb1ff678 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:58.022980 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3c5266-1432-4c35-b27f-e63df6c11270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:58.023589 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3c5266-1432-4c35-b27f-e63df6c11270 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:58.023873 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3c5266-1432-4c35-b27f-e63df6c11270 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:58.024145 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3c5266-1432-4c35-b27f-e63df6c11270 None admin] PATH_INFO: `/v3/services` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:58.024806 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3c5266-1432-4c35-b27f-e63df6c11270 None admin] RBAC: Adding query filter params (type=image) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:58.025112 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3c5266-1432-4c35-b27f-e63df6c11270 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:58.026475 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3c5266-1432-4c35-b27f-e63df6c11270 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:58.032415 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 517/1025] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:44:57 2022] GET /identity/v3/services?type=image => generated 350 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:58.038265 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28fd5df-7947-439d-bfd5-830ff613622b None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:58.140391 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28fd5df-7947-439d-bfd5-830ff613622b None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:58.151156 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:58.176940 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a17036-1175-4ae1-9ea7-bea833949c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:58.177551 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a17036-1175-4ae1-9ea7-bea833949c84 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:58.177832 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a17036-1175-4ae1-9ea7-bea833949c84 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:58.178105 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a17036-1175-4ae1-9ea7-bea833949c84 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:58.178803 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a17036-1175-4ae1-9ea7-bea833949c84 None admin] RBAC: Adding query filter params (interface=public, service_id=7552ab10d0364137bc9c3fb459c7372a, region_id=RegionOne) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:58.179113 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a17036-1175-4ae1-9ea7-bea833949c84 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:58.180531 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a17036-1175-4ae1-9ea7-bea833949c84 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:58.191460 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 509/1026] 10.222.0.72 () {56 vars in 1251 bytes} [Mon Sep 19 14:44:58 2022] GET /identity/v3/endpoints?service_id=7552ab10d0364137bc9c3fb459c7372a&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:58.193290 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3c5266-1432-4c35-b27f-e63df6c11270 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:58.235864 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:58.316364 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5d8079-aa8a-4b2a-9137-f9572b8ea3c5 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:58.316364 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5d8079-aa8a-4b2a-9137-f9572b8ea3c5 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:58.316364 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5d8079-aa8a-4b2a-9137-f9572b8ea3c5 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:58.316748 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3c5266-1432-4c35-b27f-e63df6c11270 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:58.323230 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 510/1027] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:44:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 14:44:58.323230 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd397d8-2973-467c-9089-b5ffa37e7eb6 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:58.323230 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd397d8-2973-467c-9089-b5ffa37e7eb6 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:58.323230 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd397d8-2973-467c-9089-b5ffa37e7eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:58.348936 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-dbd397d8-2973-467c-9089-b5ffa37e7eb6 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:44:58.350551 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-dbd397d8-2973-467c-9089-b5ffa37e7eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:44:58.361885 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76460cf8-ad08-4ad5-bb8a-bf31b6f99b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:58.362780 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76460cf8-ad08-4ad5-bb8a-bf31b6f99b2f None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:58.363816 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76460cf8-ad08-4ad5-bb8a-bf31b6f99b2f None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:58.364258 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76460cf8-ad08-4ad5-bb8a-bf31b6f99b2f None admin] PATH_INFO: `/v3/services` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:58.365530 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76460cf8-ad08-4ad5-bb8a-bf31b6f99b2f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:58.367441 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76460cf8-ad08-4ad5-bb8a-bf31b6f99b2f None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:58.384432 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 518/1028] 10.222.0.72 () {56 vars in 1087 bytes} [Mon Sep 19 14:44:58 2022] GET /identity/v3/services => generated 1957 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 14:44:58.453556 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 511/1029] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:44:58 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:44:58.470156 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b5077-db60-4232-8905-bdcb04f717fb None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:58.470475 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b5077-db60-4232-8905-bdcb04f717fb None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:58.472371 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b5077-db60-4232-8905-bdcb04f717fb None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:58.472371 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 519/1030] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:44:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:44:58.478070 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bdc393-15b0-4a81-a26f-4bd3c4d2475e None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:58.478355 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bdc393-15b0-4a81-a26f-4bd3c4d2475e None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:58.478634 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bdc393-15b0-4a81-a26f-4bd3c4d2475e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:58.497521 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-41bdc393-15b0-4a81-a26f-4bd3c4d2475e None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:44:58.498735 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-41bdc393-15b0-4a81-a26f-4bd3c4d2475e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:44:58.580204 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 512/1031] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:44:58 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:44:58.728469 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3b5077-db60-4232-8905-bdcb04f717fb None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:58.825913 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:58.834715 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3b5077-db60-4232-8905-bdcb04f717fb None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:58.853014 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bdc393-15b0-4a81-a26f-4bd3c4d2475e None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:58.875022 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06815a67-96ba-4aa1-8e1e-87f9579a21e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:58.876134 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06815a67-96ba-4aa1-8e1e-87f9579a21e7 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:58.876452 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06815a67-96ba-4aa1-8e1e-87f9579a21e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:58.876734 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06815a67-96ba-4aa1-8e1e-87f9579a21e7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:58.878009 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06815a67-96ba-4aa1-8e1e-87f9579a21e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:58.879981 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06815a67-96ba-4aa1-8e1e-87f9579a21e7 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:58.884570 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 520/1032] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:44:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:58.888028 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06815a67-96ba-4aa1-8e1e-87f9579a21e7 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:58.892888 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:58.963902 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bdc393-15b0-4a81-a26f-4bd3c4d2475e None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:58.996499 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06815a67-96ba-4aa1-8e1e-87f9579a21e7 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:58.998783 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cebc785-9f03-4060-90ac-bc98e2c8a339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:58.999417 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cebc785-9f03-4060-90ac-bc98e2c8a339 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:58.999700 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cebc785-9f03-4060-90ac-bc98e2c8a339 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:58.999972 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cebc785-9f03-4060-90ac-bc98e2c8a339 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:59.010069 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cebc785-9f03-4060-90ac-bc98e2c8a339 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:44:59.015702 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-4cebc785-9f03-4060-90ac-bc98e2c8a339 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 14:44:59.015702 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:59.015702 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:59.015702 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:59.015702 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:59.015702 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:59.015702 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:59.015702 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:59.015702 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:59.015702 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:59.015702 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:59.015702 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:59.015702 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:44:59.015702 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:44:59.015702 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:44:59.015702 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:44:59.016650 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:44:59.016650 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:44:59.016650 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:44:59.016650 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:44:59.016650 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:59.016650 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:59.016650 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:59.016650 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:59.016650 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:59.016650 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:59.016650 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:59.016650 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:59.016650 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:59.016650 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:59.016650 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:59.016650 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:59.017521 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:59.017521 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:59.017521 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:59.017521 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:59.017521 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:44:59.017521 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:44:59.017521 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:44:59.017521 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:44:59.017521 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:44:59.017521 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:44:59.017521 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 14:44:59.017521 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:44:59.017521 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 513/1033] 10.222.0.72 () {56 vars in 1120 bytes} [Mon Sep 19 14:44:58 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:59.022543 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cebc785-9f03-4060-90ac-bc98e2c8a339 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:59.038633 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fdd678-78a2-4c34-aaa7-a42b4aee9a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:59.039239 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fdd678-78a2-4c34-aaa7-a42b4aee9a62 None admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:59.039518 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fdd678-78a2-4c34-aaa7-a42b4aee9a62 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:59.039802 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fdd678-78a2-4c34-aaa7-a42b4aee9a62 None admin] PATH_INFO: `/v3/users` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:59.040475 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fdd678-78a2-4c34-aaa7-a42b4aee9a62 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:59.041904 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fdd678-78a2-4c34-aaa7-a42b4aee9a62 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:59.064843 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 521/1034] 10.222.0.72 () {60 vars in 1132 bytes} [Mon Sep 19 14:44:58 2022] POST /identity/v3/users => generated 285 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 14:44:59.143304 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:59.154085 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cebc785-9f03-4060-90ac-bc98e2c8a339 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:59.192497 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9024fab7-054a-40eb-86d7-58d00219b81b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:59.193122 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9024fab7-054a-40eb-86d7-58d00219b81b None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:59.193406 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9024fab7-054a-40eb-86d7-58d00219b81b None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:59.193681 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9024fab7-054a-40eb-86d7-58d00219b81b None admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:59.194358 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9024fab7-054a-40eb-86d7-58d00219b81b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:59.194664 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9024fab7-054a-40eb-86d7-58d00219b81b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:59.196147 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9024fab7-054a-40eb-86d7-58d00219b81b None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:59.206201 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 514/1035] 10.222.0.72 () {56 vars in 1115 bytes} [Mon Sep 19 14:44:59 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:44:59.212020 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fdd678-78a2-4c34-aaa7-a42b4aee9a62 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:59.233578 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:59.328557 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fdd678-78a2-4c34-aaa7-a42b4aee9a62 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:59.363060 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a67db8-02b3-41e9-a502-f30c2d5e4099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:59.363694 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a67db8-02b3-41e9-a502-f30c2d5e4099 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:59.363984 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a67db8-02b3-41e9-a502-f30c2d5e4099 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:59.364256 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a67db8-02b3-41e9-a502-f30c2d5e4099 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:59.375687 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a67db8-02b3-41e9-a502-f30c2d5e4099 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:59.377151 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a67db8-02b3-41e9-a502-f30c2d5e4099 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:59.391657 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-c9a67db8-02b3-41e9-a502-f30c2d5e4099 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:44:59.391657 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:59.391657 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:59.391657 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:59.391657 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:59.391657 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:59.391657 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:59.391657 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:59.391657 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:59.391657 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:59.391657 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:59.391657 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:59.391657 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:44:59.391657 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:44:59.391657 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:44:59.391657 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:44:59.392827 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:59.392827 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:59.392827 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:59.392827 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:59.392827 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:59.392827 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:59.392827 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:59.392827 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:59.392827 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:59.392827 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:59.392827 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:59.392827 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:59.392827 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:59.392827 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:59.392827 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:59.392827 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:59.392827 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:44:59.393754 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:44:59.393754 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:44:59.393754 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:44:59.393754 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 522/1036] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:44:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:59.400025 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9024fab7-054a-40eb-86d7-58d00219b81b None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:59.503298 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9024fab7-054a-40eb-86d7-58d00219b81b None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:59.537997 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a24eee3-f69a-46d2-96f4-3d9bee878a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:59.538600 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a24eee3-f69a-46d2-96f4-3d9bee878a44 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:59.538874 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a24eee3-f69a-46d2-96f4-3d9bee878a44 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:59.539141 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a24eee3-f69a-46d2-96f4-3d9bee878a44 None admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:59.539774 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a24eee3-f69a-46d2-96f4-3d9bee878a44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:59.540070 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a24eee3-f69a-46d2-96f4-3d9bee878a44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:59.541464 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a24eee3-f69a-46d2-96f4-3d9bee878a44 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:59.554015 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 515/1037] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Sep 19 14:44:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:44:59.559900 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a67db8-02b3-41e9-a502-f30c2d5e4099 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:59.634715 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:59.668405 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a67db8-02b3-41e9-a502-f30c2d5e4099 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:59.702821 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750571c1-bd33-4925-8456-9a1048765a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:59.703460 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750571c1-bd33-4925-8456-9a1048765a1f None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:59.703739 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750571c1-bd33-4925-8456-9a1048765a1f None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:59.704009 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750571c1-bd33-4925-8456-9a1048765a1f None admin] PATH_INFO: `/v3/users/nova` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:59.711448 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750571c1-bd33-4925-8456-9a1048765a1f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:59.712919 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750571c1-bd33-4925-8456-9a1048765a1f None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:59.724556 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-750571c1-bd33-4925-8456-9a1048765a1f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 19 14:44:59.724556 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:59.724556 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:59.724556 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:59.724556 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:59.724556 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:59.724556 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:59.724556 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:59.724556 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:59.724556 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:59.724556 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:59.724556 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:59.724556 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 14:44:59.724556 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 14:44:59.724556 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 14:44:59.724556 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 14:44:59.725503 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:59.725503 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:59.725503 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:44:59.725503 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:44:59.725503 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:44:59.725503 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:44:59.725503 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:59.725503 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:59.725503 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:59.725503 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:59.725503 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:59.725503 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:59.725503 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:59.725503 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:59.725503 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:59.725503 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:59.725503 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:59.725503 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:59.732438 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:59.732438 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:59.732438 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 14:44:59.732438 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 14:44:59.732438 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 14:44:59.732438 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 14:44:59.732438 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 14:44:59.732438 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 14:44:59.732438 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 19 14:44:59.732438 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:44:59.732438 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 523/1038] 10.222.0.72 () {56 vars in 1093 bytes} [Mon Sep 19 14:44:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:44:59.733037 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a24eee3-f69a-46d2-96f4-3d9bee878a44 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:59.752016 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:59.837599 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a24eee3-f69a-46d2-96f4-3d9bee878a44 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:59.873824 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967794e6-f98f-4c4e-b605-24e48a0cc123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:59.874430 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967794e6-f98f-4c4e-b605-24e48a0cc123 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:59.874712 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967794e6-f98f-4c4e-b605-24e48a0cc123 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:59.874986 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967794e6-f98f-4c4e-b605-24e48a0cc123 None admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:59.875710 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967794e6-f98f-4c4e-b605-24e48a0cc123 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:59.876018 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967794e6-f98f-4c4e-b605-24e48a0cc123 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:59.877492 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967794e6-f98f-4c4e-b605-24e48a0cc123 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:59.899960 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 516/1039] 10.222.0.72 () {56 vars in 1133 bytes} [Mon Sep 19 14:44:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:44:59.901582 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750571c1-bd33-4925-8456-9a1048765a1f None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:00.008647 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750571c1-bd33-4925-8456-9a1048765a1f None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:00.038866 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:00.046289 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b32eb7e-95ce-4a36-bb55-578a9033434a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:00.046907 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b32eb7e-95ce-4a36-bb55-578a9033434a None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:00.047188 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b32eb7e-95ce-4a36-bb55-578a9033434a None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:00.047462 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b32eb7e-95ce-4a36-bb55-578a9033434a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:00.115356 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b32eb7e-95ce-4a36-bb55-578a9033434a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:00.117173 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b32eb7e-95ce-4a36-bb55-578a9033434a None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:00.220090 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 524/1040] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Sep 19 14:44:59 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 14:45:00.222306 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967794e6-f98f-4c4e-b605-24e48a0cc123 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:00.301686 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:00.332537 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967794e6-f98f-4c4e-b605-24e48a0cc123 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:00.367478 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d0d3fe-8e47-4391-98da-defd028f841d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:00.368129 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d0d3fe-8e47-4391-98da-defd028f841d None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:00.368456 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d0d3fe-8e47-4391-98da-defd028f841d None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:00.368727 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d0d3fe-8e47-4391-98da-defd028f841d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:00.378869 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d0d3fe-8e47-4391-98da-defd028f841d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:00.380302 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d0d3fe-8e47-4391-98da-defd028f841d None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:00.395368 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-40d0d3fe-8e47-4391-98da-defd028f841d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:45:00.395368 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:45:00.395368 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:45:00.395368 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:45:00.395368 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:45:00.395368 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:45:00.395368 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:45:00.395368 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:45:00.395368 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:45:00.395368 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:45:00.395368 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:45:00.395368 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:45:00.395368 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:45:00.395368 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:45:00.395368 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:45:00.395368 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:45:00.396399 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:45:00.396399 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:45:00.396399 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:45:00.396399 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:45:00.396399 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:45:00.396399 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:45:00.396399 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:45:00.396399 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:45:00.396399 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:45:00.396399 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:45:00.396399 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:45:00.396399 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:45:00.396399 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:45:00.396399 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:45:00.396399 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:45:00.396399 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:45:00.396399 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:45:00.402746 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:45:00.402746 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:45:00.402746 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:45:00.402746 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 517/1041] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:45:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:45:00.404703 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b32eb7e-95ce-4a36-bb55-578a9033434a None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:00.435846 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:00.512016 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b32eb7e-95ce-4a36-bb55-578a9033434a None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:00.548715 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a58c75-7257-46b3-95de-dc22f6c0bd70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:00.549327 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a58c75-7257-46b3-95de-dc22f6c0bd70 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:00.549659 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a58c75-7257-46b3-95de-dc22f6c0bd70 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:00.549938 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a58c75-7257-46b3-95de-dc22f6c0bd70 None admin] PATH_INFO: `/v3/domains` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:00.550577 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a58c75-7257-46b3-95de-dc22f6c0bd70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:45:00.550880 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a58c75-7257-46b3-95de-dc22f6c0bd70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:00.552320 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a58c75-7257-46b3-95de-dc22f6c0bd70 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:00.568486 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 525/1042] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Sep 19 14:45:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:45:00.570005 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d0d3fe-8e47-4391-98da-defd028f841d None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:00.592885 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd0a27f-94b0-4ff8-84a6-6e3b3e9b6291 None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:00.593171 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd0a27f-94b0-4ff8-84a6-6e3b3e9b6291 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:00.593452 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd0a27f-94b0-4ff8-84a6-6e3b3e9b6291 None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:00.595350 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 526/1043] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:45:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 14:45:00.600661 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c1ba21-d05f-460d-a237-c8d70686c69c None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:00.601292 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c1ba21-d05f-460d-a237-c8d70686c69c None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:00.601782 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c1ba21-d05f-460d-a237-c8d70686c69c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:00.621039 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-36c1ba21-d05f-460d-a237-c8d70686c69c None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:45:00.622591 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-36c1ba21-d05f-460d-a237-c8d70686c69c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:45:00.673716 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d0d3fe-8e47-4391-98da-defd028f841d None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:00.695153 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 527/1044] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:45:00 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 14:45:00.701009 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:00.709442 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75641cf4-1fc8-46ce-a167-f113120d0610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:00.710151 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75641cf4-1fc8-46ce-a167-f113120d0610 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:00.710505 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75641cf4-1fc8-46ce-a167-f113120d0610 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:00.710854 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75641cf4-1fc8-46ce-a167-f113120d0610 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:00.718209 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75641cf4-1fc8-46ce-a167-f113120d0610 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:00.719738 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75641cf4-1fc8-46ce-a167-f113120d0610 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:00.731705 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-75641cf4-1fc8-46ce-a167-f113120d0610 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:45:00.731705 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:45:00.731705 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:45:00.731705 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:45:00.731705 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:45:00.731705 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:45:00.731705 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:45:00.731705 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:45:00.731705 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:45:00.731705 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:45:00.731705 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:45:00.731705 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:45:00.731705 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 14:45:00.731705 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 14:45:00.731705 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 14:45:00.732643 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 14:45:00.732643 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:45:00.732643 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:45:00.732643 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:45:00.732643 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:45:00.732643 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:45:00.732643 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:45:00.732643 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:45:00.732643 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:45:00.732643 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:45:00.732643 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:45:00.732643 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:45:00.732643 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:45:00.732643 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:45:00.732643 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:45:00.732643 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:45:00.732643 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:45:00.738401 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 14:45:00.738401 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 14:45:00.738401 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:45:00.738401 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:45:00.738401 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:45:00.738401 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:45:00.738401 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:45:00.738401 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:45:00.738401 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 518/1045] 10.222.0.72 () {56 vars in 1111 bytes} [Mon Sep 19 14:45:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:45:00.740514 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c1ba21-d05f-460d-a237-c8d70686c69c None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:00.764162 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:00.847925 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c1ba21-d05f-460d-a237-c8d70686c69c None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:00.883686 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac433b20-e932-43eb-a57b-512c257dc564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:00.884299 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac433b20-e932-43eb-a57b-512c257dc564 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:00.884610 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac433b20-e932-43eb-a57b-512c257dc564 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:00.884881 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac433b20-e932-43eb-a57b-512c257dc564 None admin] PATH_INFO: `/v3/projects` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:00.885568 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac433b20-e932-43eb-a57b-512c257dc564 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:45:00.885872 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac433b20-e932-43eb-a57b-512c257dc564 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:00.887433 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac433b20-e932-43eb-a57b-512c257dc564 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:00.903769 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 528/1046] 10.222.0.72 () {56 vars in 1148 bytes} [Mon Sep 19 14:45:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:45:00.911200 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75641cf4-1fc8-46ce-a167-f113120d0610 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:00.963013 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac433b20-e932-43eb-a57b-512c257dc564 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:01.020976 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75641cf4-1fc8-46ce-a167-f113120d0610 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:01.061323 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b7a3d6-319c-4419-95d5-724190e043a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:01.061561 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:01.061928 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b7a3d6-319c-4419-95d5-724190e043a5 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:01.062211 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b7a3d6-319c-4419-95d5-724190e043a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:01.062490 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b7a3d6-319c-4419-95d5-724190e043a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:01.063223 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b7a3d6-319c-4419-95d5-724190e043a5 None admin] RBAC: Adding query filter params (role.id=3ff0804c348f4f9fb91749835805a83a, scope.project.id=51af3a14d665498c9b7a35b34dac0ef1, user.id=055439dc35e946f4a82535c684f9b60d) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:45:01.063552 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b7a3d6-319c-4419-95d5-724190e043a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:01.065000 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b7a3d6-319c-4419-95d5-724190e043a5 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:01.080892 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 519/1047] 10.222.0.72 () {56 vars in 1374 bytes} [Mon Sep 19 14:45:00 2022] GET /identity/v3/role_assignments?user.id=055439dc35e946f4a82535c684f9b60d&scope.project.id=51af3a14d665498c9b7a35b34dac0ef1&role.id=3ff0804c348f4f9fb91749835805a83a => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:45:01.083774 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac433b20-e932-43eb-a57b-512c257dc564 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:01.122420 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dba7906-06de-4d6b-a24f-6870b081ad80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:01.123071 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dba7906-06de-4d6b-a24f-6870b081ad80 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:01.123351 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dba7906-06de-4d6b-a24f-6870b081ad80 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:01.123624 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dba7906-06de-4d6b-a24f-6870b081ad80 None admin] PATH_INFO: `/v3/services/image` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:01.124220 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dba7906-06de-4d6b-a24f-6870b081ad80 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:01.125664 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dba7906-06de-4d6b-a24f-6870b081ad80 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:01.135462 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-3dba7906-06de-4d6b-a24f-6870b081ad80 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 19 14:45:01.135462 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:45:01.135462 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 14:45:01.135462 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 14:45:01.135462 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 14:45:01.135462 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 14:45:01.135462 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 14:45:01.135462 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:45:01.135462 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 19 14:45:01.135462 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:45:01.135462 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 14:45:01.135462 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:45:01.135462 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:45:01.135462 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:45:01.135462 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:45:01.135462 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:45:01.135462 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:45:01.136851 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:45:01.136851 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:45:01.136851 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:45:01.136851 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:45:01.136851 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:45:01.136851 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:45:01.136851 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 14:45:01.136851 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 14:45:01.136851 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 14:45:01.136851 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 14:45:01.136851 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:45:01.136851 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:45:01.136851 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:45:01.136851 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:45:01.136851 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:45:01.136851 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:45:01.137696 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:45:01.137696 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:45:01.137696 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:45:01.137696 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:45:01.137696 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:45:01.137696 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:45:01.137696 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:45:01.137696 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:45:01.137696 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:45:01.137696 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:45:01.137696 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 14:45:01.137696 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:45:01.137696 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 19 14:45:01.137696 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:45:01.140713 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 529/1048] 10.222.0.72 () {56 vars in 1105 bytes} [Mon Sep 19 14:45:00 2022] GET /identity/v3/services/image => generated 86 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:45:01.142777 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b7a3d6-319c-4419-95d5-724190e043a5 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:01.201814 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:01.261645 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b7a3d6-319c-4419-95d5-724190e043a5 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:01.297526 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47ebf2f-143b-4863-851f-9dc200d6c9f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:01.298059 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47ebf2f-143b-4863-851f-9dc200d6c9f0 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:01.298339 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47ebf2f-143b-4863-851f-9dc200d6c9f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:01.298613 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47ebf2f-143b-4863-851f-9dc200d6c9f0 None admin] PATH_INFO: `/v3/services` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:01.299242 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47ebf2f-143b-4863-851f-9dc200d6c9f0 None admin] RBAC: Adding query filter params (name=image) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:45:01.299544 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47ebf2f-143b-4863-851f-9dc200d6c9f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:01.300997 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47ebf2f-143b-4863-851f-9dc200d6c9f0 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:01.311137 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 520/1049] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:45:01 2022] GET /identity/v3/services?name=image => generated 122 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:45:01.311298 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8da9d8-8a9b-4ffa-96b1-7fbd7bca6871 None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:01.311298 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8da9d8-8a9b-4ffa-96b1-7fbd7bca6871 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:01.311298 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8da9d8-8a9b-4ffa-96b1-7fbd7bca6871 None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:01.312372 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47ebf2f-143b-4863-851f-9dc200d6c9f0 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:01.312507 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 530/1050] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:45:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 14:45:01.318576 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dea093-f521-4e9d-8cf9-f3b7d47d5415 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:01.318859 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dea093-f521-4e9d-8cf9-f3b7d47d5415 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:01.319135 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dea093-f521-4e9d-8cf9-f3b7d47d5415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:01.339453 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-18dea093-f521-4e9d-8cf9-f3b7d47d5415 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:45:01.340676 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-18dea093-f521-4e9d-8cf9-f3b7d47d5415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:45:01.414993 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 531/1051] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:45:01 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 14:45:01.426180 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47ebf2f-143b-4863-851f-9dc200d6c9f0 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:01.441095 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:01.462869 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2790f242-4fd0-4ca0-a0af-c815e8d1b4ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:01.463474 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2790f242-4fd0-4ca0-a0af-c815e8d1b4ae None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:01.463752 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2790f242-4fd0-4ca0-a0af-c815e8d1b4ae None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:01.464023 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2790f242-4fd0-4ca0-a0af-c815e8d1b4ae None admin] PATH_INFO: `/v3/services` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:01.465219 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2790f242-4fd0-4ca0-a0af-c815e8d1b4ae None admin] RBAC: Adding query filter params (type=image) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:45:01.465639 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2790f242-4fd0-4ca0-a0af-c815e8d1b4ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:01.466994 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2790f242-4fd0-4ca0-a0af-c815e8d1b4ae None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:01.476757 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 521/1052] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:45:01 2022] GET /identity/v3/services?type=image => generated 350 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:45:01.477542 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dea093-f521-4e9d-8cf9-f3b7d47d5415 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:01.554352 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:01.581581 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dea093-f521-4e9d-8cf9-f3b7d47d5415 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:01.615441 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328a9b20-73a0-450a-be10-eede9bb027f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:01.616047 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328a9b20-73a0-450a-be10-eede9bb027f7 None admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:01.616355 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328a9b20-73a0-450a-be10-eede9bb027f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:01.616618 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328a9b20-73a0-450a-be10-eede9bb027f7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:01.617279 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328a9b20-73a0-450a-be10-eede9bb027f7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:01.618626 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328a9b20-73a0-450a-be10-eede9bb027f7 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:01.644363 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 532/1053] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Sep 19 14:45:01 2022] POST /identity/v3/endpoints => generated 327 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 14:45:01.686096 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2790f242-4fd0-4ca0-a0af-c815e8d1b4ae None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:01.797312 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2790f242-4fd0-4ca0-a0af-c815e8d1b4ae None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:01.842033 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb65fb17-3474-43ce-ad66-b491b25692da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:01.842592 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb65fb17-3474-43ce-ad66-b491b25692da None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:01.842871 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb65fb17-3474-43ce-ad66-b491b25692da None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:01.843143 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb65fb17-3474-43ce-ad66-b491b25692da None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:01.853973 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb65fb17-3474-43ce-ad66-b491b25692da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:45:01.859073 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-cb65fb17-3474-43ce-ad66-b491b25692da None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:45:01.859073 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:45:01.859073 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:45:01.859073 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:45:01.859073 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:45:01.859073 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:45:01.859073 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:45:01.859073 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:45:01.859073 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:45:01.859073 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:45:01.859073 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:45:01.859073 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:45:01.859073 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:45:01.859073 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:45:01.859073 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:45:01.859073 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:45:01.860007 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:45:01.860007 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:45:01.860007 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:45:01.860007 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:45:01.860007 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:45:01.860007 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:45:01.860007 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:45:01.860007 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:45:01.860007 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:45:01.860007 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:45:01.860007 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:45:01.860007 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:45:01.860007 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:45:01.860007 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:45:01.860007 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:45:01.860007 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:45:01.860998 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:45:01.860998 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:45:01.860998 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:45:01.860998 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:45:01.860998 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:45:01.860998 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:45:01.860998 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:45:01.860998 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:45:01.860998 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:45:01.860998 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:45:01.860998 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:45:01.860998 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:45:01.864436 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 522/1054] 10.222.0.72 () {56 vars in 1096 bytes} [Mon Sep 19 14:45:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:45:01.866953 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328a9b20-73a0-450a-be10-eede9bb027f7 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:01.976245 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328a9b20-73a0-450a-be10-eede9bb027f7 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:02.005524 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:02.013078 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1f816d-a301-4530-8312-ee48469094d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:02.013991 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1f816d-a301-4530-8312-ee48469094d1 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:02.014613 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1f816d-a301-4530-8312-ee48469094d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:02.014883 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1f816d-a301-4530-8312-ee48469094d1 None admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:02.015553 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1f816d-a301-4530-8312-ee48469094d1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:45:02.015856 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1f816d-a301-4530-8312-ee48469094d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:02.017242 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1f816d-a301-4530-8312-ee48469094d1 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:02.030910 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 533/1055] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Sep 19 14:45:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:45:02.032592 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb65fb17-3474-43ce-ad66-b491b25692da None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:02.068126 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:02.135522 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb65fb17-3474-43ce-ad66-b491b25692da None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:02.171721 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecfc2dd-e583-4e52-89c6-e428eb844a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:02.172455 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecfc2dd-e583-4e52-89c6-e428eb844a1c None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:02.172742 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecfc2dd-e583-4e52-89c6-e428eb844a1c None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:02.173020 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecfc2dd-e583-4e52-89c6-e428eb844a1c None admin] PATH_INFO: `/v3/users/0c9152a0338f4952b44236221db28b77` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:02.187974 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecfc2dd-e583-4e52-89c6-e428eb844a1c None admin] RBAC: Authorizing `identity:get_user(user_id=0c9152a0338f4952b44236221db28b77)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:02.189462 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecfc2dd-e583-4e52-89c6-e428eb844a1c None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:02.195992 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 523/1056] 10.222.0.72 () {56 vars in 1177 bytes} [Mon Sep 19 14:45:02 2022] GET /identity/v3/users/0c9152a0338f4952b44236221db28b77 => generated 285 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:45:02.197463 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1f816d-a301-4530-8312-ee48469094d1 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:02.306610 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1f816d-a301-4530-8312-ee48469094d1 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:02.342764 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fdf381-06b2-4aca-99aa-689e806d4245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:02.343387 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fdf381-06b2-4aca-99aa-689e806d4245 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:02.343639 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fdf381-06b2-4aca-99aa-689e806d4245 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:02.343907 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fdf381-06b2-4aca-99aa-689e806d4245 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:02.403767 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:02.413770 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fdf381-06b2-4aca-99aa-689e806d4245 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:02.415203 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fdf381-06b2-4aca-99aa-689e806d4245 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:02.513724 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 534/1057] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Sep 19 14:45:02 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 19 14:45:02.519802 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecfc2dd-e583-4e52-89c6-e428eb844a1c None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:02.616142 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:02.626698 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecfc2dd-e583-4e52-89c6-e428eb844a1c None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:02.660895 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1ddba7-805a-4fdd-958c-ca89201d5cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:02.661451 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ddba7-805a-4fdd-958c-ca89201d5cde None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:02.661731 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ddba7-805a-4fdd-958c-ca89201d5cde None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:02.662004 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ddba7-805a-4fdd-958c-ca89201d5cde None admin] PATH_INFO: `/v3/projects/f132d5fdc1024777b2c36b1067e33573` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:02.663120 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1ddba7-805a-4fdd-958c-ca89201d5cde None admin] RBAC: Authorizing `identity:get_project(project_id=f132d5fdc1024777b2c36b1067e33573)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:02.664581 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1ddba7-805a-4fdd-958c-ca89201d5cde None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:02.671770 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 524/1058] 10.222.0.72 () {56 vars in 1186 bytes} [Mon Sep 19 14:45:02 2022] GET /identity/v3/projects/f132d5fdc1024777b2c36b1067e33573 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:45:02.672946 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fdf381-06b2-4aca-99aa-689e806d4245 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:02.762879 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:02.772405 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fdf381-06b2-4aca-99aa-689e806d4245 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:02.807029 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49334976-98c3-4dff-aa52-5e2ab8a692da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:02.807632 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49334976-98c3-4dff-aa52-5e2ab8a692da None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:02.807911 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49334976-98c3-4dff-aa52-5e2ab8a692da None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:02.808299 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49334976-98c3-4dff-aa52-5e2ab8a692da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:02.809000 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49334976-98c3-4dff-aa52-5e2ab8a692da None admin] RBAC: Adding query filter params (role.id=ddb643577b2e4e478100ec370decfaeb, scope.project.id=f132d5fdc1024777b2c36b1067e33573, user.id=0c9152a0338f4952b44236221db28b77) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:45:02.809568 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49334976-98c3-4dff-aa52-5e2ab8a692da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:02.810978 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49334976-98c3-4dff-aa52-5e2ab8a692da None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:02.820578 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 535/1059] 10.222.0.72 () {56 vars in 1374 bytes} [Mon Sep 19 14:45:02 2022] GET /identity/v3/role_assignments?user.id=0c9152a0338f4952b44236221db28b77&scope.project.id=f132d5fdc1024777b2c36b1067e33573&role.id=ddb643577b2e4e478100ec370decfaeb => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:45:03.267002 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5514c8a9-2242-43a4-ab3e-d9cc910254e0 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:03.267387 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5514c8a9-2242-43a4-ab3e-d9cc910254e0 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:03.267569 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5514c8a9-2242-43a4-ab3e-d9cc910254e0 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:03.269069 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 525/1060] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:45:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:45:03.274107 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f488cf07-00a4-42bf-b6a5-41e4c6dc0fc5 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:03.274398 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f488cf07-00a4-42bf-b6a5-41e4c6dc0fc5 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:03.274673 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f488cf07-00a4-42bf-b6a5-41e4c6dc0fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:03.293771 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-f488cf07-00a4-42bf-b6a5-41e4c6dc0fc5 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:45:03.294937 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-f488cf07-00a4-42bf-b6a5-41e4c6dc0fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:45:03.363420 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 536/1061] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:45:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:45:03.636713 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5514c8a9-2242-43a4-ab3e-d9cc910254e0 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:03.744145 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5514c8a9-2242-43a4-ab3e-d9cc910254e0 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:03.780964 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31faa9d7-2cd6-4ebb-9444-784da6c971a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:03.781585 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31faa9d7-2cd6-4ebb-9444-784da6c971a6 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:03.781858 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31faa9d7-2cd6-4ebb-9444-784da6c971a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:03.782123 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31faa9d7-2cd6-4ebb-9444-784da6c971a6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:03.792218 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31faa9d7-2cd6-4ebb-9444-784da6c971a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:45:03.797742 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-31faa9d7-2cd6-4ebb-9444-784da6c971a6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 14:45:03.797742 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:45:03.797742 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:45:03.797742 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:45:03.797742 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:45:03.797742 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:45:03.797742 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:45:03.797742 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:45:03.797742 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:45:03.797742 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:45:03.797742 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:45:03.797742 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:45:03.797742 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:45:03.797742 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:45:03.797742 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:45:03.797742 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:45:03.798660 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:45:03.798660 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:45:03.798660 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:45:03.798660 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:45:03.798660 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:45:03.798660 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:45:03.798660 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:45:03.798660 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:45:03.798660 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:45:03.798660 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:45:03.798660 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:45:03.798660 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:45:03.798660 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:45:03.798660 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:45:03.798660 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:45:03.798660 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:45:03.799492 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:45:03.799492 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:45:03.799492 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:45:03.799492 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:45:03.799492 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:45:03.799492 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:45:03.799492 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:45:03.799492 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:45:03.799492 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:45:03.799492 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:45:03.799492 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 14:45:03.799492 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:45:03.803956 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 526/1062] 10.222.0.72 () {56 vars in 1120 bytes} [Mon Sep 19 14:45:03 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:45:03.804973 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f488cf07-00a4-42bf-b6a5-41e4c6dc0fc5 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:03.848874 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c4199d-f649-4b0b-8fb5-32f335e6cd7e None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:03.849499 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c4199d-f649-4b0b-8fb5-32f335e6cd7e None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:03.849982 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c4199d-f649-4b0b-8fb5-32f335e6cd7e None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:03.852395 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 527/1063] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:45:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 14:45:03.857637 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce92f65e-fa73-4560-b505-06e44f287290 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:03.858141 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce92f65e-fa73-4560-b505-06e44f287290 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:03.858626 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce92f65e-fa73-4560-b505-06e44f287290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:03.879736 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-ce92f65e-fa73-4560-b505-06e44f287290 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:45:03.881266 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-ce92f65e-fa73-4560-b505-06e44f287290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:45:03.896085 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:03.897683 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:03.916305 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f488cf07-00a4-42bf-b6a5-41e4c6dc0fc5 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:03.954860 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 528/1064] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:45:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:45:03.956195 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af18ff43-b38c-4640-846e-e05a0049cb32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:03.956848 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af18ff43-b38c-4640-846e-e05a0049cb32 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:03.957133 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af18ff43-b38c-4640-846e-e05a0049cb32 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:03.957404 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af18ff43-b38c-4640-846e-e05a0049cb32 None admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:03.958068 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af18ff43-b38c-4640-846e-e05a0049cb32 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:45:03.958372 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af18ff43-b38c-4640-846e-e05a0049cb32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:03.959729 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af18ff43-b38c-4640-846e-e05a0049cb32 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:03.972156 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 537/1065] 10.222.0.72 () {56 vars in 1115 bytes} [Mon Sep 19 14:45:03 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:45:03.977716 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce92f65e-fa73-4560-b505-06e44f287290 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:04.077083 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce92f65e-fa73-4560-b505-06e44f287290 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:04.111035 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c643938-d69c-40cb-9eac-b8e605af7c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:04.111658 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c643938-d69c-40cb-9eac-b8e605af7c3a None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:04.111935 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c643938-d69c-40cb-9eac-b8e605af7c3a None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:04.112204 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c643938-d69c-40cb-9eac-b8e605af7c3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:04.123375 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c643938-d69c-40cb-9eac-b8e605af7c3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:04.124852 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c643938-d69c-40cb-9eac-b8e605af7c3a None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:04.139338 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-2c643938-d69c-40cb-9eac-b8e605af7c3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:45:04.139338 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:45:04.139338 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:45:04.139338 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:45:04.139338 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:45:04.139338 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:45:04.139338 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:45:04.139338 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:45:04.139338 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:45:04.139338 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:45:04.139338 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:45:04.139338 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:45:04.139338 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:45:04.139338 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:45:04.139338 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:45:04.139338 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:45:04.140294 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:45:04.140294 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:45:04.140294 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:45:04.140294 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:45:04.140294 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:45:04.140294 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:45:04.140294 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:45:04.140294 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:45:04.140294 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:45:04.140294 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:45:04.140294 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:45:04.140294 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:45:04.140294 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:45:04.140294 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:45:04.140294 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:45:04.140294 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:45:04.140294 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:45:04.141251 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:45:04.141251 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:45:04.141251 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:45:04.145077 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 529/1066] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:45:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:45:04.146347 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af18ff43-b38c-4640-846e-e05a0049cb32 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:04.227700 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c643938-d69c-40cb-9eac-b8e605af7c3a None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:04.231287 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:04.250720 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af18ff43-b38c-4640-846e-e05a0049cb32 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:04.286822 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c9430f-bf8d-4fff-86b1-a4bd8ad68131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:04.287437 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c9430f-bf8d-4fff-86b1-a4bd8ad68131 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:04.287719 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c9430f-bf8d-4fff-86b1-a4bd8ad68131 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:04.288024 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c9430f-bf8d-4fff-86b1-a4bd8ad68131 None admin] PATH_INFO: `/v3/domains` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:04.288768 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c9430f-bf8d-4fff-86b1-a4bd8ad68131 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:45:04.289188 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c9430f-bf8d-4fff-86b1-a4bd8ad68131 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:04.290547 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c9430f-bf8d-4fff-86b1-a4bd8ad68131 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:04.304359 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 538/1067] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Sep 19 14:45:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:45:04.310215 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c9430f-bf8d-4fff-86b1-a4bd8ad68131 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:04.320944 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:04.334845 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c643938-d69c-40cb-9eac-b8e605af7c3a None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:04.374849 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6c068e-bd01-4a53-afed-2cf92fe82e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:04.375456 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6c068e-bd01-4a53-afed-2cf92fe82e5d None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:04.375736 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6c068e-bd01-4a53-afed-2cf92fe82e5d None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:04.376009 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6c068e-bd01-4a53-afed-2cf92fe82e5d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:04.427532 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c9430f-bf8d-4fff-86b1-a4bd8ad68131 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:04.447305 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6c068e-bd01-4a53-afed-2cf92fe82e5d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:04.449326 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6c068e-bd01-4a53-afed-2cf92fe82e5d None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:04.451337 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:04.470495 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822b64dd-2751-4308-8aac-49e140f2ca38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:04.471578 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822b64dd-2751-4308-8aac-49e140f2ca38 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:04.472090 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822b64dd-2751-4308-8aac-49e140f2ca38 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:04.472613 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822b64dd-2751-4308-8aac-49e140f2ca38 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:04.481676 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822b64dd-2751-4308-8aac-49e140f2ca38 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:04.483113 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822b64dd-2751-4308-8aac-49e140f2ca38 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:04.494977 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-822b64dd-2751-4308-8aac-49e140f2ca38 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 19 14:45:04.494977 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:45:04.494977 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:45:04.494977 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:45:04.494977 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:45:04.494977 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:45:04.494977 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:45:04.494977 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:45:04.494977 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:45:04.494977 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:45:04.494977 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:45:04.494977 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:45:04.494977 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 14:45:04.494977 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 14:45:04.494977 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 14:45:04.494977 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 14:45:04.495981 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:45:04.495981 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:45:04.495981 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:45:04.495981 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:45:04.495981 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:45:04.495981 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:45:04.495981 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:45:04.495981 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:45:04.495981 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:45:04.495981 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:45:04.495981 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:45:04.495981 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:45:04.495981 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:45:04.495981 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:45:04.495981 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:45:04.495981 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:45:04.495981 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:45:04.495981 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:45:04.496947 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:45:04.496947 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:45:04.496947 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 14:45:04.496947 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 14:45:04.496947 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 14:45:04.496947 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 14:45:04.496947 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 14:45:04.496947 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 14:45:04.496947 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 19 14:45:04.496947 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:45:04.501383 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 539/1068] 10.222.0.72 () {56 vars in 1093 bytes} [Mon Sep 19 14:45:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:45:04.502074 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822b64dd-2751-4308-8aac-49e140f2ca38 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:04.562398 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 530/1069] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Sep 19 14:45:04 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 19 14:45:04.568028 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6c068e-bd01-4a53-afed-2cf92fe82e5d None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:04.574607 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:04.610971 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822b64dd-2751-4308-8aac-49e140f2ca38 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:04.648930 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e39266b-faba-4aa9-9941-910cd3fc8212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:04.649917 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e39266b-faba-4aa9-9941-910cd3fc8212 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:04.650350 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e39266b-faba-4aa9-9941-910cd3fc8212 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:04.650764 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e39266b-faba-4aa9-9941-910cd3fc8212 None admin] PATH_INFO: `/v3/users` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:04.651506 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e39266b-faba-4aa9-9941-910cd3fc8212 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:45:04.652552 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e39266b-faba-4aa9-9941-910cd3fc8212 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:04.654116 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e39266b-faba-4aa9-9941-910cd3fc8212 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:04.674786 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6c068e-bd01-4a53-afed-2cf92fe82e5d None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:04.676318 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:04.676870 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 540/1070] 10.222.0.72 () {56 vars in 1133 bytes} [Mon Sep 19 14:45:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:45:04.681823 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e39266b-faba-4aa9-9941-910cd3fc8212 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:04.717023 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb93e7e4-c444-416b-89e8-96277e6e407c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:04.718236 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb93e7e4-c444-416b-89e8-96277e6e407c None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:04.719550 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb93e7e4-c444-416b-89e8-96277e6e407c None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:04.720018 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb93e7e4-c444-416b-89e8-96277e6e407c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:04.734342 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb93e7e4-c444-416b-89e8-96277e6e407c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:04.736275 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb93e7e4-c444-416b-89e8-96277e6e407c None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:04.751812 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-fb93e7e4-c444-416b-89e8-96277e6e407c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:45:04.751812 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:45:04.751812 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:45:04.751812 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:45:04.751812 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:45:04.751812 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:45:04.751812 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:45:04.751812 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:45:04.751812 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:45:04.751812 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:45:04.751812 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:45:04.751812 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:45:04.751812 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:45:04.751812 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:45:04.751812 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:45:04.751812 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:45:04.752963 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:45:04.752963 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:45:04.752963 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:45:04.752963 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:45:04.752963 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:45:04.752963 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:45:04.752963 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:45:04.752963 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:45:04.752963 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:45:04.752963 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:45:04.752963 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:45:04.752963 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:45:04.752963 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:45:04.752963 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:45:04.752963 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:45:04.752963 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:45:04.752963 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:45:04.754135 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:45:04.754135 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:45:04.754135 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:45:04.757937 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 531/1071] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:45:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:45:04.758767 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb93e7e4-c444-416b-89e8-96277e6e407c None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:04.792313 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e39266b-faba-4aa9-9941-910cd3fc8212 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:04.822504 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:04.832829 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884820a7-f651-4e16-9dea-1d8c9550ca81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:04.833803 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884820a7-f651-4e16-9dea-1d8c9550ca81 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:04.833803 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884820a7-f651-4e16-9dea-1d8c9550ca81 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:04.833990 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884820a7-f651-4e16-9dea-1d8c9550ca81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:04.845165 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884820a7-f651-4e16-9dea-1d8c9550ca81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:04.846627 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884820a7-f651-4e16-9dea-1d8c9550ca81 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:04.862816 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-884820a7-f651-4e16-9dea-1d8c9550ca81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:45:04.862816 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:45:04.862816 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:45:04.862816 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:45:04.862816 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:45:04.862816 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:45:04.862816 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:45:04.862816 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:45:04.862816 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:45:04.862816 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:45:04.862816 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:45:04.862816 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:45:04.862816 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:45:04.862816 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:45:04.862816 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:45:04.862816 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:45:04.863854 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:45:04.863854 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:45:04.863854 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:45:04.863854 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:45:04.863854 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:45:04.863854 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:45:04.863854 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:45:04.863854 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:45:04.863854 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:45:04.863854 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:45:04.863854 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:45:04.863854 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:45:04.863854 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:45:04.863854 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:45:04.863854 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:45:04.863854 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:45:04.863854 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:45:04.864799 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:45:04.864799 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:45:04.864799 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:45:04.864799 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 541/1072] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:45:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:45:04.869026 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb93e7e4-c444-416b-89e8-96277e6e407c None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:04.869959 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884820a7-f651-4e16-9dea-1d8c9550ca81 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:04.913392 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bba5d7-9d20-4855-9492-61a8acf4cea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:04.914808 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bba5d7-9d20-4855-9492-61a8acf4cea9 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:04.915091 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bba5d7-9d20-4855-9492-61a8acf4cea9 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:04.915362 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bba5d7-9d20-4855-9492-61a8acf4cea9 None admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:04.916006 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bba5d7-9d20-4855-9492-61a8acf4cea9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:45:04.916308 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bba5d7-9d20-4855-9492-61a8acf4cea9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:04.918352 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bba5d7-9d20-4855-9492-61a8acf4cea9 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:04.931910 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 532/1073] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Sep 19 14:45:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:45:04.988275 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884820a7-f651-4e16-9dea-1d8c9550ca81 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:04.991161 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9c37ba-5d0f-4c9e-a618-8a4f51d40e90 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:04.991458 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9c37ba-5d0f-4c9e-a618-8a4f51d40e90 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:04.991728 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9c37ba-5d0f-4c9e-a618-8a4f51d40e90 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:04.993159 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 533/1074] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:45:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 14:45:04.999322 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be91c18-c2c7-406a-ac1c-dc3493adee7e None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:04.999611 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be91c18-c2c7-406a-ac1c-dc3493adee7e None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:04.999866 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be91c18-c2c7-406a-ac1c-dc3493adee7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:05.019239 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-3be91c18-c2c7-406a-ac1c-dc3493adee7e None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:45:05.020521 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-3be91c18-c2c7-406a-ac1c-dc3493adee7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:45:05.028840 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c906f0a6-9f02-4361-98a7-e0d3550570d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:05.029832 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c906f0a6-9f02-4361-98a7-e0d3550570d2 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:05.030315 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c906f0a6-9f02-4361-98a7-e0d3550570d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:05.030760 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c906f0a6-9f02-4361-98a7-e0d3550570d2 None admin] PATH_INFO: `/v3/domains` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:05.031533 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:05.032807 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c906f0a6-9f02-4361-98a7-e0d3550570d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:45:05.033427 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c906f0a6-9f02-4361-98a7-e0d3550570d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:05.035566 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c906f0a6-9f02-4361-98a7-e0d3550570d2 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:05.050942 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 542/1075] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Sep 19 14:45:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:45:05.056419 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c906f0a6-9f02-4361-98a7-e0d3550570d2 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:05.100587 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:05.108039 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 534/1076] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:45:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 14:45:05.165240 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c906f0a6-9f02-4361-98a7-e0d3550570d2 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:05.200479 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6519326b-9b26-464c-ba18-847768e33039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:05.201034 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6519326b-9b26-464c-ba18-847768e33039 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:05.201310 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6519326b-9b26-464c-ba18-847768e33039 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:05.201576 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6519326b-9b26-464c-ba18-847768e33039 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:05.208308 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6519326b-9b26-464c-ba18-847768e33039 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:05.209762 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6519326b-9b26-464c-ba18-847768e33039 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:05.221214 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-6519326b-9b26-464c-ba18-847768e33039 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:45:05.221214 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:45:05.221214 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:45:05.221214 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:45:05.221214 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:45:05.221214 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:45:05.221214 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:45:05.221214 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:45:05.221214 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:45:05.221214 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:45:05.221214 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:45:05.221214 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:45:05.221214 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 14:45:05.221214 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 14:45:05.221214 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 14:45:05.222091 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 14:45:05.222091 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:45:05.222091 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:45:05.222091 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:45:05.222091 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:45:05.222091 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:45:05.222091 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:45:05.222091 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:45:05.222091 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:45:05.222091 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:45:05.222091 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:45:05.222091 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:45:05.222091 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:45:05.222091 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:45:05.222091 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:45:05.222091 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:45:05.222091 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:45:05.223052 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 14:45:05.223052 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 14:45:05.223052 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:45:05.223052 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:45:05.223052 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:45:05.223052 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:45:05.223052 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:45:05.223052 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:45:05.223052 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 543/1077] 10.222.0.72 () {56 vars in 1111 bytes} [Mon Sep 19 14:45:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:45:05.229535 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be91c18-c2c7-406a-ac1c-dc3493adee7e None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:05.334442 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be91c18-c2c7-406a-ac1c-dc3493adee7e None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:05.368231 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c14884b-25d0-4520-b1ed-0eb891d1aa85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:05.368850 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c14884b-25d0-4520-b1ed-0eb891d1aa85 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:05.369129 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c14884b-25d0-4520-b1ed-0eb891d1aa85 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:05.369401 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c14884b-25d0-4520-b1ed-0eb891d1aa85 None admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:05.370075 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c14884b-25d0-4520-b1ed-0eb891d1aa85 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:45:05.370381 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c14884b-25d0-4520-b1ed-0eb891d1aa85 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:05.372340 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c14884b-25d0-4520-b1ed-0eb891d1aa85 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:05.383374 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 535/1078] 10.222.0.72 () {56 vars in 1148 bytes} [Mon Sep 19 14:45:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:45:05.388229 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6519326b-9b26-464c-ba18-847768e33039 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:05.389645 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c14884b-25d0-4520-b1ed-0eb891d1aa85 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:05.393125 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:05.483905 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:05.488259 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c14884b-25d0-4520-b1ed-0eb891d1aa85 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:05.488424 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6519326b-9b26-464c-ba18-847768e33039 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:05.522154 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a30e9b-0446-48d0-9cb0-2eb93d5cf9bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:05.522422 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb5de40-b3bd-42af-8e3b-bf53ec75c306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:05.522773 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a30e9b-0446-48d0-9cb0-2eb93d5cf9bc None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:05.523054 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a30e9b-0446-48d0-9cb0-2eb93d5cf9bc None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:05.523157 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb5de40-b3bd-42af-8e3b-bf53ec75c306 None admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:05.523326 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a30e9b-0446-48d0-9cb0-2eb93d5cf9bc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:05.523427 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb5de40-b3bd-42af-8e3b-bf53ec75c306 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:05.523606 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb5de40-b3bd-42af-8e3b-bf53ec75c306 None admin] PATH_INFO: `/v3/projects/51af3a14d665498c9b7a35b34dac0ef1/users/055439dc35e946f4a82535c684f9b60d/roles/3ff0804c348f4f9fb91749835805a83a` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:05.525985 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb5de40-b3bd-42af-8e3b-bf53ec75c306 None admin] RBAC: Authorizing `identity:create_grant(project_id=51af3a14d665498c9b7a35b34dac0ef1, user_id=055439dc35e946f4a82535c684f9b60d, role_id=3ff0804c348f4f9fb91749835805a83a)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:05.527537 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb5de40-b3bd-42af-8e3b-bf53ec75c306 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:05.535484 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a30e9b-0446-48d0-9cb0-2eb93d5cf9bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:45:05.540764 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-23a30e9b-0446-48d0-9cb0-2eb93d5cf9bc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:45:05.540764 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:45:05.540764 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:45:05.540764 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:45:05.540764 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:45:05.540764 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:45:05.540764 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:45:05.540764 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:45:05.540764 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:45:05.540764 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:45:05.540764 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:45:05.540764 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:45:05.540764 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:45:05.540764 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:45:05.540764 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:45:05.540764 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:45:05.541971 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:45:05.541971 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:45:05.541971 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:45:05.541971 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:45:05.541971 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:45:05.541971 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:45:05.541971 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:45:05.541971 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:45:05.541971 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:45:05.541971 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:45:05.541971 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:45:05.541971 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:45:05.541971 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:45:05.541971 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:45:05.541971 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:45:05.541971 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:45:05.543585 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:45:05.543585 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:45:05.543585 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:45:05.543585 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:45:05.543585 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:45:05.543585 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:45:05.543585 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:45:05.543585 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:45:05.543585 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:45:05.543585 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:45:05.543585 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:45:05.543585 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:45:05.543585 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 544/1079] 10.222.0.72 () {56 vars in 1096 bytes} [Mon Sep 19 14:45:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:45:05.544534 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 536/1080] 10.222.0.72 () {58 vars in 1439 bytes} [Mon Sep 19 14:45:05 2022] PUT /identity/v3/projects/51af3a14d665498c9b7a35b34dac0ef1/users/055439dc35e946f4a82535c684f9b60d/roles/3ff0804c348f4f9fb91749835805a83a => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 14:45:05.548192 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a30e9b-0446-48d0-9cb0-2eb93d5cf9bc None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:05.654748 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a30e9b-0446-48d0-9cb0-2eb93d5cf9bc None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:05.690232 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d22419-2f9f-4193-81a3-b03b04ad2507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:05.690854 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d22419-2f9f-4193-81a3-b03b04ad2507 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:05.691132 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d22419-2f9f-4193-81a3-b03b04ad2507 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:05.691404 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d22419-2f9f-4193-81a3-b03b04ad2507 None admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:05.692077 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d22419-2f9f-4193-81a3-b03b04ad2507 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:45:05.692414 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d22419-2f9f-4193-81a3-b03b04ad2507 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:05.693792 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d22419-2f9f-4193-81a3-b03b04ad2507 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:05.703256 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 545/1081] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Sep 19 14:45:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:45:05.709690 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb5de40-b3bd-42af-8e3b-bf53ec75c306 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:05.775231 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:05.814062 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb5de40-b3bd-42af-8e3b-bf53ec75c306 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:05.847539 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412598ad-1c45-4cc7-87ea-ccce682620a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:05.848170 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412598ad-1c45-4cc7-87ea-ccce682620a4 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:05.848485 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412598ad-1c45-4cc7-87ea-ccce682620a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:05.848761 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412598ad-1c45-4cc7-87ea-ccce682620a4 None admin] PATH_INFO: `/v3/users/0c9152a0338f4952b44236221db28b77` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:05.849877 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412598ad-1c45-4cc7-87ea-ccce682620a4 None admin] RBAC: Authorizing `identity:get_user(user_id=0c9152a0338f4952b44236221db28b77)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:05.851308 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412598ad-1c45-4cc7-87ea-ccce682620a4 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:05.852936 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 537/1082] 10.222.0.72 () {56 vars in 1177 bytes} [Mon Sep 19 14:45:05 2022] GET /identity/v3/users/0c9152a0338f4952b44236221db28b77 => generated 285 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:45:05.859085 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d22419-2f9f-4193-81a3-b03b04ad2507 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:05.880945 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:05.959100 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d22419-2f9f-4193-81a3-b03b04ad2507 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:05.993416 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79088ef0-3352-45f9-a18c-f46006fcb3e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:05.994042 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79088ef0-3352-45f9-a18c-f46006fcb3e2 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:05.994323 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79088ef0-3352-45f9-a18c-f46006fcb3e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:05.994594 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79088ef0-3352-45f9-a18c-f46006fcb3e2 None admin] PATH_INFO: `/v3/projects/f132d5fdc1024777b2c36b1067e33573` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:05.996262 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79088ef0-3352-45f9-a18c-f46006fcb3e2 None admin] RBAC: Authorizing `identity:get_project(project_id=f132d5fdc1024777b2c36b1067e33573)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:05.997708 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79088ef0-3352-45f9-a18c-f46006fcb3e2 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:05.999521 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 546/1083] 10.222.0.72 () {56 vars in 1186 bytes} [Mon Sep 19 14:45:05 2022] GET /identity/v3/projects/f132d5fdc1024777b2c36b1067e33573 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:45:06.005228 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412598ad-1c45-4cc7-87ea-ccce682620a4 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:06.103457 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412598ad-1c45-4cc7-87ea-ccce682620a4 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:06.132644 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:06.138403 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0840c9e8-aefa-4097-8fcc-f69cbffda609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:06.139060 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0840c9e8-aefa-4097-8fcc-f69cbffda609 None admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:06.139341 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0840c9e8-aefa-4097-8fcc-f69cbffda609 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:06.139617 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0840c9e8-aefa-4097-8fcc-f69cbffda609 None admin] PATH_INFO: `/v3/projects/f132d5fdc1024777b2c36b1067e33573/users/0c9152a0338f4952b44236221db28b77/roles/ddb643577b2e4e478100ec370decfaeb` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:06.141525 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0840c9e8-aefa-4097-8fcc-f69cbffda609 None admin] RBAC: Authorizing `identity:create_grant(project_id=f132d5fdc1024777b2c36b1067e33573, user_id=0c9152a0338f4952b44236221db28b77, role_id=ddb643577b2e4e478100ec370decfaeb)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:06.142943 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0840c9e8-aefa-4097-8fcc-f69cbffda609 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:06.156002 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 538/1084] 10.222.0.72 () {58 vars in 1439 bytes} [Mon Sep 19 14:45:06 2022] PUT /identity/v3/projects/f132d5fdc1024777b2c36b1067e33573/users/0c9152a0338f4952b44236221db28b77/roles/ddb643577b2e4e478100ec370decfaeb => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:45:07.686750 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228fb22d-8c40-48e0-8e53-65bb9b5cf263 None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:07.687303 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228fb22d-8c40-48e0-8e53-65bb9b5cf263 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:07.687303 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228fb22d-8c40-48e0-8e53-65bb9b5cf263 None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:07.688655 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 547/1085] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:45:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:45:07.693795 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781a6b7-c39f-4f2e-a698-34f508856a46 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:07.694208 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781a6b7-c39f-4f2e-a698-34f508856a46 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:07.694357 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781a6b7-c39f-4f2e-a698-34f508856a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:07.712905 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-2781a6b7-c39f-4f2e-a698-34f508856a46 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:45:07.714079 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-2781a6b7-c39f-4f2e-a698-34f508856a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:45:07.780729 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 539/1086] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:45:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:45:08.051723 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228fb22d-8c40-48e0-8e53-65bb9b5cf263 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:08.139052 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:08.153035 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228fb22d-8c40-48e0-8e53-65bb9b5cf263 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:08.187990 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e989dde5-d97f-4ab2-90b9-22e595e1a5fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:08.188671 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e989dde5-d97f-4ab2-90b9-22e595e1a5fb None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:08.188953 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e989dde5-d97f-4ab2-90b9-22e595e1a5fb None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:08.189221 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e989dde5-d97f-4ab2-90b9-22e595e1a5fb None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:08.201372 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e989dde5-d97f-4ab2-90b9-22e595e1a5fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:45:08.206323 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-e989dde5-d97f-4ab2-90b9-22e595e1a5fb None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 14:45:08.206323 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:45:08.206323 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:45:08.206323 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:45:08.206323 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:45:08.206323 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:45:08.206323 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:45:08.206323 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:45:08.206323 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:45:08.206323 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:45:08.206323 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:45:08.206323 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:45:08.206323 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:45:08.206323 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:45:08.206323 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:45:08.206323 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:45:08.207436 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:45:08.207436 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:45:08.207436 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:45:08.207436 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:45:08.207436 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:45:08.207436 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:45:08.207436 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:45:08.207436 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:45:08.207436 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:45:08.207436 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:45:08.207436 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:45:08.207436 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:45:08.207436 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:45:08.207436 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:45:08.207436 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:45:08.207436 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:45:08.208466 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:45:08.208466 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:45:08.208466 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:45:08.208466 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:45:08.208466 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:45:08.208466 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:45:08.208466 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:45:08.208466 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:45:08.208466 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:45:08.208466 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:45:08.208466 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 14:45:08.208466 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:45:08.208466 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 548/1087] 10.222.0.72 () {56 vars in 1120 bytes} [Mon Sep 19 14:45:08 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:45:08.213496 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2781a6b7-c39f-4f2e-a698-34f508856a46 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:08.293056 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b1c557-f627-4e0f-ad81-e7fc481434bf None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:08.293343 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b1c557-f627-4e0f-ad81-e7fc481434bf None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:08.293620 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b1c557-f627-4e0f-ad81-e7fc481434bf None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:08.295513 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 549/1088] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:45:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:45:08.300608 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b325c17-144c-4d17-923a-782941f10a78 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:08.300886 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b325c17-144c-4d17-923a-782941f10a78 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:08.301160 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b325c17-144c-4d17-923a-782941f10a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:08.311051 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2781a6b7-c39f-4f2e-a698-34f508856a46 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:08.319452 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-3b325c17-144c-4d17-923a-782941f10a78 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:45:08.320768 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-3b325c17-144c-4d17-923a-782941f10a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:45:08.333997 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:08.346922 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa26664-1ae2-4860-a87f-72a0db66c6e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:08.347572 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa26664-1ae2-4860-a87f-72a0db66c6e3 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:08.347849 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa26664-1ae2-4860-a87f-72a0db66c6e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:08.348116 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa26664-1ae2-4860-a87f-72a0db66c6e3 None admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:08.348802 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa26664-1ae2-4860-a87f-72a0db66c6e3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:45:08.349100 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa26664-1ae2-4860-a87f-72a0db66c6e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:08.350456 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa26664-1ae2-4860-a87f-72a0db66c6e3 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:08.358529 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 540/1089] 10.222.0.72 () {56 vars in 1115 bytes} [Mon Sep 19 14:45:08 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:45:08.364190 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa26664-1ae2-4860-a87f-72a0db66c6e3 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:08.389188 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 550/1090] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:45:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 14:45:08.473598 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa26664-1ae2-4860-a87f-72a0db66c6e3 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:08.506097 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653f5fd4-30b7-426b-8540-045c8a3ec607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:08.506714 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653f5fd4-30b7-426b-8540-045c8a3ec607 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:08.506997 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653f5fd4-30b7-426b-8540-045c8a3ec607 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:08.507270 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653f5fd4-30b7-426b-8540-045c8a3ec607 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:08.517789 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653f5fd4-30b7-426b-8540-045c8a3ec607 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:08.519222 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653f5fd4-30b7-426b-8540-045c8a3ec607 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:08.547137 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-653f5fd4-30b7-426b-8540-045c8a3ec607 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:45:08.547137 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:45:08.547137 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:45:08.547137 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:45:08.547137 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:45:08.547137 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:45:08.547137 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:45:08.547137 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:45:08.547137 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:45:08.547137 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:45:08.547137 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:45:08.547137 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:45:08.547137 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:45:08.547137 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:45:08.547137 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:45:08.547137 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:45:08.548289 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:45:08.548289 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:45:08.548289 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:45:08.548289 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:45:08.548289 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:45:08.548289 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:45:08.548289 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:45:08.548289 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:45:08.548289 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:45:08.548289 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:45:08.548289 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:45:08.548289 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:45:08.548289 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:45:08.548289 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:45:08.548289 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:45:08.548289 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:45:08.548289 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:45:08.549213 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:45:08.549213 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:45:08.549213 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:45:08.549213 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 541/1091] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:45:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:45:08.554147 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b325c17-144c-4d17-923a-782941f10a78 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:08.629902 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:08.650924 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b325c17-144c-4d17-923a-782941f10a78 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:08.657218 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653f5fd4-30b7-426b-8540-045c8a3ec607 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:08.685865 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b0b792-c41f-4b6c-9279-0d119172cbf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:08.686475 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b0b792-c41f-4b6c-9279-0d119172cbf4 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:08.686750 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b0b792-c41f-4b6c-9279-0d119172cbf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:08.687023 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b0b792-c41f-4b6c-9279-0d119172cbf4 None admin] PATH_INFO: `/v3/domains` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:08.687645 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b0b792-c41f-4b6c-9279-0d119172cbf4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:45:08.687948 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b0b792-c41f-4b6c-9279-0d119172cbf4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:08.689331 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b0b792-c41f-4b6c-9279-0d119172cbf4 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:08.693175 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:08.701144 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 551/1092] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Sep 19 14:45:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:45:08.706745 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b0b792-c41f-4b6c-9279-0d119172cbf4 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:08.759294 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653f5fd4-30b7-426b-8540-045c8a3ec607 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:08.795764 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bfb76e-a261-4d9a-aad7-17c381bc8958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:08.796409 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bfb76e-a261-4d9a-aad7-17c381bc8958 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:08.796697 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bfb76e-a261-4d9a-aad7-17c381bc8958 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:08.796970 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bfb76e-a261-4d9a-aad7-17c381bc8958 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:08.805398 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b0b792-c41f-4b6c-9279-0d119172cbf4 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:08.807350 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bfb76e-a261-4d9a-aad7-17c381bc8958 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:45:08.812541 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-05bfb76e-a261-4d9a-aad7-17c381bc8958 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:45:08.812541 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:45:08.812541 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:45:08.812541 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:45:08.812541 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:45:08.812541 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:45:08.812541 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:45:08.812541 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:45:08.812541 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:45:08.812541 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:45:08.812541 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:45:08.812541 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:45:08.812541 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:45:08.812541 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:45:08.812541 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:45:08.812541 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:45:08.816389 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:45:08.816389 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:45:08.816389 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:45:08.816389 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:45:08.816389 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:45:08.816389 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:45:08.816389 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:45:08.816389 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:45:08.816389 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:45:08.816389 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:45:08.816389 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:45:08.816389 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:45:08.816389 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:45:08.816389 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:45:08.816389 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:45:08.816389 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:45:08.817333 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:45:08.817333 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:45:08.817333 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:45:08.817333 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:45:08.817333 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:45:08.817333 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:45:08.817333 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:45:08.817333 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:45:08.817333 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:45:08.817333 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:45:08.817333 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:45:08.817333 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:45:08.817333 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 542/1093] 10.222.0.72 () {56 vars in 1096 bytes} [Mon Sep 19 14:45:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:45:08.819858 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bfb76e-a261-4d9a-aad7-17c381bc8958 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:08.840164 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2286a2-7f22-4d91-8e68-58c5a2e4783b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:08.840894 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2286a2-7f22-4d91-8e68-58c5a2e4783b None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:08.841175 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2286a2-7f22-4d91-8e68-58c5a2e4783b None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:08.841448 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2286a2-7f22-4d91-8e68-58c5a2e4783b None admin] PATH_INFO: `/v3/users/nova` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:08.848807 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2286a2-7f22-4d91-8e68-58c5a2e4783b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:08.850234 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2286a2-7f22-4d91-8e68-58c5a2e4783b None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:08.851967 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:08.863225 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-7f2286a2-7f22-4d91-8e68-58c5a2e4783b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 19 14:45:08.863225 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:45:08.863225 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:45:08.863225 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:45:08.863225 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:45:08.863225 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:45:08.863225 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:45:08.863225 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:45:08.863225 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:45:08.863225 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:45:08.863225 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:45:08.863225 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:45:08.863225 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 14:45:08.863225 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 14:45:08.863225 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 14:45:08.863225 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 14:45:08.864216 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:45:08.864216 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:45:08.864216 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:45:08.864216 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:45:08.864216 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:45:08.864216 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:45:08.864216 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:45:08.864216 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:45:08.864216 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:45:08.864216 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:45:08.864216 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:45:08.864216 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:45:08.864216 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:45:08.864216 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:45:08.864216 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:45:08.864216 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:45:08.864216 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:45:08.864216 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:45:08.865419 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:45:08.865419 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:45:08.865419 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 14:45:08.865419 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 14:45:08.865419 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 14:45:08.865419 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 14:45:08.865419 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 14:45:08.865419 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 14:45:08.865419 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 19 14:45:08.865419 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:45:08.865419 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 552/1094] 10.222.0.72 () {56 vars in 1093 bytes} [Mon Sep 19 14:45:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:45:08.869994 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2286a2-7f22-4d91-8e68-58c5a2e4783b None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:08.920742 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:08.927254 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bfb76e-a261-4d9a-aad7-17c381bc8958 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:08.961528 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553cbdff-233f-43b2-a284-ae52060df8cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:08.962215 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553cbdff-233f-43b2-a284-ae52060df8cc None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:08.962499 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553cbdff-233f-43b2-a284-ae52060df8cc None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:08.962773 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553cbdff-233f-43b2-a284-ae52060df8cc None admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:08.963428 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553cbdff-233f-43b2-a284-ae52060df8cc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:45:08.963728 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553cbdff-233f-43b2-a284-ae52060df8cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:08.965746 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553cbdff-233f-43b2-a284-ae52060df8cc None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:08.973515 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2286a2-7f22-4d91-8e68-58c5a2e4783b None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:08.974259 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 543/1095] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Sep 19 14:45:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:45:08.980129 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553cbdff-233f-43b2-a284-ae52060df8cc None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:09.008744 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c77efe0-23a6-4bc6-bd5c-d245d2d07172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:09.009349 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c77efe0-23a6-4bc6-bd5c-d245d2d07172 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:09.009627 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c77efe0-23a6-4bc6-bd5c-d245d2d07172 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:09.009897 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c77efe0-23a6-4bc6-bd5c-d245d2d07172 None admin] PATH_INFO: `/v3/users` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:09.010617 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c77efe0-23a6-4bc6-bd5c-d245d2d07172 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:45:09.010922 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c77efe0-23a6-4bc6-bd5c-d245d2d07172 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:09.012903 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c77efe0-23a6-4bc6-bd5c-d245d2d07172 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:09.030419 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 553/1096] 10.222.0.72 () {56 vars in 1133 bytes} [Mon Sep 19 14:45:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:45:09.035993 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c77efe0-23a6-4bc6-bd5c-d245d2d07172 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:09.077969 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553cbdff-233f-43b2-a284-ae52060df8cc None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:09.093833 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:09.113421 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8de5e52-1394-4c83-8609-393a7cb860b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:09.114051 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8de5e52-1394-4c83-8609-393a7cb860b1 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:09.114335 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8de5e52-1394-4c83-8609-393a7cb860b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:09.114615 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8de5e52-1394-4c83-8609-393a7cb860b1 None admin] PATH_INFO: `/v3/users/0c9152a0338f4952b44236221db28b77` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:09.115744 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8de5e52-1394-4c83-8609-393a7cb860b1 None admin] RBAC: Authorizing `identity:get_user(user_id=0c9152a0338f4952b44236221db28b77)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:09.117212 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8de5e52-1394-4c83-8609-393a7cb860b1 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:09.118943 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 544/1097] 10.222.0.72 () {56 vars in 1177 bytes} [Mon Sep 19 14:45:08 2022] GET /identity/v3/users/0c9152a0338f4952b44236221db28b77 => generated 285 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:45:09.125216 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8de5e52-1394-4c83-8609-393a7cb860b1 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:09.139127 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c77efe0-23a6-4bc6-bd5c-d245d2d07172 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:09.153247 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:09.173592 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb3bb82-bd28-405a-838d-d41830c675cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:09.174131 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb3bb82-bd28-405a-838d-d41830c675cc None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:09.174406 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb3bb82-bd28-405a-838d-d41830c675cc None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:09.174675 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb3bb82-bd28-405a-838d-d41830c675cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:09.226864 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8de5e52-1394-4c83-8609-393a7cb860b1 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:09.242087 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb3bb82-bd28-405a-838d-d41830c675cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:09.243526 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb3bb82-bd28-405a-838d-d41830c675cc None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:09.260904 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a7b1c2-702e-4ac7-9179-540d6d95334f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:09.261571 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a7b1c2-702e-4ac7-9179-540d6d95334f None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:09.261954 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a7b1c2-702e-4ac7-9179-540d6d95334f None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:09.262234 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a7b1c2-702e-4ac7-9179-540d6d95334f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:09.296088 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:09.330645 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a7b1c2-702e-4ac7-9179-540d6d95334f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:09.332090 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a7b1c2-702e-4ac7-9179-540d6d95334f None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:09.339959 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 554/1098] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Sep 19 14:45:09 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 19 14:45:09.345705 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb3bb82-bd28-405a-838d-d41830c675cc None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:09.359268 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:09.431988 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 545/1099] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Sep 19 14:45:09 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 19 14:45:09.438122 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a7b1c2-702e-4ac7-9179-540d6d95334f None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:09.443336 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb3bb82-bd28-405a-838d-d41830c675cc None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:09.478500 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29139dfe-a266-4082-8eb1-53f476883279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:09.479118 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29139dfe-a266-4082-8eb1-53f476883279 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:09.479393 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29139dfe-a266-4082-8eb1-53f476883279 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:09.479658 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29139dfe-a266-4082-8eb1-53f476883279 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:09.490168 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29139dfe-a266-4082-8eb1-53f476883279 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:09.491591 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29139dfe-a266-4082-8eb1-53f476883279 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:09.505735 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-29139dfe-a266-4082-8eb1-53f476883279 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:45:09.505735 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:45:09.505735 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:45:09.505735 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:45:09.505735 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:45:09.505735 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:45:09.505735 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:45:09.505735 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:45:09.505735 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:45:09.505735 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:45:09.505735 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:45:09.505735 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:45:09.505735 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:45:09.505735 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:45:09.505735 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:45:09.505735 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:45:09.506863 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:45:09.506863 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:45:09.506863 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:45:09.506863 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:45:09.506863 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:45:09.506863 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:45:09.506863 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:45:09.506863 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:45:09.506863 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:45:09.506863 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:45:09.506863 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:45:09.506863 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:45:09.506863 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:45:09.506863 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:45:09.506863 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:45:09.506863 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:45:09.506863 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:45:09.508277 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:45:09.508277 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:45:09.508277 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:45:09.508277 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 555/1100] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:45:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:45:09.513038 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29139dfe-a266-4082-8eb1-53f476883279 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:09.523438 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:09.535463 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a7b1c2-702e-4ac7-9179-540d6d95334f None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:09.562483 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:09.571704 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24d31a0-4372-4dd0-9b3c-3e9538082ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:09.572344 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24d31a0-4372-4dd0-9b3c-3e9538082ff1 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:09.572648 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24d31a0-4372-4dd0-9b3c-3e9538082ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:09.572919 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24d31a0-4372-4dd0-9b3c-3e9538082ff1 None admin] PATH_INFO: `/v3/projects/f132d5fdc1024777b2c36b1067e33573` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:09.574630 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24d31a0-4372-4dd0-9b3c-3e9538082ff1 None admin] RBAC: Authorizing `identity:get_project(project_id=f132d5fdc1024777b2c36b1067e33573)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:09.576047 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24d31a0-4372-4dd0-9b3c-3e9538082ff1 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:09.577960 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 546/1101] 10.222.0.72 () {56 vars in 1186 bytes} [Mon Sep 19 14:45:09 2022] GET /identity/v3/projects/f132d5fdc1024777b2c36b1067e33573 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:45:09.583841 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24d31a0-4372-4dd0-9b3c-3e9538082ff1 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:09.614387 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29139dfe-a266-4082-8eb1-53f476883279 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:09.647565 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cc849d-e558-43ba-830c-8351cfa38b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:09.648171 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc849d-e558-43ba-830c-8351cfa38b2a None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:09.648485 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc849d-e558-43ba-830c-8351cfa38b2a None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:09.648757 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc849d-e558-43ba-830c-8351cfa38b2a None admin] PATH_INFO: `/v3/domains` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:09.649385 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cc849d-e558-43ba-830c-8351cfa38b2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:45:09.649684 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cc849d-e558-43ba-830c-8351cfa38b2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:09.651043 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cc849d-e558-43ba-830c-8351cfa38b2a None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:09.663399 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 556/1102] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Sep 19 14:45:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:45:09.669407 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cc849d-e558-43ba-830c-8351cfa38b2a None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:09.681044 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24d31a0-4372-4dd0-9b3c-3e9538082ff1 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:09.716121 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0638d8-ae9a-4813-8189-f4e2a33943cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:09.716752 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0638d8-ae9a-4813-8189-f4e2a33943cd None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:09.717032 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0638d8-ae9a-4813-8189-f4e2a33943cd None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:09.717416 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0638d8-ae9a-4813-8189-f4e2a33943cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:09.718009 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0638d8-ae9a-4813-8189-f4e2a33943cd None admin] RBAC: Adding query filter params (role.id=ddb643577b2e4e478100ec370decfaeb, scope.project.id=f132d5fdc1024777b2c36b1067e33573, user.id=0c9152a0338f4952b44236221db28b77) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:45:09.718323 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0638d8-ae9a-4813-8189-f4e2a33943cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:09.719744 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0638d8-ae9a-4813-8189-f4e2a33943cd None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:09.725418 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 547/1103] 10.222.0.72 () {56 vars in 1374 bytes} [Mon Sep 19 14:45:09 2022] GET /identity/v3/role_assignments?user.id=0c9152a0338f4952b44236221db28b77&scope.project.id=f132d5fdc1024777b2c36b1067e33573&role.id=ddb643577b2e4e478100ec370decfaeb => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:45:09.735224 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:09.772697 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cc849d-e558-43ba-830c-8351cfa38b2a None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:09.810210 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab26672-3cbd-4f34-a966-b04cc767f1f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:09.810855 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab26672-3cbd-4f34-a966-b04cc767f1f9 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:09.811136 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab26672-3cbd-4f34-a966-b04cc767f1f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:09.811409 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab26672-3cbd-4f34-a966-b04cc767f1f9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:09.818956 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab26672-3cbd-4f34-a966-b04cc767f1f9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:09.820447 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab26672-3cbd-4f34-a966-b04cc767f1f9 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:09.833241 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-4ab26672-3cbd-4f34-a966-b04cc767f1f9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:45:09.833241 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:45:09.833241 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:45:09.833241 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:45:09.833241 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:45:09.833241 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:45:09.833241 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:45:09.833241 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:45:09.833241 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:45:09.833241 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:45:09.833241 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:45:09.833241 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:45:09.833241 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 14:45:09.833241 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 14:45:09.833241 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 14:45:09.834235 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 14:45:09.834235 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:45:09.834235 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:45:09.834235 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:45:09.834235 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:45:09.834235 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:45:09.834235 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:45:09.834235 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:45:09.834235 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:45:09.834235 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:45:09.834235 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:45:09.834235 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:45:09.834235 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:45:09.834235 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:45:09.834235 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:45:09.834235 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:45:09.834235 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:45:09.835160 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 14:45:09.835160 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 14:45:09.835160 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:45:09.835160 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:45:09.835160 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:45:09.835160 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:45:09.835160 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:45:09.835160 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:45:09.835160 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 557/1104] 10.222.0.72 () {56 vars in 1111 bytes} [Mon Sep 19 14:45:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:45:09.841147 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0638d8-ae9a-4813-8189-f4e2a33943cd None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:09.905231 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:09.947755 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0638d8-ae9a-4813-8189-f4e2a33943cd None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:09.981570 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea43aba-2d7f-4f19-bfde-6c061387d604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:09.982093 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea43aba-2d7f-4f19-bfde-6c061387d604 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:09.982368 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea43aba-2d7f-4f19-bfde-6c061387d604 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:09.982636 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea43aba-2d7f-4f19-bfde-6c061387d604 None admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:09.983308 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea43aba-2d7f-4f19-bfde-6c061387d604 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:45:09.983607 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea43aba-2d7f-4f19-bfde-6c061387d604 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:09.985043 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea43aba-2d7f-4f19-bfde-6c061387d604 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:09.997214 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 548/1105] 10.222.0.72 () {56 vars in 1148 bytes} [Mon Sep 19 14:45:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:45:10.003159 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab26672-3cbd-4f34-a966-b04cc767f1f9 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:10.099458 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab26672-3cbd-4f34-a966-b04cc767f1f9 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:10.124843 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:10.132680 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4575c8a1-0404-4699-b64a-95434b5f0928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:10.133278 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4575c8a1-0404-4699-b64a-95434b5f0928 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:10.133553 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4575c8a1-0404-4699-b64a-95434b5f0928 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:10.133821 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4575c8a1-0404-4699-b64a-95434b5f0928 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:10.134531 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4575c8a1-0404-4699-b64a-95434b5f0928 None admin] RBAC: Adding query filter params (role.id=3ff0804c348f4f9fb91749835805a83a, scope.project.id=51af3a14d665498c9b7a35b34dac0ef1, user.id=055439dc35e946f4a82535c684f9b60d) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:45:10.134827 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4575c8a1-0404-4699-b64a-95434b5f0928 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:10.136805 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4575c8a1-0404-4699-b64a-95434b5f0928 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:10.142466 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 558/1106] 10.222.0.72 () {56 vars in 1374 bytes} [Mon Sep 19 14:45:10 2022] GET /identity/v3/role_assignments?user.id=055439dc35e946f4a82535c684f9b60d&scope.project.id=51af3a14d665498c9b7a35b34dac0ef1&role.id=3ff0804c348f4f9fb91749835805a83a => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:45:11.940925 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ee6c7-00a5-4841-905e-8f37dbd30d6f None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:11.941388 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ee6c7-00a5-4841-905e-8f37dbd30d6f None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:11.941480 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ee6c7-00a5-4841-905e-8f37dbd30d6f None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:11.942789 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 549/1107] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:45:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:45:11.947873 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde893b3-0e6e-49ed-8cbc-c5dbb62eaa99 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:11.948237 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde893b3-0e6e-49ed-8cbc-c5dbb62eaa99 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:11.948454 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde893b3-0e6e-49ed-8cbc-c5dbb62eaa99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:11.967550 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-fde893b3-0e6e-49ed-8cbc-c5dbb62eaa99 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:45:11.968773 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-fde893b3-0e6e-49ed-8cbc-c5dbb62eaa99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:45:12.033022 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 559/1108] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:45:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:45:12.305628 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81ee6c7-00a5-4841-905e-8f37dbd30d6f None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:12.405228 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81ee6c7-00a5-4841-905e-8f37dbd30d6f None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:12.421989 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:12.439471 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0cf61a-7635-478a-b511-431ce0027056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:12.440087 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0cf61a-7635-478a-b511-431ce0027056 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:12.440391 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0cf61a-7635-478a-b511-431ce0027056 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:12.440669 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0cf61a-7635-478a-b511-431ce0027056 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:12.441767 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0cf61a-7635-478a-b511-431ce0027056 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:12.443191 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0cf61a-7635-478a-b511-431ce0027056 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:12.444791 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 550/1109] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:45:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:45:12.451165 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde893b3-0e6e-49ed-8cbc-c5dbb62eaa99 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:12.552627 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde893b3-0e6e-49ed-8cbc-c5dbb62eaa99 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:12.575709 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:12.587792 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b80ef20-b545-4b90-a765-91abb8e0060e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:12.588426 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b80ef20-b545-4b90-a765-91abb8e0060e None admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:12.588712 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b80ef20-b545-4b90-a765-91abb8e0060e None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:12.588987 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b80ef20-b545-4b90-a765-91abb8e0060e None admin] PATH_INFO: `/v3/users` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:12.589828 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b80ef20-b545-4b90-a765-91abb8e0060e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:12.591654 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b80ef20-b545-4b90-a765-91abb8e0060e None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:12.612421 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 560/1110] 10.222.0.72 () {60 vars in 1132 bytes} [Mon Sep 19 14:45:12 2022] POST /identity/v3/users => generated 286 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:45:14.764433 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712e498b-1aff-4dff-a16b-e626fc14f851 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:14.764985 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712e498b-1aff-4dff-a16b-e626fc14f851 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:14.764985 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712e498b-1aff-4dff-a16b-e626fc14f851 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:14.766347 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 551/1111] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:45:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:45:14.771531 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30acfb28-053c-480c-918c-8e91425edb55 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:14.771960 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30acfb28-053c-480c-918c-8e91425edb55 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:14.772077 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30acfb28-053c-480c-918c-8e91425edb55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:14.789976 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-30acfb28-053c-480c-918c-8e91425edb55 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:45:14.791145 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-30acfb28-053c-480c-918c-8e91425edb55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:45:14.856039 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 561/1112] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:45:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:45:15.125666 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712e498b-1aff-4dff-a16b-e626fc14f851 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:15.227436 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712e498b-1aff-4dff-a16b-e626fc14f851 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:15.260673 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeda3ab-8aa4-442f-9d9f-24983c87c0be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:15.261948 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeda3ab-8aa4-442f-9d9f-24983c87c0be None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:15.262253 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeda3ab-8aa4-442f-9d9f-24983c87c0be None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:15.262527 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeda3ab-8aa4-442f-9d9f-24983c87c0be None admin] PATH_INFO: `/v3/roles/962ee04d08ae41b08c1a5108c54c7469` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:15.263915 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceeda3ab-8aa4-442f-9d9f-24983c87c0be None admin] RBAC: Authorizing `identity:get_role(role_id=962ee04d08ae41b08c1a5108c54c7469)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:15.265314 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceeda3ab-8aa4-442f-9d9f-24983c87c0be None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:15.266620 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 552/1113] 10.222.0.72 () {56 vars in 1177 bytes} [Mon Sep 19 14:45:15 2022] GET /identity/v3/roles/962ee04d08ae41b08c1a5108c54c7469 => generated 223 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:45:15.272427 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30acfb28-053c-480c-918c-8e91425edb55 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:15.375329 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30acfb28-053c-480c-918c-8e91425edb55 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:15.385941 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:15.411944 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca0ad95-540b-4ec0-9c61-79c7a9589722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:15.412590 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca0ad95-540b-4ec0-9c61-79c7a9589722 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:15.412872 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca0ad95-540b-4ec0-9c61-79c7a9589722 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:15.413144 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca0ad95-540b-4ec0-9c61-79c7a9589722 None admin] PATH_INFO: `/v3/users/fe99dc2428d844968e9d13ed808809d9` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:15.425931 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca0ad95-540b-4ec0-9c61-79c7a9589722 None admin] RBAC: Authorizing `identity:get_user(user_id=fe99dc2428d844968e9d13ed808809d9)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:15.427356 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca0ad95-540b-4ec0-9c61-79c7a9589722 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:15.428963 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 562/1114] 10.222.0.72 () {56 vars in 1177 bytes} [Mon Sep 19 14:45:15 2022] GET /identity/v3/users/fe99dc2428d844968e9d13ed808809d9 => generated 286 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:45:15.435589 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeda3ab-8aa4-442f-9d9f-24983c87c0be None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:15.489519 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:15.534229 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeda3ab-8aa4-442f-9d9f-24983c87c0be None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:15.568437 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1df14fd-b156-4f15-ac12-1607e5525c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:15.569030 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df14fd-b156-4f15-ac12-1607e5525c03 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:15.569311 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df14fd-b156-4f15-ac12-1607e5525c03 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:15.569581 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df14fd-b156-4f15-ac12-1607e5525c03 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:15.634587 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1df14fd-b156-4f15-ac12-1607e5525c03 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:15.636109 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1df14fd-b156-4f15-ac12-1607e5525c03 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:15.688316 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:15.732059 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 553/1115] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Sep 19 14:45:15 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 14:45:15.737990 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca0ad95-540b-4ec0-9c61-79c7a9589722 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:15.832504 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca0ad95-540b-4ec0-9c61-79c7a9589722 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:15.865156 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8745d3e-18b7-469b-8471-35ef4520eabc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:15.865768 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8745d3e-18b7-469b-8471-35ef4520eabc None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:15.866043 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8745d3e-18b7-469b-8471-35ef4520eabc None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:15.866312 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8745d3e-18b7-469b-8471-35ef4520eabc None admin] PATH_INFO: `/v3/projects/f132d5fdc1024777b2c36b1067e33573` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:15.867403 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8745d3e-18b7-469b-8471-35ef4520eabc None admin] RBAC: Authorizing `identity:get_project(project_id=f132d5fdc1024777b2c36b1067e33573)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:15.868840 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8745d3e-18b7-469b-8471-35ef4520eabc None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:15.870467 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 563/1116] 10.222.0.72 () {56 vars in 1186 bytes} [Mon Sep 19 14:45:15 2022] GET /identity/v3/projects/f132d5fdc1024777b2c36b1067e33573 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:45:15.877206 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1df14fd-b156-4f15-ac12-1607e5525c03 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:15.974786 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1df14fd-b156-4f15-ac12-1607e5525c03 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:16.007908 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894c910c-1ba4-4671-b83a-2628131c33b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:16.008527 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c910c-1ba4-4671-b83a-2628131c33b2 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:16.008819 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c910c-1ba4-4671-b83a-2628131c33b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:16.009093 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c910c-1ba4-4671-b83a-2628131c33b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:16.009806 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894c910c-1ba4-4671-b83a-2628131c33b2 None admin] RBAC: Adding query filter params (role.id=962ee04d08ae41b08c1a5108c54c7469, scope.project.id=f132d5fdc1024777b2c36b1067e33573, user.id=fe99dc2428d844968e9d13ed808809d9) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:45:16.010115 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894c910c-1ba4-4671-b83a-2628131c33b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:16.011657 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894c910c-1ba4-4671-b83a-2628131c33b2 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:16.017046 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 554/1117] 10.222.0.72 () {56 vars in 1374 bytes} [Mon Sep 19 14:45:15 2022] GET /identity/v3/role_assignments?user.id=fe99dc2428d844968e9d13ed808809d9&scope.project.id=f132d5fdc1024777b2c36b1067e33573&role.id=962ee04d08ae41b08c1a5108c54c7469 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:45:18.152534 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dd4cdc-5f5e-4ce8-ba76-ea74ad660e6a None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:18.153054 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dd4cdc-5f5e-4ce8-ba76-ea74ad660e6a None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:18.153054 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dd4cdc-5f5e-4ce8-ba76-ea74ad660e6a None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:18.154426 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 564/1118] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:45:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:45:18.159567 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceb996c-38e1-41f6-9376-85a9c2281668 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:18.159960 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceb996c-38e1-41f6-9376-85a9c2281668 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:18.160059 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceb996c-38e1-41f6-9376-85a9c2281668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:18.177955 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-5ceb996c-38e1-41f6-9376-85a9c2281668 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:45:18.179139 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-5ceb996c-38e1-41f6-9376-85a9c2281668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:45:18.192893 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:18.246414 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 555/1119] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:45:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:45:18.519617 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dd4cdc-5f5e-4ce8-ba76-ea74ad660e6a None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:18.554407 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:18.620781 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dd4cdc-5f5e-4ce8-ba76-ea74ad660e6a None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:18.653993 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c198eacd-fea9-4ef3-98d5-5365b0c87677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:18.654608 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c198eacd-fea9-4ef3-98d5-5365b0c87677 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:18.654887 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c198eacd-fea9-4ef3-98d5-5365b0c87677 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:18.655158 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c198eacd-fea9-4ef3-98d5-5365b0c87677 None admin] PATH_INFO: `/v3/roles/962ee04d08ae41b08c1a5108c54c7469` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:18.656676 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c198eacd-fea9-4ef3-98d5-5365b0c87677 None admin] RBAC: Authorizing `identity:get_role(role_id=962ee04d08ae41b08c1a5108c54c7469)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:18.658033 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c198eacd-fea9-4ef3-98d5-5365b0c87677 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:18.659329 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 565/1120] 10.222.0.72 () {56 vars in 1177 bytes} [Mon Sep 19 14:45:18 2022] GET /identity/v3/roles/962ee04d08ae41b08c1a5108c54c7469 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:45:18.665129 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceb996c-38e1-41f6-9376-85a9c2281668 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:18.763611 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceb996c-38e1-41f6-9376-85a9c2281668 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:18.797509 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024c19b7-2ecd-4088-ad82-ae8d60eb0bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:18.798063 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024c19b7-2ecd-4088-ad82-ae8d60eb0bff None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:18.798348 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024c19b7-2ecd-4088-ad82-ae8d60eb0bff None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:18.798622 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024c19b7-2ecd-4088-ad82-ae8d60eb0bff None admin] PATH_INFO: `/v3/users/fe99dc2428d844968e9d13ed808809d9` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:18.799722 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024c19b7-2ecd-4088-ad82-ae8d60eb0bff None admin] RBAC: Authorizing `identity:get_user(user_id=fe99dc2428d844968e9d13ed808809d9)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:18.801181 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024c19b7-2ecd-4088-ad82-ae8d60eb0bff None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:18.802734 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 556/1121] 10.222.0.72 () {56 vars in 1177 bytes} [Mon Sep 19 14:45:18 2022] GET /identity/v3/users/fe99dc2428d844968e9d13ed808809d9 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:45:18.808715 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c198eacd-fea9-4ef3-98d5-5365b0c87677 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:18.904955 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c198eacd-fea9-4ef3-98d5-5365b0c87677 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:18.906499 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:18.939770 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08498ca-bcbd-43c0-9549-7fac68ee8e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:18.940419 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08498ca-bcbd-43c0-9549-7fac68ee8e7f None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:18.940698 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08498ca-bcbd-43c0-9549-7fac68ee8e7f None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:18.940970 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08498ca-bcbd-43c0-9549-7fac68ee8e7f None admin] PATH_INFO: `/v3/projects/f132d5fdc1024777b2c36b1067e33573` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:18.942071 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08498ca-bcbd-43c0-9549-7fac68ee8e7f None admin] RBAC: Authorizing `identity:get_project(project_id=f132d5fdc1024777b2c36b1067e33573)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:18.943488 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08498ca-bcbd-43c0-9549-7fac68ee8e7f None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:18.945269 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 566/1122] 10.222.0.72 () {56 vars in 1186 bytes} [Mon Sep 19 14:45:18 2022] GET /identity/v3/projects/f132d5fdc1024777b2c36b1067e33573 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:45:18.951760 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024c19b7-2ecd-4088-ad82-ae8d60eb0bff None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:18.969340 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:19.048666 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024c19b7-2ecd-4088-ad82-ae8d60eb0bff None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:19.082629 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645afeb6-16fe-4afb-adfc-b1402befb18e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:19.083273 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645afeb6-16fe-4afb-adfc-b1402befb18e None admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:19.083552 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645afeb6-16fe-4afb-adfc-b1402befb18e None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:19.083824 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645afeb6-16fe-4afb-adfc-b1402befb18e None admin] PATH_INFO: `/v3/projects/f132d5fdc1024777b2c36b1067e33573/users/fe99dc2428d844968e9d13ed808809d9/roles/962ee04d08ae41b08c1a5108c54c7469` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:19.085929 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645afeb6-16fe-4afb-adfc-b1402befb18e None admin] RBAC: Authorizing `identity:create_grant(project_id=f132d5fdc1024777b2c36b1067e33573, user_id=fe99dc2428d844968e9d13ed808809d9, role_id=962ee04d08ae41b08c1a5108c54c7469)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:19.087357 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645afeb6-16fe-4afb-adfc-b1402befb18e None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:19.099850 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 557/1123] 10.222.0.72 () {58 vars in 1439 bytes} [Mon Sep 19 14:45:18 2022] PUT /identity/v3/projects/f132d5fdc1024777b2c36b1067e33573/users/fe99dc2428d844968e9d13ed808809d9/roles/962ee04d08ae41b08c1a5108c54c7469 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:45:21.218951 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3049bbb5-ac19-4a8b-9b0a-48a437e3b589 None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:21.219483 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3049bbb5-ac19-4a8b-9b0a-48a437e3b589 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:21.219483 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3049bbb5-ac19-4a8b-9b0a-48a437e3b589 None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:21.220859 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 567/1124] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:45:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:45:21.225955 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ac4bcc-7f92-4a24-8778-097d8e743083 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:21.226319 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ac4bcc-7f92-4a24-8778-097d8e743083 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:21.226510 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ac4bcc-7f92-4a24-8778-097d8e743083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:21.244799 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-61ac4bcc-7f92-4a24-8778-097d8e743083 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:45:21.246004 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-61ac4bcc-7f92-4a24-8778-097d8e743083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:45:21.311868 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 558/1125] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:45:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:45:21.579701 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3049bbb5-ac19-4a8b-9b0a-48a437e3b589 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:21.677630 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3049bbb5-ac19-4a8b-9b0a-48a437e3b589 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:21.710200 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69097f9-d367-48ff-b408-89b0dc9a918b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:21.710808 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69097f9-d367-48ff-b408-89b0dc9a918b None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:21.711081 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69097f9-d367-48ff-b408-89b0dc9a918b None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:21.711349 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69097f9-d367-48ff-b408-89b0dc9a918b None admin] PATH_INFO: `/v3/roles/962ee04d08ae41b08c1a5108c54c7469` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:21.712735 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69097f9-d367-48ff-b408-89b0dc9a918b None admin] RBAC: Authorizing `identity:get_role(role_id=962ee04d08ae41b08c1a5108c54c7469)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:21.714087 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69097f9-d367-48ff-b408-89b0dc9a918b None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:21.715472 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 568/1126] 10.222.0.72 () {56 vars in 1177 bytes} [Mon Sep 19 14:45:21 2022] GET /identity/v3/roles/962ee04d08ae41b08c1a5108c54c7469 => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:45:21.721204 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ac4bcc-7f92-4a24-8778-097d8e743083 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:21.729060 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:21.818465 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ac4bcc-7f92-4a24-8778-097d8e743083 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:21.851069 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eaa348-60a5-4703-8de0-6d8da076c36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:21.851610 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eaa348-60a5-4703-8de0-6d8da076c36a None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:21.851886 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eaa348-60a5-4703-8de0-6d8da076c36a None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:21.852154 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eaa348-60a5-4703-8de0-6d8da076c36a None admin] PATH_INFO: `/v3/users/fe99dc2428d844968e9d13ed808809d9` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:21.853271 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eaa348-60a5-4703-8de0-6d8da076c36a None admin] RBAC: Authorizing `identity:get_user(user_id=fe99dc2428d844968e9d13ed808809d9)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:21.854677 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eaa348-60a5-4703-8de0-6d8da076c36a None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:21.856837 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 559/1127] 10.222.0.72 () {56 vars in 1177 bytes} [Mon Sep 19 14:45:21 2022] GET /identity/v3/users/fe99dc2428d844968e9d13ed808809d9 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:45:21.862693 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69097f9-d367-48ff-b408-89b0dc9a918b None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:21.902977 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:21.961970 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69097f9-d367-48ff-b408-89b0dc9a918b None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:21.995877 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f712c77f-7655-4938-8e7a-abdda9d90f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:21.996522 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f712c77f-7655-4938-8e7a-abdda9d90f4a None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:21.996801 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f712c77f-7655-4938-8e7a-abdda9d90f4a None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:21.997076 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f712c77f-7655-4938-8e7a-abdda9d90f4a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:22.061519 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f712c77f-7655-4938-8e7a-abdda9d90f4a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:22.062949 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f712c77f-7655-4938-8e7a-abdda9d90f4a None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:22.099474 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:22.158061 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 569/1128] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Sep 19 14:45:21 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 14:45:22.163971 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eaa348-60a5-4703-8de0-6d8da076c36a None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:22.237338 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:22.262662 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eaa348-60a5-4703-8de0-6d8da076c36a None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:22.295908 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6d5bc9-1566-4baa-9d3c-f7f62e176add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:22.296549 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d5bc9-1566-4baa-9d3c-f7f62e176add None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:22.296832 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d5bc9-1566-4baa-9d3c-f7f62e176add None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:22.297105 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d5bc9-1566-4baa-9d3c-f7f62e176add None admin] PATH_INFO: `/v3/projects/f132d5fdc1024777b2c36b1067e33573` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:22.298201 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6d5bc9-1566-4baa-9d3c-f7f62e176add None admin] RBAC: Authorizing `identity:get_project(project_id=f132d5fdc1024777b2c36b1067e33573)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:22.299616 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6d5bc9-1566-4baa-9d3c-f7f62e176add None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:22.301254 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 560/1129] 10.222.0.72 () {56 vars in 1186 bytes} [Mon Sep 19 14:45:22 2022] GET /identity/v3/projects/f132d5fdc1024777b2c36b1067e33573 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:45:22.307352 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f712c77f-7655-4938-8e7a-abdda9d90f4a None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:22.403923 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f712c77f-7655-4938-8e7a-abdda9d90f4a None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:22.436622 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aad8a9-2f58-4356-a56d-ee2750d736f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:22.437156 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aad8a9-2f58-4356-a56d-ee2750d736f9 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:22.437440 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aad8a9-2f58-4356-a56d-ee2750d736f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:22.437718 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aad8a9-2f58-4356-a56d-ee2750d736f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:22.438430 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9aad8a9-2f58-4356-a56d-ee2750d736f9 None admin] RBAC: Adding query filter params (role.id=962ee04d08ae41b08c1a5108c54c7469, scope.project.id=f132d5fdc1024777b2c36b1067e33573, user.id=fe99dc2428d844968e9d13ed808809d9) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:45:22.438740 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9aad8a9-2f58-4356-a56d-ee2750d736f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:22.440148 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9aad8a9-2f58-4356-a56d-ee2750d736f9 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:22.445676 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 570/1130] 10.222.0.72 () {56 vars in 1374 bytes} [Mon Sep 19 14:45:22 2022] GET /identity/v3/role_assignments?user.id=fe99dc2428d844968e9d13ed808809d9&scope.project.id=f132d5fdc1024777b2c36b1067e33573&role.id=962ee04d08ae41b08c1a5108c54c7469 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:45:24.585032 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3aa72c-59b5-4fad-88bd-508eab333106 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:24.585583 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3aa72c-59b5-4fad-88bd-508eab333106 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:24.585583 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3aa72c-59b5-4fad-88bd-508eab333106 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:24.586938 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 561/1131] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:45:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:45:24.593056 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c68778-31dd-40c5-a2a5-c56bacff3f1e None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:24.593448 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c68778-31dd-40c5-a2a5-c56bacff3f1e None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:24.593607 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c68778-31dd-40c5-a2a5-c56bacff3f1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:24.599837 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:24.612551 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-67c68778-31dd-40c5-a2a5-c56bacff3f1e None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:45:24.613735 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-67c68778-31dd-40c5-a2a5-c56bacff3f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:45:24.686582 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 571/1132] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:45:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:45:24.963723 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3aa72c-59b5-4fad-88bd-508eab333106 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:25.063821 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3aa72c-59b5-4fad-88bd-508eab333106 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:25.096295 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673c1222-f3dd-4620-8de4-a353449b824c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:25.096928 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673c1222-f3dd-4620-8de4-a353449b824c None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:25.097206 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673c1222-f3dd-4620-8de4-a353449b824c None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:25.097474 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673c1222-f3dd-4620-8de4-a353449b824c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:25.098566 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673c1222-f3dd-4620-8de4-a353449b824c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:25.099973 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673c1222-f3dd-4620-8de4-a353449b824c None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:25.101546 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 562/1133] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:45:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:45:25.107900 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c68778-31dd-40c5-a2a5-c56bacff3f1e None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:25.202855 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c68778-31dd-40c5-a2a5-c56bacff3f1e None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:25.231620 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:25.237769 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed2408b-c04d-4c34-a690-5b89075b0d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:25.238372 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed2408b-c04d-4c34-a690-5b89075b0d73 None admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:25.238650 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed2408b-c04d-4c34-a690-5b89075b0d73 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:25.238921 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed2408b-c04d-4c34-a690-5b89075b0d73 None admin] PATH_INFO: `/v3/projects` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:25.239572 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed2408b-c04d-4c34-a690-5b89075b0d73 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:25.241026 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed2408b-c04d-4c34-a690-5b89075b0d73 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:25.267243 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 572/1134] 10.222.0.72 () {60 vars in 1141 bytes} [Mon Sep 19 14:45:25 2022] POST /identity/v3/projects => generated 311 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:45:27.437748 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4d9224-3e44-47ba-a04d-6ee5c8a38417 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:27.438275 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4d9224-3e44-47ba-a04d-6ee5c8a38417 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:27.438275 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4d9224-3e44-47ba-a04d-6ee5c8a38417 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:27.439627 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 563/1135] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:45:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:45:27.444978 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf5f23e-d1b2-4144-919a-fd3096001e47 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:27.445378 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf5f23e-d1b2-4144-919a-fd3096001e47 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:27.445539 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf5f23e-d1b2-4144-919a-fd3096001e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:27.464366 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-3cf5f23e-d1b2-4144-919a-fd3096001e47 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:45:27.465628 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-3cf5f23e-d1b2-4144-919a-fd3096001e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:45:27.529659 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 573/1136] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:45:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:45:27.798147 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4d9224-3e44-47ba-a04d-6ee5c8a38417 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:27.811173 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:27.898675 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4d9224-3e44-47ba-a04d-6ee5c8a38417 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:27.933846 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2756a10d-5ea8-4ad7-b39c-22e22450a913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:27.934466 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2756a10d-5ea8-4ad7-b39c-22e22450a913 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:27.934745 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2756a10d-5ea8-4ad7-b39c-22e22450a913 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:27.935016 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2756a10d-5ea8-4ad7-b39c-22e22450a913 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:27.936392 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2756a10d-5ea8-4ad7-b39c-22e22450a913 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:27.937825 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2756a10d-5ea8-4ad7-b39c-22e22450a913 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:27.939382 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 564/1137] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:45:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:45:27.945145 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf5f23e-d1b2-4144-919a-fd3096001e47 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:28.040630 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf5f23e-d1b2-4144-919a-fd3096001e47 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:28.054738 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:28.075935 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f79f139-401c-4343-a4de-53404d41dc98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:28.076563 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f79f139-401c-4343-a4de-53404d41dc98 None admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:28.076848 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f79f139-401c-4343-a4de-53404d41dc98 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:28.077121 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f79f139-401c-4343-a4de-53404d41dc98 None admin] PATH_INFO: `/v3/users` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:28.077764 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f79f139-401c-4343-a4de-53404d41dc98 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:28.079183 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f79f139-401c-4343-a4de-53404d41dc98 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:28.099716 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 574/1138] 10.222.0.72 () {60 vars in 1132 bytes} [Mon Sep 19 14:45:27 2022] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:45:30.270959 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1e74bb-9920-4bcf-ac79-16a84398e32d None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:30.271498 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1e74bb-9920-4bcf-ac79-16a84398e32d None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:30.271498 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1e74bb-9920-4bcf-ac79-16a84398e32d None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:30.272867 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 565/1139] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:45:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:45:30.278012 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b8302-a672-41c3-9647-abae8e5069df None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:30.278391 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b8302-a672-41c3-9647-abae8e5069df None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:30.278553 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b8302-a672-41c3-9647-abae8e5069df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:30.296231 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-a11b8302-a672-41c3-9647-abae8e5069df None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:45:30.297426 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-a11b8302-a672-41c3-9647-abae8e5069df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:45:30.360828 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 575/1140] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:45:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:45:30.629396 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1e74bb-9920-4bcf-ac79-16a84398e32d None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:30.706537 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:30.728578 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1e74bb-9920-4bcf-ac79-16a84398e32d None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:30.761707 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987a313e-2c1e-46d1-a9bc-390ec9b8cd55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:30.762269 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a313e-2c1e-46d1-a9bc-390ec9b8cd55 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:30.762549 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a313e-2c1e-46d1-a9bc-390ec9b8cd55 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:30.762818 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a313e-2c1e-46d1-a9bc-390ec9b8cd55 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:30.772753 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987a313e-2c1e-46d1-a9bc-390ec9b8cd55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:45:30.778227 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-987a313e-2c1e-46d1-a9bc-390ec9b8cd55 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:45:30.778227 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:45:30.778227 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:45:30.778227 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:45:30.778227 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:45:30.778227 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:45:30.778227 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:45:30.778227 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:45:30.778227 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:45:30.778227 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:45:30.778227 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:45:30.778227 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:45:30.778227 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:45:30.778227 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:45:30.778227 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:45:30.778227 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:45:30.779314 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:45:30.779314 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:45:30.779314 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:45:30.779314 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:45:30.779314 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:45:30.779314 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:45:30.779314 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:45:30.779314 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:45:30.779314 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:45:30.779314 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:45:30.779314 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:45:30.779314 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:45:30.779314 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:45:30.779314 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:45:30.779314 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:45:30.779314 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:45:30.780393 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:45:30.780393 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:45:30.780393 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:45:30.780393 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:45:30.780393 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:45:30.780393 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:45:30.780393 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:45:30.780393 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:45:30.780393 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:45:30.780393 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:45:30.780393 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:45:30.780393 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:45:30.780393 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 566/1141] 10.222.0.72 () {56 vars in 1096 bytes} [Mon Sep 19 14:45:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:45:30.785350 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11b8302-a672-41c3-9647-abae8e5069df None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:30.877194 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:30.880280 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11b8302-a672-41c3-9647-abae8e5069df None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:30.914569 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc07085-fdf5-45fa-b90e-09c70c903a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:30.915171 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc07085-fdf5-45fa-b90e-09c70c903a8e None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:30.915447 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc07085-fdf5-45fa-b90e-09c70c903a8e None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:30.915714 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc07085-fdf5-45fa-b90e-09c70c903a8e None admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:30.916393 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc07085-fdf5-45fa-b90e-09c70c903a8e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:45:30.916699 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc07085-fdf5-45fa-b90e-09c70c903a8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:30.918167 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc07085-fdf5-45fa-b90e-09c70c903a8e None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:30.925885 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 576/1142] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Sep 19 14:45:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:45:30.931940 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987a313e-2c1e-46d1-a9bc-390ec9b8cd55 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:31.035125 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987a313e-2c1e-46d1-a9bc-390ec9b8cd55 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:31.068506 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7471c921-9fc0-472a-973c-5a8e1849b65b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:31.069118 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7471c921-9fc0-472a-973c-5a8e1849b65b None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:31.069393 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7471c921-9fc0-472a-973c-5a8e1849b65b None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:31.069661 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7471c921-9fc0-472a-973c-5a8e1849b65b None admin] PATH_INFO: `/v3/users/a005f9fadc93438f99323b6a45eb5879` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:31.077268 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:31.083535 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7471c921-9fc0-472a-973c-5a8e1849b65b None admin] RBAC: Authorizing `identity:get_user(user_id=a005f9fadc93438f99323b6a45eb5879)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:31.084988 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7471c921-9fc0-472a-973c-5a8e1849b65b None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:31.086557 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 567/1143] 10.222.0.72 () {56 vars in 1177 bytes} [Mon Sep 19 14:45:30 2022] GET /identity/v3/users/a005f9fadc93438f99323b6a45eb5879 => generated 286 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:45:31.092465 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc07085-fdf5-45fa-b90e-09c70c903a8e None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:31.187249 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc07085-fdf5-45fa-b90e-09c70c903a8e None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:31.219239 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6419702a-5333-4dae-991b-be9b506ca17b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:31.219827 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6419702a-5333-4dae-991b-be9b506ca17b None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:31.220104 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6419702a-5333-4dae-991b-be9b506ca17b None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:31.220399 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6419702a-5333-4dae-991b-be9b506ca17b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:31.249977 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:31.289602 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6419702a-5333-4dae-991b-be9b506ca17b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:31.291137 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6419702a-5333-4dae-991b-be9b506ca17b None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:31.390825 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 577/1144] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Sep 19 14:45:31 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 14:45:31.396798 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7471c921-9fc0-472a-973c-5a8e1849b65b None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:31.494409 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7471c921-9fc0-472a-973c-5a8e1849b65b None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:31.527937 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5654b48d-ed00-4ee2-bce8-6ef2f2db695c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:31.528584 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5654b48d-ed00-4ee2-bce8-6ef2f2db695c None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:31.528867 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5654b48d-ed00-4ee2-bce8-6ef2f2db695c None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:31.529141 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5654b48d-ed00-4ee2-bce8-6ef2f2db695c None admin] PATH_INFO: `/v3/projects/102eeb16bc524de0b2c1888b87981a3e` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:31.530235 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5654b48d-ed00-4ee2-bce8-6ef2f2db695c None admin] RBAC: Authorizing `identity:get_project(project_id=102eeb16bc524de0b2c1888b87981a3e)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:31.531692 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5654b48d-ed00-4ee2-bce8-6ef2f2db695c None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:31.533372 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 568/1145] 10.222.0.72 () {56 vars in 1186 bytes} [Mon Sep 19 14:45:31 2022] GET /identity/v3/projects/102eeb16bc524de0b2c1888b87981a3e => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:45:31.539532 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6419702a-5333-4dae-991b-be9b506ca17b None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:31.599288 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:31.638291 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6419702a-5333-4dae-991b-be9b506ca17b None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:31.672607 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc7fc69-ad6a-4321-a517-0dbf5a5ca4f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:31.673201 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc7fc69-ad6a-4321-a517-0dbf5a5ca4f7 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:31.673477 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc7fc69-ad6a-4321-a517-0dbf5a5ca4f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:31.673743 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc7fc69-ad6a-4321-a517-0dbf5a5ca4f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:31.674451 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc7fc69-ad6a-4321-a517-0dbf5a5ca4f7 None admin] RBAC: Adding query filter params (role.id=ddb643577b2e4e478100ec370decfaeb, scope.project.id=102eeb16bc524de0b2c1888b87981a3e, user.id=a005f9fadc93438f99323b6a45eb5879) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:45:31.674756 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc7fc69-ad6a-4321-a517-0dbf5a5ca4f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:31.676155 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc7fc69-ad6a-4321-a517-0dbf5a5ca4f7 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:31.681560 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 578/1146] 10.222.0.72 () {56 vars in 1374 bytes} [Mon Sep 19 14:45:31 2022] GET /identity/v3/role_assignments?user.id=a005f9fadc93438f99323b6a45eb5879&scope.project.id=102eeb16bc524de0b2c1888b87981a3e&role.id=ddb643577b2e4e478100ec370decfaeb => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:45:33.830487 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd42de-08ec-4a83-b5fd-6e1d644b920a None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:33.831020 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd42de-08ec-4a83-b5fd-6e1d644b920a None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:33.831020 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd42de-08ec-4a83-b5fd-6e1d644b920a None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:33.832435 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 569/1147] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:45:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:45:33.837656 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7c2845-07a7-4bc9-912d-0b301d628be5 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:33.838084 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7c2845-07a7-4bc9-912d-0b301d628be5 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:33.838203 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7c2845-07a7-4bc9-912d-0b301d628be5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:33.857001 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-9e7c2845-07a7-4bc9-912d-0b301d628be5 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:45:33.858179 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-9e7c2845-07a7-4bc9-912d-0b301d628be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:45:33.924717 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 579/1148] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:45:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:45:34.195266 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cd42de-08ec-4a83-b5fd-6e1d644b920a None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:34.257764 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:34.295773 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cd42de-08ec-4a83-b5fd-6e1d644b920a None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:34.329255 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e67419d-aefe-4a6c-8318-a97107702417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:34.329860 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e67419d-aefe-4a6c-8318-a97107702417 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:34.330140 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e67419d-aefe-4a6c-8318-a97107702417 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:34.330410 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e67419d-aefe-4a6c-8318-a97107702417 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:34.340450 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e67419d-aefe-4a6c-8318-a97107702417 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:45:34.345299 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-4e67419d-aefe-4a6c-8318-a97107702417 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:45:34.345299 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:45:34.345299 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:45:34.345299 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:45:34.345299 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:45:34.345299 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:45:34.345299 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:45:34.345299 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:45:34.345299 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:45:34.345299 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:45:34.345299 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:45:34.345299 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:45:34.345299 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:45:34.345299 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:45:34.345299 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:45:34.345299 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:45:34.346416 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:45:34.346416 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:45:34.346416 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:45:34.346416 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:45:34.346416 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:45:34.346416 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:45:34.346416 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:45:34.346416 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:45:34.346416 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:45:34.346416 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:45:34.346416 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:45:34.346416 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:45:34.346416 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:45:34.346416 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:45:34.346416 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:45:34.346416 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:45:34.347532 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:45:34.347532 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:45:34.347532 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:45:34.347532 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:45:34.347532 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:45:34.347532 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:45:34.347532 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:45:34.347532 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:45:34.347532 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:45:34.347532 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:45:34.347532 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:45:34.347532 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:45:34.347532 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 570/1149] 10.222.0.72 () {56 vars in 1096 bytes} [Mon Sep 19 14:45:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:45:34.352460 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7c2845-07a7-4bc9-912d-0b301d628be5 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:34.406020 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:34.449351 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7c2845-07a7-4bc9-912d-0b301d628be5 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:34.482137 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d98b2e1-80e2-459c-9169-43acaad2c8bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:34.482740 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d98b2e1-80e2-459c-9169-43acaad2c8bb None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:34.483019 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d98b2e1-80e2-459c-9169-43acaad2c8bb None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:34.483288 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d98b2e1-80e2-459c-9169-43acaad2c8bb None admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:34.483972 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d98b2e1-80e2-459c-9169-43acaad2c8bb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:45:34.484271 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d98b2e1-80e2-459c-9169-43acaad2c8bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:34.485660 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d98b2e1-80e2-459c-9169-43acaad2c8bb None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:34.493464 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 580/1150] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Sep 19 14:45:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:45:34.499937 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e67419d-aefe-4a6c-8318-a97107702417 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:34.600134 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e67419d-aefe-4a6c-8318-a97107702417 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:34.623839 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:34.634451 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0187c5d-8de0-4efc-a0a5-bd834fa1d337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:34.635073 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0187c5d-8de0-4efc-a0a5-bd834fa1d337 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:34.635351 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0187c5d-8de0-4efc-a0a5-bd834fa1d337 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:34.635621 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0187c5d-8de0-4efc-a0a5-bd834fa1d337 None admin] PATH_INFO: `/v3/users/a005f9fadc93438f99323b6a45eb5879` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:34.636852 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0187c5d-8de0-4efc-a0a5-bd834fa1d337 None admin] RBAC: Authorizing `identity:get_user(user_id=a005f9fadc93438f99323b6a45eb5879)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:34.638270 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0187c5d-8de0-4efc-a0a5-bd834fa1d337 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:34.639832 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 571/1151] 10.222.0.72 () {56 vars in 1177 bytes} [Mon Sep 19 14:45:34 2022] GET /identity/v3/users/a005f9fadc93438f99323b6a45eb5879 => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:45:34.645668 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d98b2e1-80e2-459c-9169-43acaad2c8bb None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:34.745931 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d98b2e1-80e2-459c-9169-43acaad2c8bb None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:34.762206 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:34.779379 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5f9dcf-f894-4a01-98b9-b5b6c91a88d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:34.780000 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5f9dcf-f894-4a01-98b9-b5b6c91a88d7 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:34.780283 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5f9dcf-f894-4a01-98b9-b5b6c91a88d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:34.780593 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5f9dcf-f894-4a01-98b9-b5b6c91a88d7 None admin] PATH_INFO: `/v3/projects/102eeb16bc524de0b2c1888b87981a3e` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:34.781702 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5f9dcf-f894-4a01-98b9-b5b6c91a88d7 None admin] RBAC: Authorizing `identity:get_project(project_id=102eeb16bc524de0b2c1888b87981a3e)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:34.783122 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5f9dcf-f894-4a01-98b9-b5b6c91a88d7 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:34.784774 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 581/1152] 10.222.0.72 () {56 vars in 1186 bytes} [Mon Sep 19 14:45:34 2022] GET /identity/v3/projects/102eeb16bc524de0b2c1888b87981a3e => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:45:34.790894 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0187c5d-8de0-4efc-a0a5-bd834fa1d337 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:34.890388 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0187c5d-8de0-4efc-a0a5-bd834fa1d337 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:34.926154 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a380f08-a25c-470f-a699-28b00df7dbdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:34.926812 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a380f08-a25c-470f-a699-28b00df7dbdf None admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:34.927093 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a380f08-a25c-470f-a699-28b00df7dbdf None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:34.927367 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a380f08-a25c-470f-a699-28b00df7dbdf None admin] PATH_INFO: `/v3/projects/102eeb16bc524de0b2c1888b87981a3e/users/a005f9fadc93438f99323b6a45eb5879/roles/ddb643577b2e4e478100ec370decfaeb` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:34.929352 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a380f08-a25c-470f-a699-28b00df7dbdf None admin] RBAC: Authorizing `identity:create_grant(project_id=102eeb16bc524de0b2c1888b87981a3e, user_id=a005f9fadc93438f99323b6a45eb5879, role_id=ddb643577b2e4e478100ec370decfaeb)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:34.930780 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a380f08-a25c-470f-a699-28b00df7dbdf None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:34.944550 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 572/1153] 10.222.0.72 () {58 vars in 1439 bytes} [Mon Sep 19 14:45:34 2022] PUT /identity/v3/projects/102eeb16bc524de0b2c1888b87981a3e/users/a005f9fadc93438f99323b6a45eb5879/roles/ddb643577b2e4e478100ec370decfaeb => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:45:37.088373 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5c7d06-b7d5-46b8-858d-c8c662442daf None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:37.088945 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5c7d06-b7d5-46b8-858d-c8c662442daf None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:37.088945 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5c7d06-b7d5-46b8-858d-c8c662442daf None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:37.090855 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 582/1154] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:45:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:45:37.096116 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d306f967-67bb-4fe9-9929-7e40c068438a None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:37.096574 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d306f967-67bb-4fe9-9929-7e40c068438a None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:37.096707 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d306f967-67bb-4fe9-9929-7e40c068438a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:37.115056 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-d306f967-67bb-4fe9-9929-7e40c068438a None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:45:37.116227 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-d306f967-67bb-4fe9-9929-7e40c068438a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:45:37.161252 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:37.181534 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 573/1155] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:45:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:45:37.452042 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5c7d06-b7d5-46b8-858d-c8c662442daf None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:37.551163 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5c7d06-b7d5-46b8-858d-c8c662442daf None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:37.584428 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58905218-6d26-4fa1-ae9f-6dcef68748b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:37.585036 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58905218-6d26-4fa1-ae9f-6dcef68748b1 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:37.585311 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58905218-6d26-4fa1-ae9f-6dcef68748b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:37.585580 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58905218-6d26-4fa1-ae9f-6dcef68748b1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:37.595338 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58905218-6d26-4fa1-ae9f-6dcef68748b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:45:37.600141 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-58905218-6d26-4fa1-ae9f-6dcef68748b1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:45:37.600141 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:45:37.600141 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:45:37.600141 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:45:37.600141 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:45:37.600141 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:45:37.600141 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:45:37.600141 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:45:37.600141 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:45:37.600141 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:45:37.600141 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:45:37.600141 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:45:37.600141 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:45:37.600141 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:45:37.600141 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:45:37.600141 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:45:37.601329 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:45:37.601329 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:45:37.601329 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:45:37.601329 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:45:37.601329 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:45:37.601329 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:45:37.601329 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:45:37.601329 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:45:37.601329 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:45:37.601329 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:45:37.601329 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:45:37.601329 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:45:37.601329 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:45:37.601329 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:45:37.601329 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:45:37.601329 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:45:37.602443 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:45:37.602443 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:45:37.602443 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:45:37.602443 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:45:37.602443 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:45:37.602443 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:45:37.602443 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:45:37.602443 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:45:37.602443 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:45:37.602443 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:45:37.602443 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:45:37.602443 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:45:37.602443 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 583/1156] 10.222.0.72 () {56 vars in 1096 bytes} [Mon Sep 19 14:45:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:45:37.607993 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d306f967-67bb-4fe9-9929-7e40c068438a None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:37.704718 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d306f967-67bb-4fe9-9929-7e40c068438a None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:37.738019 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fe3577-956f-4acf-8adb-d0989c000318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:37.738615 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fe3577-956f-4acf-8adb-d0989c000318 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:37.738896 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fe3577-956f-4acf-8adb-d0989c000318 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:37.739168 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fe3577-956f-4acf-8adb-d0989c000318 None admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:37.739822 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fe3577-956f-4acf-8adb-d0989c000318 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:45:37.740122 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fe3577-956f-4acf-8adb-d0989c000318 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:37.741514 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fe3577-956f-4acf-8adb-d0989c000318 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:37.749330 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 574/1157] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Sep 19 14:45:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:45:37.755169 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58905218-6d26-4fa1-ae9f-6dcef68748b1 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:37.800932 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:37.851814 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58905218-6d26-4fa1-ae9f-6dcef68748b1 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:37.884978 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed6bea6-f68b-4e47-bf78-7075ac7550a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:37.885592 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed6bea6-f68b-4e47-bf78-7075ac7550a3 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:37.885944 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed6bea6-f68b-4e47-bf78-7075ac7550a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:37.886218 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed6bea6-f68b-4e47-bf78-7075ac7550a3 None admin] PATH_INFO: `/v3/users/a005f9fadc93438f99323b6a45eb5879` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:37.887320 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed6bea6-f68b-4e47-bf78-7075ac7550a3 None admin] RBAC: Authorizing `identity:get_user(user_id=a005f9fadc93438f99323b6a45eb5879)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:37.888785 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed6bea6-f68b-4e47-bf78-7075ac7550a3 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:37.890348 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 584/1158] 10.222.0.72 () {56 vars in 1177 bytes} [Mon Sep 19 14:45:37 2022] GET /identity/v3/users/a005f9fadc93438f99323b6a45eb5879 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:45:37.896091 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fe3577-956f-4acf-8adb-d0989c000318 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:37.942402 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:37.995374 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fe3577-956f-4acf-8adb-d0989c000318 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:38.028426 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120a71c1-b6d9-4b04-8267-4b84e097279a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:38.029013 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120a71c1-b6d9-4b04-8267-4b84e097279a None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:38.029290 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120a71c1-b6d9-4b04-8267-4b84e097279a None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:38.029560 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120a71c1-b6d9-4b04-8267-4b84e097279a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:38.093685 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120a71c1-b6d9-4b04-8267-4b84e097279a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:38.095113 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120a71c1-b6d9-4b04-8267-4b84e097279a None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:38.137554 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:38.191289 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 575/1159] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Sep 19 14:45:37 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 14:45:38.197291 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed6bea6-f68b-4e47-bf78-7075ac7550a3 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:38.293598 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed6bea6-f68b-4e47-bf78-7075ac7550a3 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:38.306916 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:38.327823 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a0473e-bc14-42bd-bdfe-e54e54e6ba79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:38.328472 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a0473e-bc14-42bd-bdfe-e54e54e6ba79 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:38.328757 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a0473e-bc14-42bd-bdfe-e54e54e6ba79 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:38.329030 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a0473e-bc14-42bd-bdfe-e54e54e6ba79 None admin] PATH_INFO: `/v3/projects/102eeb16bc524de0b2c1888b87981a3e` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:38.330129 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a0473e-bc14-42bd-bdfe-e54e54e6ba79 None admin] RBAC: Authorizing `identity:get_project(project_id=102eeb16bc524de0b2c1888b87981a3e)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:38.331543 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a0473e-bc14-42bd-bdfe-e54e54e6ba79 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:38.333168 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 585/1160] 10.222.0.72 () {56 vars in 1186 bytes} [Mon Sep 19 14:45:38 2022] GET /identity/v3/projects/102eeb16bc524de0b2c1888b87981a3e => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:45:38.339515 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120a71c1-b6d9-4b04-8267-4b84e097279a None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:38.436399 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120a71c1-b6d9-4b04-8267-4b84e097279a None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:38.469485 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e467840-0d21-4c74-860b-00a234761aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:38.470075 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e467840-0d21-4c74-860b-00a234761aba None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:38.470352 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e467840-0d21-4c74-860b-00a234761aba None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:38.470620 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e467840-0d21-4c74-860b-00a234761aba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:38.471319 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e467840-0d21-4c74-860b-00a234761aba None admin] RBAC: Adding query filter params (role.id=ddb643577b2e4e478100ec370decfaeb, scope.project.id=102eeb16bc524de0b2c1888b87981a3e, user.id=a005f9fadc93438f99323b6a45eb5879) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:45:38.471621 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e467840-0d21-4c74-860b-00a234761aba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:38.473051 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e467840-0d21-4c74-860b-00a234761aba None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:38.478681 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 576/1161] 10.222.0.72 () {56 vars in 1374 bytes} [Mon Sep 19 14:45:38 2022] GET /identity/v3/role_assignments?user.id=a005f9fadc93438f99323b6a45eb5879&scope.project.id=102eeb16bc524de0b2c1888b87981a3e&role.id=ddb643577b2e4e478100ec370decfaeb => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:45:40.639263 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd30517f-4335-43fd-b104-672711139bd2 None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:40.639793 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd30517f-4335-43fd-b104-672711139bd2 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:40.639793 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd30517f-4335-43fd-b104-672711139bd2 None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:40.641155 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 586/1162] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:45:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:45:40.646392 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c1d8da-acb0-4f23-8359-cb5d36fc1621 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:40.646842 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c1d8da-acb0-4f23-8359-cb5d36fc1621 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:40.646937 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c1d8da-acb0-4f23-8359-cb5d36fc1621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:40.665236 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-52c1d8da-acb0-4f23-8359-cb5d36fc1621 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:45:40.666392 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-52c1d8da-acb0-4f23-8359-cb5d36fc1621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:45:40.669024 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:40.732400 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 577/1163] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:45:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 14:45:41.008190 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd30517f-4335-43fd-b104-672711139bd2 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:41.107743 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd30517f-4335-43fd-b104-672711139bd2 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:41.140619 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57e8c19-013d-4f4c-98cb-b3cc9636d0ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:41.141208 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57e8c19-013d-4f4c-98cb-b3cc9636d0ac None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:41.141486 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57e8c19-013d-4f4c-98cb-b3cc9636d0ac None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:41.141757 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57e8c19-013d-4f4c-98cb-b3cc9636d0ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:41.188275 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:41.206432 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57e8c19-013d-4f4c-98cb-b3cc9636d0ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:41.207856 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57e8c19-013d-4f4c-98cb-b3cc9636d0ac None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:41.301192 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 587/1164] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Sep 19 14:45:41 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 14:45:41.307126 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c1d8da-acb0-4f23-8359-cb5d36fc1621 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:41.404218 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c1d8da-acb0-4f23-8359-cb5d36fc1621 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:41.436830 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93143fe4-4581-4163-b231-5df92aaf899e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:41.437439 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93143fe4-4581-4163-b231-5df92aaf899e None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:41.437714 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93143fe4-4581-4163-b231-5df92aaf899e None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:41.437983 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93143fe4-4581-4163-b231-5df92aaf899e None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:41.444365 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93143fe4-4581-4163-b231-5df92aaf899e None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:41.445731 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93143fe4-4581-4163-b231-5df92aaf899e None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:41.447381 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:41.457781 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-93143fe4-4581-4163-b231-5df92aaf899e None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 19 14:45:41.457781 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:45:41.457781 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 19 14:45:41.457781 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 19 14:45:41.457781 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:45:41.457781 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:45:41.457781 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:45:41.457781 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:45:41.457781 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 19 14:45:41.457781 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:45:41.457781 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 14:45:41.457781 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:45:41.457781 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:45:41.457781 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:45:41.457781 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:45:41.457781 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:45:41.457781 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:45:41.459039 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:45:41.459039 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:45:41.459039 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:45:41.459039 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:45:41.459039 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:45:41.459039 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:45:41.459039 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:45:41.459039 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:45:41.459039 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:45:41.459039 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:45:41.459039 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:45:41.459039 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:45:41.459039 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:45:41.459039 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:45:41.459039 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:45:41.459039 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:45:41.460162 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:45:41.460162 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:45:41.460162 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:45:41.460162 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:45:41.460162 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:45:41.460162 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:45:41.460162 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:45:41.460162 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:45:41.460162 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:45:41.460162 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:45:41.460162 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 19 14:45:41.460162 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:45:41.460162 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 19 14:45:41.460162 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:45:41.460162 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 578/1165] 10.222.0.72 () {56 vars in 1117 bytes} [Mon Sep 19 14:45:41 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:45:41.465281 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57e8c19-013d-4f4c-98cb-b3cc9636d0ac None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:41.542808 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:41.560388 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57e8c19-013d-4f4c-98cb-b3cc9636d0ac None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:41.594009 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a0faa8-af5c-4a68-a075-8bc214e81fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:41.594602 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a0faa8-af5c-4a68-a075-8bc214e81fa8 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:41.594880 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a0faa8-af5c-4a68-a075-8bc214e81fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:41.595149 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a0faa8-af5c-4a68-a075-8bc214e81fa8 None admin] PATH_INFO: `/v3/domains` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:41.595779 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a0faa8-af5c-4a68-a075-8bc214e81fa8 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:45:41.596079 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a0faa8-af5c-4a68-a075-8bc214e81fa8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:41.597463 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a0faa8-af5c-4a68-a075-8bc214e81fa8 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:41.604301 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 588/1166] 10.222.0.72 () {56 vars in 1115 bytes} [Mon Sep 19 14:45:41 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:45:43.734620 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aace54ff-cb1c-4ce3-9961-a147f65066a1 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:43.735168 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aace54ff-cb1c-4ce3-9961-a147f65066a1 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:43.735168 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aace54ff-cb1c-4ce3-9961-a147f65066a1 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:43.736520 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 579/1167] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:45:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:45:43.741774 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b62c19-d0fd-4d73-b72d-b78474978e85 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:43.742193 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b62c19-d0fd-4d73-b72d-b78474978e85 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:43.742366 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b62c19-d0fd-4d73-b72d-b78474978e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:43.760455 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-49b62c19-d0fd-4d73-b72d-b78474978e85 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:45:43.761849 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-49b62c19-d0fd-4d73-b72d-b78474978e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:45:43.826688 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 589/1168] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:45:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:45:44.090732 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aace54ff-cb1c-4ce3-9961-a147f65066a1 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:44.189518 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aace54ff-cb1c-4ce3-9961-a147f65066a1 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:44.222076 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673f112c-746d-4c6b-9376-ad70a8b9e4fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:44.222668 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673f112c-746d-4c6b-9376-ad70a8b9e4fb None admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:44.222948 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673f112c-746d-4c6b-9376-ad70a8b9e4fb None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:44.223221 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673f112c-746d-4c6b-9376-ad70a8b9e4fb None admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:44.223880 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673f112c-746d-4c6b-9376-ad70a8b9e4fb None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:44.225266 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673f112c-746d-4c6b-9376-ad70a8b9e4fb None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:44.241100 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 580/1169] 10.222.0.72 () {60 vars in 1138 bytes} [Mon Sep 19 14:45:44 2022] POST /identity/v3/domains => generated 267 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:45:46.380879 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b154411e-061f-4e66-bc61-cea7d9e58eab None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:46.381437 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b154411e-061f-4e66-bc61-cea7d9e58eab None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:46.381437 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b154411e-061f-4e66-bc61-cea7d9e58eab None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:46.382747 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 590/1170] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:45:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:45:46.388488 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f46a85a-0ad2-4a47-877f-16715dd32696 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:46.388901 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f46a85a-0ad2-4a47-877f-16715dd32696 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:46.389045 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f46a85a-0ad2-4a47-877f-16715dd32696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:46.406906 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-0f46a85a-0ad2-4a47-877f-16715dd32696 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:45:46.408087 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-0f46a85a-0ad2-4a47-877f-16715dd32696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:45:46.459939 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:46.474591 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 581/1171] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:45:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:45:46.739841 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b154411e-061f-4e66-bc61-cea7d9e58eab None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:46.817166 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:46.844197 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b154411e-061f-4e66-bc61-cea7d9e58eab None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:46.877859 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8619eca2-f652-4402-b212-736092f583dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:46.878470 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8619eca2-f652-4402-b212-736092f583dc None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:46.878747 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8619eca2-f652-4402-b212-736092f583dc None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:46.879015 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8619eca2-f652-4402-b212-736092f583dc None admin] PATH_INFO: `/v3/domains/8c70a23187aa46c7b0cf3fc6417d67e8` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:46.889524 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8619eca2-f652-4402-b212-736092f583dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=8c70a23187aa46c7b0cf3fc6417d67e8)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:46.890961 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8619eca2-f652-4402-b212-736092f583dc None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:46.892564 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 591/1172] 10.222.0.72 () {56 vars in 1183 bytes} [Mon Sep 19 14:45:46 2022] GET /identity/v3/domains/8c70a23187aa46c7b0cf3fc6417d67e8 => generated 267 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:45:46.898373 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f46a85a-0ad2-4a47-877f-16715dd32696 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:47.001224 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f46a85a-0ad2-4a47-877f-16715dd32696 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:47.033908 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d4167f-a147-4824-a9c7-4b67dc17018b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:47.034502 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d4167f-a147-4824-a9c7-4b67dc17018b None admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:47.034781 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d4167f-a147-4824-a9c7-4b67dc17018b None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:47.035053 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d4167f-a147-4824-a9c7-4b67dc17018b None admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:47.035707 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d4167f-a147-4824-a9c7-4b67dc17018b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:47.037158 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d4167f-a147-4824-a9c7-4b67dc17018b None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:47.064200 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 582/1173] 10.222.0.72 () {60 vars in 1141 bytes} [Mon Sep 19 14:45:46 2022] POST /identity/v3/projects => generated 361 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 14:45:49.230321 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a31b7a5-bb44-46bd-a139-8ee200c0259c None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:49.230811 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a31b7a5-bb44-46bd-a139-8ee200c0259c None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:49.230922 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a31b7a5-bb44-46bd-a139-8ee200c0259c None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:49.232194 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 592/1174] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:45:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:45:49.237436 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa4d762-978d-450c-ac6b-a11e7522bbdd None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:49.237825 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa4d762-978d-450c-ac6b-a11e7522bbdd None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:49.237986 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa4d762-978d-450c-ac6b-a11e7522bbdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:49.255844 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-4aa4d762-978d-450c-ac6b-a11e7522bbdd None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:45:49.257052 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-4aa4d762-978d-450c-ac6b-a11e7522bbdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:45:49.291220 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:49.324796 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 583/1175] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:45:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:45:49.600246 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a31b7a5-bb44-46bd-a139-8ee200c0259c None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:49.699849 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a31b7a5-bb44-46bd-a139-8ee200c0259c None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:49.731796 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae901735-363b-4159-b75e-810e0777c5ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:49.732429 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae901735-363b-4159-b75e-810e0777c5ba None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:49.732720 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae901735-363b-4159-b75e-810e0777c5ba None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:49.732996 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae901735-363b-4159-b75e-810e0777c5ba None admin] PATH_INFO: `/v3/domains/8c70a23187aa46c7b0cf3fc6417d67e8` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:49.734100 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae901735-363b-4159-b75e-810e0777c5ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=8c70a23187aa46c7b0cf3fc6417d67e8)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:49.735512 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae901735-363b-4159-b75e-810e0777c5ba None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:49.737074 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 593/1176] 10.222.0.72 () {56 vars in 1183 bytes} [Mon Sep 19 14:45:49 2022] GET /identity/v3/domains/8c70a23187aa46c7b0cf3fc6417d67e8 => generated 267 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:45:49.742711 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa4d762-978d-450c-ac6b-a11e7522bbdd None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:49.840505 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa4d762-978d-450c-ac6b-a11e7522bbdd None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:49.873746 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9601ea-cba9-4107-a6f2-53b63c3cdbfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:49.874272 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9601ea-cba9-4107-a6f2-53b63c3cdbfc None admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:49.874552 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9601ea-cba9-4107-a6f2-53b63c3cdbfc None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:49.874825 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9601ea-cba9-4107-a6f2-53b63c3cdbfc None admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:49.875461 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9601ea-cba9-4107-a6f2-53b63c3cdbfc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:49.876916 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9601ea-cba9-4107-a6f2-53b63c3cdbfc None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:49.898651 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 584/1177] 10.222.0.72 () {60 vars in 1132 bytes} [Mon Sep 19 14:45:49 2022] POST /identity/v3/users => generated 311 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:45:52.081807 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0988da-78fc-4ea0-96c7-c6044d97911f None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:52.082357 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0988da-78fc-4ea0-96c7-c6044d97911f None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:52.082357 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0988da-78fc-4ea0-96c7-c6044d97911f None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:52.083660 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 594/1178] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:45:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:45:52.089506 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e114232-da3a-4d81-9661-cd7c6ff2d1f8 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:52.090063 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e114232-da3a-4d81-9661-cd7c6ff2d1f8 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:52.090063 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e114232-da3a-4d81-9661-cd7c6ff2d1f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:52.108271 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-3e114232-da3a-4d81-9661-cd7c6ff2d1f8 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:45:52.109463 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-3e114232-da3a-4d81-9661-cd7c6ff2d1f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:45:52.129273 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:52.174915 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 585/1179] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:45:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 14:45:52.445369 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0988da-78fc-4ea0-96c7-c6044d97911f None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:52.449674 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:52.544548 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0988da-78fc-4ea0-96c7-c6044d97911f None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:52.577722 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa33357-f45c-4ad8-a612-5a7ccafa7ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:52.578337 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa33357-f45c-4ad8-a612-5a7ccafa7ab9 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:52.578615 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa33357-f45c-4ad8-a612-5a7ccafa7ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:52.578891 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa33357-f45c-4ad8-a612-5a7ccafa7ab9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:52.588569 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa33357-f45c-4ad8-a612-5a7ccafa7ab9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:45:52.593987 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-5fa33357-f45c-4ad8-a612-5a7ccafa7ab9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:45:52.593987 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:45:52.593987 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:45:52.593987 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:45:52.593987 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:45:52.593987 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:45:52.593987 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:45:52.593987 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:45:52.593987 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:45:52.593987 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:45:52.593987 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:45:52.593987 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:45:52.593987 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:45:52.593987 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:45:52.593987 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:45:52.593987 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:45:52.595080 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:45:52.595080 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:45:52.595080 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:45:52.595080 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:45:52.595080 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:45:52.595080 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:45:52.595080 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:45:52.595080 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:45:52.595080 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:45:52.595080 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:45:52.595080 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:45:52.595080 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:45:52.595080 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:45:52.595080 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:45:52.595080 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:45:52.595080 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:45:52.595936 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:45:52.595936 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:45:52.595936 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:45:52.595936 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:45:52.595936 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:45:52.595936 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:45:52.595936 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:45:52.595936 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:45:52.595936 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:45:52.595936 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:45:52.595936 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:45:52.595936 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:45:52.595936 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 595/1180] 10.222.0.72 () {56 vars in 1096 bytes} [Mon Sep 19 14:45:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:45:52.601107 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e114232-da3a-4d81-9661-cd7c6ff2d1f8 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:52.697698 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e114232-da3a-4d81-9661-cd7c6ff2d1f8 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:52.730847 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b47c48-3899-4cdb-a404-9201f851c4da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:52.731435 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b47c48-3899-4cdb-a404-9201f851c4da None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:52.731712 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b47c48-3899-4cdb-a404-9201f851c4da None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:52.731983 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b47c48-3899-4cdb-a404-9201f851c4da None admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:52.732665 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b47c48-3899-4cdb-a404-9201f851c4da None admin] RBAC: Adding query filter params (name=admin) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:45:52.732972 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b47c48-3899-4cdb-a404-9201f851c4da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:52.734328 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b47c48-3899-4cdb-a404-9201f851c4da None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:52.742027 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 586/1181] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Sep 19 14:45:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:45:52.748477 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa33357-f45c-4ad8-a612-5a7ccafa7ab9 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:52.808832 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:52.846000 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa33357-f45c-4ad8-a612-5a7ccafa7ab9 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:52.878734 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4506f8-24bd-4dd3-afc3-e9c21f99234d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:52.879345 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4506f8-24bd-4dd3-afc3-e9c21f99234d None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:52.879622 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4506f8-24bd-4dd3-afc3-e9c21f99234d None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:52.879991 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4506f8-24bd-4dd3-afc3-e9c21f99234d None admin] PATH_INFO: `/v3/users/dddc668641d743158d7211e1422e0040` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:52.893346 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4506f8-24bd-4dd3-afc3-e9c21f99234d None admin] RBAC: Authorizing `identity:get_user(user_id=dddc668641d743158d7211e1422e0040)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:52.894783 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4506f8-24bd-4dd3-afc3-e9c21f99234d None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:52.896420 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 596/1182] 10.222.0.72 () {56 vars in 1177 bytes} [Mon Sep 19 14:45:52 2022] GET /identity/v3/users/dddc668641d743158d7211e1422e0040 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:45:52.902149 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b47c48-3899-4cdb-a404-9201f851c4da None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:52.921311 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:53.000515 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b47c48-3899-4cdb-a404-9201f851c4da None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:53.032191 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe9d85a-7de9-4ff0-a08d-06377e57c58e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:53.032811 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe9d85a-7de9-4ff0-a08d-06377e57c58e None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:53.033088 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe9d85a-7de9-4ff0-a08d-06377e57c58e None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:53.033355 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe9d85a-7de9-4ff0-a08d-06377e57c58e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:53.107290 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe9d85a-7de9-4ff0-a08d-06377e57c58e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:53.108741 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe9d85a-7de9-4ff0-a08d-06377e57c58e None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:53.125660 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:53.204851 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 587/1183] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Sep 19 14:45:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 14:45:53.210770 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4506f8-24bd-4dd3-afc3-e9c21f99234d None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:53.305829 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4506f8-24bd-4dd3-afc3-e9c21f99234d None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:53.328943 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:53.341088 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb38044-8732-4288-8781-d92fdc349800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:53.341708 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb38044-8732-4288-8781-d92fdc349800 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:53.341987 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb38044-8732-4288-8781-d92fdc349800 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:53.342258 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb38044-8732-4288-8781-d92fdc349800 None admin] PATH_INFO: `/v3/projects/f78120e3752e4e9cac415cf8f4eba790` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:53.343359 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb38044-8732-4288-8781-d92fdc349800 None admin] RBAC: Authorizing `identity:get_project(project_id=f78120e3752e4e9cac415cf8f4eba790)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:53.344797 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb38044-8732-4288-8781-d92fdc349800 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:53.346394 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 597/1184] 10.222.0.72 () {56 vars in 1186 bytes} [Mon Sep 19 14:45:53 2022] GET /identity/v3/projects/f78120e3752e4e9cac415cf8f4eba790 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:45:53.352436 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe9d85a-7de9-4ff0-a08d-06377e57c58e None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:53.447371 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe9d85a-7de9-4ff0-a08d-06377e57c58e None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:53.466250 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:53.483437 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c691ee9e-b3ee-4267-ac94-59fb4226e8ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:53.484032 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c691ee9e-b3ee-4267-ac94-59fb4226e8ba None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:53.484313 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c691ee9e-b3ee-4267-ac94-59fb4226e8ba None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:53.484619 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c691ee9e-b3ee-4267-ac94-59fb4226e8ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:53.485328 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c691ee9e-b3ee-4267-ac94-59fb4226e8ba None admin] RBAC: Adding query filter params (role.id=ddb643577b2e4e478100ec370decfaeb, scope.project.id=f78120e3752e4e9cac415cf8f4eba790, user.id=dddc668641d743158d7211e1422e0040) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:45:53.485636 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c691ee9e-b3ee-4267-ac94-59fb4226e8ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:53.487060 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c691ee9e-b3ee-4267-ac94-59fb4226e8ba None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:53.492296 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 588/1185] 10.222.0.72 () {56 vars in 1374 bytes} [Mon Sep 19 14:45:53 2022] GET /identity/v3/role_assignments?user.id=dddc668641d743158d7211e1422e0040&scope.project.id=f78120e3752e4e9cac415cf8f4eba790&role.id=ddb643577b2e4e478100ec370decfaeb => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:45:55.616304 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55165d33-ae1e-438d-acef-a05cec8d3c62 None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:55.616930 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55165d33-ae1e-438d-acef-a05cec8d3c62 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:55.616930 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55165d33-ae1e-438d-acef-a05cec8d3c62 None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:55.618189 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 598/1186] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:45:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:45:55.623325 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d79c966-f4b5-4739-aefd-044217c8a709 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:55.623748 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d79c966-f4b5-4739-aefd-044217c8a709 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:55.623864 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d79c966-f4b5-4739-aefd-044217c8a709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:55.642578 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-9d79c966-f4b5-4739-aefd-044217c8a709 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:45:55.643762 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-9d79c966-f4b5-4739-aefd-044217c8a709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:45:55.709403 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 589/1187] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:45:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:45:55.976837 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55165d33-ae1e-438d-acef-a05cec8d3c62 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:56.075753 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55165d33-ae1e-438d-acef-a05cec8d3c62 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:56.108045 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959e4be6-af27-4c72-8d56-cff527a5b88b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:56.108686 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959e4be6-af27-4c72-8d56-cff527a5b88b None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:56.108965 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959e4be6-af27-4c72-8d56-cff527a5b88b None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:56.109239 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959e4be6-af27-4c72-8d56-cff527a5b88b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:56.119132 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959e4be6-af27-4c72-8d56-cff527a5b88b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:45:56.124089 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-959e4be6-af27-4c72-8d56-cff527a5b88b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:45:56.124089 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:45:56.124089 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:45:56.124089 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:45:56.124089 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:45:56.124089 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:45:56.124089 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:45:56.124089 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:45:56.124089 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:45:56.124089 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:45:56.124089 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:45:56.124089 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:45:56.124089 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:45:56.124089 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:45:56.124089 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:45:56.124089 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:45:56.125178 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:45:56.125178 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:45:56.125178 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:45:56.125178 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:45:56.125178 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:45:56.125178 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:45:56.125178 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:45:56.125178 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:45:56.125178 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:45:56.125178 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:45:56.125178 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:45:56.125178 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:45:56.125178 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:45:56.125178 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:45:56.125178 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:45:56.125178 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:45:56.126138 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:45:56.126138 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:45:56.126138 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:45:56.126138 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:45:56.126138 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:45:56.126138 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:45:56.126138 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:45:56.126138 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:45:56.126138 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:45:56.126138 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:45:56.126138 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:45:56.126138 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:45:56.126138 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 599/1188] 10.222.0.72 () {56 vars in 1096 bytes} [Mon Sep 19 14:45:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:45:56.131177 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d79c966-f4b5-4739-aefd-044217c8a709 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:56.227378 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d79c966-f4b5-4739-aefd-044217c8a709 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:56.239823 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:56.259954 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48afa236-9e8f-4655-812a-d3aa9448d372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:56.260573 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48afa236-9e8f-4655-812a-d3aa9448d372 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:56.261439 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48afa236-9e8f-4655-812a-d3aa9448d372 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:56.261846 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48afa236-9e8f-4655-812a-d3aa9448d372 None admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:56.262494 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48afa236-9e8f-4655-812a-d3aa9448d372 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:45:56.262791 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48afa236-9e8f-4655-812a-d3aa9448d372 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:56.264136 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48afa236-9e8f-4655-812a-d3aa9448d372 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:56.273693 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 590/1189] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Sep 19 14:45:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:45:56.280269 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959e4be6-af27-4c72-8d56-cff527a5b88b None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:56.329225 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:56.377682 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959e4be6-af27-4c72-8d56-cff527a5b88b None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:56.410206 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bee13ce-9e77-42ff-93a9-350c5e41d18f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:56.410821 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee13ce-9e77-42ff-93a9-350c5e41d18f None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:56.411101 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee13ce-9e77-42ff-93a9-350c5e41d18f None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:56.411374 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee13ce-9e77-42ff-93a9-350c5e41d18f None admin] PATH_INFO: `/v3/users/dddc668641d743158d7211e1422e0040` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:56.412504 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bee13ce-9e77-42ff-93a9-350c5e41d18f None admin] RBAC: Authorizing `identity:get_user(user_id=dddc668641d743158d7211e1422e0040)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:56.413923 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bee13ce-9e77-42ff-93a9-350c5e41d18f None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:56.415470 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 600/1190] 10.222.0.72 () {56 vars in 1177 bytes} [Mon Sep 19 14:45:56 2022] GET /identity/v3/users/dddc668641d743158d7211e1422e0040 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:45:56.421226 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48afa236-9e8f-4655-812a-d3aa9448d372 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:56.518667 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48afa236-9e8f-4655-812a-d3aa9448d372 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:56.550449 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bc7a2c-0fbf-40d1-83eb-528e7d1b1ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:56.551066 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bc7a2c-0fbf-40d1-83eb-528e7d1b1ec7 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:56.551349 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bc7a2c-0fbf-40d1-83eb-528e7d1b1ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:56.551617 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bc7a2c-0fbf-40d1-83eb-528e7d1b1ec7 None admin] PATH_INFO: `/v3/projects/f78120e3752e4e9cac415cf8f4eba790` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:56.552758 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bc7a2c-0fbf-40d1-83eb-528e7d1b1ec7 None admin] RBAC: Authorizing `identity:get_project(project_id=f78120e3752e4e9cac415cf8f4eba790)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:56.554175 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bc7a2c-0fbf-40d1-83eb-528e7d1b1ec7 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:56.555796 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 591/1191] 10.222.0.72 () {56 vars in 1186 bytes} [Mon Sep 19 14:45:56 2022] GET /identity/v3/projects/f78120e3752e4e9cac415cf8f4eba790 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:45:56.562684 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bee13ce-9e77-42ff-93a9-350c5e41d18f None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:56.661490 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bee13ce-9e77-42ff-93a9-350c5e41d18f None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:56.678336 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:56.696160 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d04fac-8aa2-4016-aa3f-b34882a38efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:56.696837 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d04fac-8aa2-4016-aa3f-b34882a38efa None admin] REQUEST_METHOD: `PUT` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:56.697121 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d04fac-8aa2-4016-aa3f-b34882a38efa None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:56.697400 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d04fac-8aa2-4016-aa3f-b34882a38efa None admin] PATH_INFO: `/v3/projects/f78120e3752e4e9cac415cf8f4eba790/users/dddc668641d743158d7211e1422e0040/roles/ddb643577b2e4e478100ec370decfaeb` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:56.699967 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d04fac-8aa2-4016-aa3f-b34882a38efa None admin] RBAC: Authorizing `identity:create_grant(project_id=f78120e3752e4e9cac415cf8f4eba790, user_id=dddc668641d743158d7211e1422e0040, role_id=ddb643577b2e4e478100ec370decfaeb)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:56.701422 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d04fac-8aa2-4016-aa3f-b34882a38efa None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:56.713538 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 601/1192] 10.222.0.72 () {58 vars in 1439 bytes} [Mon Sep 19 14:45:56 2022] PUT /identity/v3/projects/f78120e3752e4e9cac415cf8f4eba790/users/dddc668641d743158d7211e1422e0040/roles/ddb643577b2e4e478100ec370decfaeb => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:45:58.882730 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20dcd60-7bd4-451d-bde9-2bf371a0bdb0 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:58.883262 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20dcd60-7bd4-451d-bde9-2bf371a0bdb0 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:58.883262 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20dcd60-7bd4-451d-bde9-2bf371a0bdb0 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:58.884728 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 592/1193] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:45:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:45:58.890179 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b721d139-037a-44e6-aae5-c751f98650ff None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:58.890606 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b721d139-037a-44e6-aae5-c751f98650ff None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:58.890730 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b721d139-037a-44e6-aae5-c751f98650ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:58.909370 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-b721d139-037a-44e6-aae5-c751f98650ff None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:45:58.910543 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-b721d139-037a-44e6-aae5-c751f98650ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:45:58.976717 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 602/1194] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:45:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:45:59.245984 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20dcd60-7bd4-451d-bde9-2bf371a0bdb0 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:59.291816 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:59.349526 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20dcd60-7bd4-451d-bde9-2bf371a0bdb0 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:59.382212 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d967cea9-bd11-47df-88ab-29ef9e6047e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:59.382831 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d967cea9-bd11-47df-88ab-29ef9e6047e8 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:59.383112 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d967cea9-bd11-47df-88ab-29ef9e6047e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:59.383384 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d967cea9-bd11-47df-88ab-29ef9e6047e8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:59.393868 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d967cea9-bd11-47df-88ab-29ef9e6047e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:45:59.398713 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-d967cea9-bd11-47df-88ab-29ef9e6047e8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:45:59.398713 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:45:59.398713 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:45:59.398713 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:45:59.398713 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:45:59.398713 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:45:59.398713 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:45:59.398713 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:45:59.398713 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:45:59.398713 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:45:59.398713 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:45:59.398713 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:45:59.398713 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:45:59.398713 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:45:59.398713 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:45:59.398713 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:45:59.399787 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:45:59.399787 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:45:59.399787 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:45:59.399787 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:45:59.399787 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:45:59.399787 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:45:59.399787 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:45:59.399787 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:45:59.399787 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:45:59.399787 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:45:59.399787 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:45:59.399787 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:45:59.399787 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:45:59.399787 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:45:59.399787 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:45:59.399787 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:45:59.400719 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:45:59.400719 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:45:59.400719 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:45:59.400719 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:45:59.400719 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:45:59.400719 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:45:59.400719 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:45:59.400719 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:45:59.400719 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:45:59.400719 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:45:59.400719 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:45:59.400719 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:45:59.400719 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 593/1195] 10.222.0.72 () {56 vars in 1096 bytes} [Mon Sep 19 14:45:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:45:59.406660 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b721d139-037a-44e6-aae5-c751f98650ff None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:59.503743 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b721d139-037a-44e6-aae5-c751f98650ff None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:59.512875 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:59.539343 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb99a74d-3279-4c20-8c5a-5dc8da6b8983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:59.539934 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb99a74d-3279-4c20-8c5a-5dc8da6b8983 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:59.540209 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb99a74d-3279-4c20-8c5a-5dc8da6b8983 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:59.540506 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb99a74d-3279-4c20-8c5a-5dc8da6b8983 None admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:59.541157 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb99a74d-3279-4c20-8c5a-5dc8da6b8983 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:45:59.541455 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb99a74d-3279-4c20-8c5a-5dc8da6b8983 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:59.543415 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb99a74d-3279-4c20-8c5a-5dc8da6b8983 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:59.551536 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 603/1196] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Sep 19 14:45:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:45:59.557461 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d967cea9-bd11-47df-88ab-29ef9e6047e8 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:59.655524 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d967cea9-bd11-47df-88ab-29ef9e6047e8 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:59.657035 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:59.689249 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bdb8c2-9852-4054-a93c-34838321ce91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:59.689867 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bdb8c2-9852-4054-a93c-34838321ce91 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:59.690142 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bdb8c2-9852-4054-a93c-34838321ce91 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:59.690412 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bdb8c2-9852-4054-a93c-34838321ce91 None admin] PATH_INFO: `/v3/users/dddc668641d743158d7211e1422e0040` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:59.691492 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bdb8c2-9852-4054-a93c-34838321ce91 None admin] RBAC: Authorizing `identity:get_user(user_id=dddc668641d743158d7211e1422e0040)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:59.692937 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bdb8c2-9852-4054-a93c-34838321ce91 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:59.694478 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 594/1197] 10.222.0.72 () {56 vars in 1177 bytes} [Mon Sep 19 14:45:59 2022] GET /identity/v3/users/dddc668641d743158d7211e1422e0040 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:45:59.700316 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb99a74d-3279-4c20-8c5a-5dc8da6b8983 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:59.798457 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb99a74d-3279-4c20-8c5a-5dc8da6b8983 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:59.831118 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c6f661-cc8c-46d7-89a0-7afed48f4544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:59.831701 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c6f661-cc8c-46d7-89a0-7afed48f4544 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:59.831975 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c6f661-cc8c-46d7-89a0-7afed48f4544 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:59.832244 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c6f661-cc8c-46d7-89a0-7afed48f4544 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:59.868890 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:59.896764 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c6f661-cc8c-46d7-89a0-7afed48f4544 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:59.898189 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c6f661-cc8c-46d7-89a0-7afed48f4544 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:59.992449 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 604/1198] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Sep 19 14:45:59 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 14:45:59.998774 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bdb8c2-9852-4054-a93c-34838321ce91 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:46:00.097473 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bdb8c2-9852-4054-a93c-34838321ce91 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:46:00.129982 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c1ef21-cc3c-4ed7-b398-46e08d016f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:46:00.130597 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c1ef21-cc3c-4ed7-b398-46e08d016f23 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:46:00.130880 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c1ef21-cc3c-4ed7-b398-46e08d016f23 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:46:00.131157 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c1ef21-cc3c-4ed7-b398-46e08d016f23 None admin] PATH_INFO: `/v3/projects/f78120e3752e4e9cac415cf8f4eba790` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:46:00.132260 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c1ef21-cc3c-4ed7-b398-46e08d016f23 None admin] RBAC: Authorizing `identity:get_project(project_id=f78120e3752e4e9cac415cf8f4eba790)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:46:00.133719 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c1ef21-cc3c-4ed7-b398-46e08d016f23 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:46:00.135329 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 595/1199] 10.222.0.72 () {56 vars in 1186 bytes} [Mon Sep 19 14:45:59 2022] GET /identity/v3/projects/f78120e3752e4e9cac415cf8f4eba790 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:46:00.142123 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c6f661-cc8c-46d7-89a0-7afed48f4544 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:46:00.207842 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:46:00.237820 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c6f661-cc8c-46d7-89a0-7afed48f4544 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:46:00.270347 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a599b52-954d-4c55-bc9a-381f59eae76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:46:00.270932 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a599b52-954d-4c55-bc9a-381f59eae76b None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:46:00.271206 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a599b52-954d-4c55-bc9a-381f59eae76b None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:46:00.271471 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a599b52-954d-4c55-bc9a-381f59eae76b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:46:00.272175 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a599b52-954d-4c55-bc9a-381f59eae76b None admin] RBAC: Adding query filter params (role.id=ddb643577b2e4e478100ec370decfaeb, scope.project.id=f78120e3752e4e9cac415cf8f4eba790, user.id=dddc668641d743158d7211e1422e0040) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:46:00.272503 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a599b52-954d-4c55-bc9a-381f59eae76b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:46:00.273894 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a599b52-954d-4c55-bc9a-381f59eae76b None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:46:00.279502 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 605/1200] 10.222.0.72 () {56 vars in 1374 bytes} [Mon Sep 19 14:46:00 2022] GET /identity/v3/role_assignments?user.id=dddc668641d743158d7211e1422e0040&scope.project.id=f78120e3752e4e9cac415cf8f4eba790&role.id=ddb643577b2e4e478100ec370decfaeb => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:46:10.125900 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=81 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:46:10.276979 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=33 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:46:56.137593 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f34c7-88c1-4c17-a0f7-4d8192445ea2 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:46:56.138224 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f34c7-88c1-4c17-a0f7-4d8192445ea2 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:46:56.138224 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f34c7-88c1-4c17-a0f7-4d8192445ea2 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:46:56.139901 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 596/1201] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:46:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:46:56.146897 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1d62d7-5fca-46d9-b85a-0c0c19869628 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:46:56.147419 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1d62d7-5fca-46d9-b85a-0c0c19869628 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:46:56.147510 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1d62d7-5fca-46d9-b85a-0c0c19869628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:46:56.167302 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-4b1d62d7-5fca-46d9-b85a-0c0c19869628 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:46:56.168786 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-4b1d62d7-5fca-46d9-b85a-0c0c19869628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:46:56.249324 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 606/1202] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:46:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:46:56.540261 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71f34c7-88c1-4c17-a0f7-4d8192445ea2 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:46:56.675464 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71f34c7-88c1-4c17-a0f7-4d8192445ea2 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:46:56.714905 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e401c2-1efd-4e4b-8655-ee7ad131a89f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:46:56.715989 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e401c2-1efd-4e4b-8655-ee7ad131a89f None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:46:56.716578 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e401c2-1efd-4e4b-8655-ee7ad131a89f None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:46:56.717029 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e401c2-1efd-4e4b-8655-ee7ad131a89f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:46:56.731090 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e401c2-1efd-4e4b-8655-ee7ad131a89f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:46:56.732669 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e401c2-1efd-4e4b-8655-ee7ad131a89f None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:46:56.753513 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-c4e401c2-1efd-4e4b-8655-ee7ad131a89f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:46:56.753513 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:46:56.753513 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:46:56.753513 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:46:56.753513 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:46:56.753513 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:46:56.753513 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:46:56.753513 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:46:56.753513 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:46:56.753513 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:46:56.753513 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:46:56.753513 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:46:56.753513 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:46:56.753513 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:46:56.753513 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:46:56.753513 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:46:56.759828 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:46:56.759828 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:46:56.759828 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:46:56.759828 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:46:56.759828 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:46:56.759828 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:46:56.759828 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:46:56.759828 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:46:56.759828 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:46:56.759828 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:46:56.759828 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:46:56.759828 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:46:56.759828 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:46:56.759828 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:46:56.759828 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:46:56.759828 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:46:56.759828 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:46:56.761411 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:46:56.761411 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:46:56.761411 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:46:56.761411 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 597/1203] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:46:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:46:56.763822 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1d62d7-5fca-46d9-b85a-0c0c19869628 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:46:56.899526 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1d62d7-5fca-46d9-b85a-0c0c19869628 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:46:56.958055 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:46:56.966685 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fca04c9-60a9-437a-96ab-e20715cbe54e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:46:56.967307 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca04c9-60a9-437a-96ab-e20715cbe54e None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:46:56.967593 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca04c9-60a9-437a-96ab-e20715cbe54e None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:46:56.967863 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca04c9-60a9-437a-96ab-e20715cbe54e None admin] PATH_INFO: `/v3/domains` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:46:56.968536 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fca04c9-60a9-437a-96ab-e20715cbe54e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:46:56.968843 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fca04c9-60a9-437a-96ab-e20715cbe54e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:46:56.970232 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fca04c9-60a9-437a-96ab-e20715cbe54e None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:46:56.988713 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 607/1204] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Sep 19 14:46:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:46:56.990492 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e401c2-1efd-4e4b-8655-ee7ad131a89f None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:46:57.061494 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:46:57.133239 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e401c2-1efd-4e4b-8655-ee7ad131a89f None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:46:57.170037 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b183bc-5fcb-4155-bb7a-8567dd7c9855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:46:57.170874 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b183bc-5fcb-4155-bb7a-8567dd7c9855 None admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:46:57.170874 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b183bc-5fcb-4155-bb7a-8567dd7c9855 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:46:57.171097 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b183bc-5fcb-4155-bb7a-8567dd7c9855 None admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:46:57.171709 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b183bc-5fcb-4155-bb7a-8567dd7c9855 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:46:57.173165 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b183bc-5fcb-4155-bb7a-8567dd7c9855 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:46:57.204372 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 598/1205] 10.222.0.72 () {60 vars in 1132 bytes} [Mon Sep 19 14:46:56 2022] POST /identity/v3/users => generated 251 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:46:59.841269 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ca6c18-bf74-4608-9a33-632c11660f10 None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:46:59.841269 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ca6c18-bf74-4608-9a33-632c11660f10 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:46:59.841269 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ca6c18-bf74-4608-9a33-632c11660f10 None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:46:59.843708 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 608/1206] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:46:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:46:59.850063 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0bb588-22a7-4672-afd9-49ce94632c00 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:46:59.850466 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0bb588-22a7-4672-afd9-49ce94632c00 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:46:59.850628 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0bb588-22a7-4672-afd9-49ce94632c00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:46:59.873973 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-0b0bb588-22a7-4672-afd9-49ce94632c00 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:46:59.875630 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-0b0bb588-22a7-4672-afd9-49ce94632c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:46:59.969032 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 599/1207] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:46:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:47:00.269246 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ca6c18-bf74-4608-9a33-632c11660f10 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:47:00.392576 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ca6c18-bf74-4608-9a33-632c11660f10 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:47:00.441491 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c6aa19-e695-4e23-950b-84180ff1fe14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:47:00.442230 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c6aa19-e695-4e23-950b-84180ff1fe14 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:00.442517 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c6aa19-e695-4e23-950b-84180ff1fe14 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:00.442857 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c6aa19-e695-4e23-950b-84180ff1fe14 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:00.457279 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c6aa19-e695-4e23-950b-84180ff1fe14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:47:00.463602 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-f8c6aa19-e695-4e23-950b-84180ff1fe14 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:47:00.463602 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:47:00.463602 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:47:00.463602 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:47:00.463602 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:47:00.463602 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:47:00.463602 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:47:00.463602 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:47:00.463602 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:47:00.463602 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:47:00.463602 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:47:00.463602 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:47:00.463602 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:47:00.463602 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:47:00.463602 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:47:00.463602 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:47:00.465095 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:47:00.465095 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:47:00.465095 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:47:00.465095 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:47:00.465095 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:47:00.465095 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:47:00.465095 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:47:00.465095 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:47:00.465095 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:47:00.465095 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:47:00.465095 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:47:00.465095 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:47:00.465095 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:47:00.465095 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:47:00.465095 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:47:00.465095 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:47:00.466076 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:47:00.466076 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:47:00.466076 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:47:00.466076 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:47:00.466076 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:47:00.466076 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:47:00.466076 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:47:00.466076 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:47:00.466076 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:47:00.466076 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:47:00.466076 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:47:00.466076 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:47:00.466076 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 609/1208] 10.222.0.72 () {56 vars in 1102 bytes} [Mon Sep 19 14:47:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:47:00.471899 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0bb588-22a7-4672-afd9-49ce94632c00 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:47:00.522728 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:47:00.610971 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0bb588-22a7-4672-afd9-49ce94632c00 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:47:00.655075 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5729998-4716-4287-b646-09a445cf0b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:47:00.655694 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5729998-4716-4287-b646-09a445cf0b93 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:00.655990 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5729998-4716-4287-b646-09a445cf0b93 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:00.656312 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5729998-4716-4287-b646-09a445cf0b93 None admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:00.657162 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5729998-4716-4287-b646-09a445cf0b93 None admin] RBAC: Adding query filter params (name=service) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:47:00.657526 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5729998-4716-4287-b646-09a445cf0b93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:47:00.659422 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5729998-4716-4287-b646-09a445cf0b93 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:47:00.669307 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 600/1209] 10.222.0.72 () {56 vars in 1103 bytes} [Mon Sep 19 14:47:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:47:00.675824 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c6aa19-e695-4e23-950b-84180ff1fe14 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:47:00.738435 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:47:00.793370 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c6aa19-e695-4e23-950b-84180ff1fe14 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:47:00.835804 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8d06b7-15f5-4720-8383-5b12e48d34ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:47:00.837219 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8d06b7-15f5-4720-8383-5b12e48d34ee None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:00.838032 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8d06b7-15f5-4720-8383-5b12e48d34ee None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:00.839126 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8d06b7-15f5-4720-8383-5b12e48d34ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:00.852642 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8d06b7-15f5-4720-8383-5b12e48d34ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:47:00.855203 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8d06b7-15f5-4720-8383-5b12e48d34ee None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:47:00.871383 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-7f8d06b7-15f5-4720-8383-5b12e48d34ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:47:00.871383 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:47:00.871383 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:47:00.871383 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:47:00.871383 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:47:00.871383 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:47:00.871383 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:47:00.871383 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:47:00.871383 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:47:00.871383 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:47:00.871383 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:47:00.871383 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:47:00.871383 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:47:00.871383 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:47:00.871383 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:47:00.871383 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:47:00.872911 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:47:00.872911 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:47:00.872911 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:47:00.872911 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:47:00.872911 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:47:00.872911 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:47:00.872911 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:47:00.872911 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:47:00.872911 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:47:00.872911 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:47:00.872911 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:47:00.872911 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:47:00.872911 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:47:00.872911 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:47:00.872911 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:47:00.872911 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:47:00.872911 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:47:00.874105 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:47:00.874105 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:47:00.874105 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:47:00.875966 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 610/1210] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:47:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:47:00.881937 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5729998-4716-4287-b646-09a445cf0b93 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:47:01.008921 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:47:01.013407 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5729998-4716-4287-b646-09a445cf0b93 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:47:01.059864 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ce7a5c-9d30-4656-b59c-1a3eb25653f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:47:01.060423 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ce7a5c-9d30-4656-b59c-1a3eb25653f1 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:01.060710 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ce7a5c-9d30-4656-b59c-1a3eb25653f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:01.060983 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ce7a5c-9d30-4656-b59c-1a3eb25653f1 None admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:01.061623 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ce7a5c-9d30-4656-b59c-1a3eb25653f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:47:01.061930 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ce7a5c-9d30-4656-b59c-1a3eb25653f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:47:01.063853 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ce7a5c-9d30-4656-b59c-1a3eb25653f1 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:47:01.084361 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 601/1211] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Sep 19 14:47:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:47:01.088969 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8d06b7-15f5-4720-8383-5b12e48d34ee None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:47:01.202245 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8d06b7-15f5-4720-8383-5b12e48d34ee None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:47:01.204066 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:47:01.240255 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60758c9-d3a2-4dd9-beef-b20d0d88e863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:47:01.240970 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60758c9-d3a2-4dd9-beef-b20d0d88e863 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:01.241244 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60758c9-d3a2-4dd9-beef-b20d0d88e863 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:01.241561 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60758c9-d3a2-4dd9-beef-b20d0d88e863 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:01.249845 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60758c9-d3a2-4dd9-beef-b20d0d88e863 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:47:01.251310 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60758c9-d3a2-4dd9-beef-b20d0d88e863 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:47:01.263873 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-b60758c9-d3a2-4dd9-beef-b20d0d88e863 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 19 14:47:01.263873 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:47:01.263873 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:47:01.263873 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:47:01.263873 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:47:01.263873 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:47:01.263873 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:47:01.263873 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:47:01.263873 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:47:01.263873 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:47:01.263873 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:47:01.263873 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:47:01.263873 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 14:47:01.263873 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 14:47:01.263873 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 14:47:01.263873 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 14:47:01.265436 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:47:01.265436 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:47:01.265436 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:47:01.265436 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:47:01.265436 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:47:01.265436 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:47:01.265436 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:47:01.265436 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:47:01.265436 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:47:01.265436 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:47:01.265436 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:47:01.265436 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:47:01.265436 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:47:01.265436 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:47:01.265436 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:47:01.265436 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:47:01.265436 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:47:01.265436 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:47:01.266757 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:47:01.266757 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:47:01.266757 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 14:47:01.266757 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 14:47:01.266757 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 14:47:01.266757 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 14:47:01.266757 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 14:47:01.266757 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 14:47:01.266757 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 19 14:47:01.266757 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:47:01.266757 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 611/1212] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:47:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:47:01.271483 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ce7a5c-9d30-4656-b59c-1a3eb25653f1 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:47:01.387661 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ce7a5c-9d30-4656-b59c-1a3eb25653f1 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:47:01.427065 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1f0bcd-4bfd-47d7-a160-bf79b6b11d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:47:01.427672 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1f0bcd-4bfd-47d7-a160-bf79b6b11d77 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:01.427979 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1f0bcd-4bfd-47d7-a160-bf79b6b11d77 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:01.428254 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1f0bcd-4bfd-47d7-a160-bf79b6b11d77 None admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:01.429018 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1f0bcd-4bfd-47d7-a160-bf79b6b11d77 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:47:01.429321 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1f0bcd-4bfd-47d7-a160-bf79b6b11d77 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:47:01.430752 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1f0bcd-4bfd-47d7-a160-bf79b6b11d77 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:47:01.452009 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 602/1213] 10.222.0.72 () {56 vars in 1143 bytes} [Mon Sep 19 14:47:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:47:01.457763 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60758c9-d3a2-4dd9-beef-b20d0d88e863 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:47:01.598583 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60758c9-d3a2-4dd9-beef-b20d0d88e863 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:47:01.654193 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3749ca2-76fe-4e08-ab6b-133453d5c7de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:47:01.654193 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3749ca2-76fe-4e08-ab6b-133453d5c7de None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:01.654193 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3749ca2-76fe-4e08-ab6b-133453d5c7de None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:01.654193 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3749ca2-76fe-4e08-ab6b-133453d5c7de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:01.692821 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:47:01.732844 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3749ca2-76fe-4e08-ab6b-133453d5c7de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:47:01.734499 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3749ca2-76fe-4e08-ab6b-133453d5c7de None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:47:01.845690 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 612/1214] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Sep 19 14:47:01 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 14:47:01.852025 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1f0bcd-4bfd-47d7-a160-bf79b6b11d77 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:47:01.874138 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:47:01.968993 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1f0bcd-4bfd-47d7-a160-bf79b6b11d77 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:47:02.007929 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3d0af6-50d2-4ecc-b610-5f9e121a77f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:47:02.008692 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3d0af6-50d2-4ecc-b610-5f9e121a77f3 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:02.008973 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3d0af6-50d2-4ecc-b610-5f9e121a77f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:02.009331 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3d0af6-50d2-4ecc-b610-5f9e121a77f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:02.021297 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3d0af6-50d2-4ecc-b610-5f9e121a77f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:47:02.022932 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3d0af6-50d2-4ecc-b610-5f9e121a77f3 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:47:02.040654 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-4a3d0af6-50d2-4ecc-b610-5f9e121a77f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:47:02.040654 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:47:02.040654 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:47:02.040654 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:47:02.040654 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:47:02.040654 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:47:02.040654 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:47:02.040654 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:47:02.040654 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:47:02.040654 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:47:02.040654 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:47:02.040654 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:47:02.040654 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:47:02.040654 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:47:02.040654 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:47:02.040654 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:47:02.041729 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:47:02.041729 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:47:02.041729 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:47:02.041729 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:47:02.041729 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:47:02.041729 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:47:02.041729 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:47:02.041729 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:47:02.041729 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:47:02.041729 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:47:02.041729 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:47:02.041729 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:47:02.041729 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:47:02.041729 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:47:02.041729 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:47:02.041729 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:47:02.041729 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:47:02.042821 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:47:02.042821 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:47:02.042821 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:47:02.042821 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 603/1215] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:47:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:47:02.049433 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3749ca2-76fe-4e08-ab6b-133453d5c7de None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:47:02.115407 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:47:02.158061 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3749ca2-76fe-4e08-ab6b-133453d5c7de None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:47:02.197370 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9732906-3992-49d8-bdbb-b327f2f86da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:47:02.198089 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9732906-3992-49d8-bdbb-b327f2f86da4 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:02.198376 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9732906-3992-49d8-bdbb-b327f2f86da4 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:02.198650 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9732906-3992-49d8-bdbb-b327f2f86da4 None admin] PATH_INFO: `/v3/domains` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:02.199289 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9732906-3992-49d8-bdbb-b327f2f86da4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:47:02.199604 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9732906-3992-49d8-bdbb-b327f2f86da4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:47:02.200981 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9732906-3992-49d8-bdbb-b327f2f86da4 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:47:02.213787 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 613/1216] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Sep 19 14:47:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:47:02.220083 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3d0af6-50d2-4ecc-b610-5f9e121a77f3 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:47:02.300191 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:47:02.337257 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3d0af6-50d2-4ecc-b610-5f9e121a77f3 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:47:02.377169 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cc0b2c-9a5a-435f-aa5a-0f33d4e30c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:47:02.377796 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc0b2c-9a5a-435f-aa5a-0f33d4e30c6d None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:02.378068 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc0b2c-9a5a-435f-aa5a-0f33d4e30c6d None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:02.378333 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc0b2c-9a5a-435f-aa5a-0f33d4e30c6d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:02.386831 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cc0b2c-9a5a-435f-aa5a-0f33d4e30c6d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:47:02.388608 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cc0b2c-9a5a-435f-aa5a-0f33d4e30c6d None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:47:02.401051 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-78cc0b2c-9a5a-435f-aa5a-0f33d4e30c6d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:47:02.401051 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:47:02.401051 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:47:02.401051 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:47:02.401051 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:47:02.401051 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:47:02.401051 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:47:02.401051 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:47:02.401051 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:47:02.401051 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:47:02.401051 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:47:02.401051 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:47:02.401051 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 14:47:02.401051 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 14:47:02.401051 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 14:47:02.402014 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 14:47:02.402014 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:47:02.402014 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:47:02.402014 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:47:02.402014 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:47:02.402014 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:47:02.402014 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:47:02.402014 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:47:02.402014 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:47:02.402014 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:47:02.402014 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:47:02.402014 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:47:02.402014 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:47:02.402014 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:47:02.402014 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:47:02.402014 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:47:02.402014 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:47:02.402920 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 14:47:02.402920 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 14:47:02.402920 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:47:02.402920 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:47:02.402920 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:47:02.402920 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:47:02.402920 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:47:02.402920 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:47:02.402920 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 604/1217] 10.222.0.72 () {56 vars in 1111 bytes} [Mon Sep 19 14:47:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:47:02.408874 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9732906-3992-49d8-bdbb-b327f2f86da4 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:47:02.524081 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9732906-3992-49d8-bdbb-b327f2f86da4 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:47:02.554433 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:47:02.574502 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bea6668-57eb-4cf3-9bc6-535070088826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:47:02.575249 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea6668-57eb-4cf3-9bc6-535070088826 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:02.575594 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea6668-57eb-4cf3-9bc6-535070088826 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:02.575945 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea6668-57eb-4cf3-9bc6-535070088826 None admin] PATH_INFO: `/v3/projects` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:02.576773 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bea6668-57eb-4cf3-9bc6-535070088826 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:47:02.577157 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bea6668-57eb-4cf3-9bc6-535070088826 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:47:02.578908 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bea6668-57eb-4cf3-9bc6-535070088826 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:47:02.592665 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 614/1218] 10.222.0.72 () {56 vars in 1148 bytes} [Mon Sep 19 14:47:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:47:02.599114 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cc0b2c-9a5a-435f-aa5a-0f33d4e30c6d None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:47:02.709405 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cc0b2c-9a5a-435f-aa5a-0f33d4e30c6d None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:47:02.739993 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:47:02.746244 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3464d2bb-e5be-43c9-acd6-078289626b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:47:02.746848 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3464d2bb-e5be-43c9-acd6-078289626b51 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:02.747221 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3464d2bb-e5be-43c9-acd6-078289626b51 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:02.747499 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3464d2bb-e5be-43c9-acd6-078289626b51 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:02.748223 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3464d2bb-e5be-43c9-acd6-078289626b51 None admin] RBAC: Adding query filter params (role.id=537cde5f25284acca3c3ea9ff806d724, scope.project.id=51af3a14d665498c9b7a35b34dac0ef1, user.id=51e7a0148db8462b8ba24bac6dd15298) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:47:02.748568 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3464d2bb-e5be-43c9-acd6-078289626b51 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:47:02.750003 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3464d2bb-e5be-43c9-acd6-078289626b51 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:47:02.755744 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 605/1219] 10.222.0.72 () {56 vars in 1374 bytes} [Mon Sep 19 14:47:02 2022] GET /identity/v3/role_assignments?user.id=51e7a0148db8462b8ba24bac6dd15298&scope.project.id=51af3a14d665498c9b7a35b34dac0ef1&role.id=537cde5f25284acca3c3ea9ff806d724 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:47:05.024687 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fa55d2-42b8-42d1-a42f-f5895d269c22 None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:05.025230 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fa55d2-42b8-42d1-a42f-f5895d269c22 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:05.025230 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fa55d2-42b8-42d1-a42f-f5895d269c22 None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:05.026549 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 615/1220] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:47:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:47:05.032595 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7aa26b-b2ae-4818-bed3-ea6c1950eba4 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:05.033023 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7aa26b-b2ae-4818-bed3-ea6c1950eba4 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:05.033204 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7aa26b-b2ae-4818-bed3-ea6c1950eba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:05.053169 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-bf7aa26b-b2ae-4818-bed3-ea6c1950eba4 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:47:05.054351 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-bf7aa26b-b2ae-4818-bed3-ea6c1950eba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:47:05.130490 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 606/1221] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:47:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:47:05.437048 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fa55d2-42b8-42d1-a42f-f5895d269c22 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:47:05.545628 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fa55d2-42b8-42d1-a42f-f5895d269c22 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:47:05.588738 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096b3c59-ec52-48c5-ad73-6ad9ed0328fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:47:05.589481 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096b3c59-ec52-48c5-ad73-6ad9ed0328fe None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:05.589787 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096b3c59-ec52-48c5-ad73-6ad9ed0328fe None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:05.590058 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096b3c59-ec52-48c5-ad73-6ad9ed0328fe None admin] PATH_INFO: `/v3/roles/service` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:05.601238 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096b3c59-ec52-48c5-ad73-6ad9ed0328fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:47:05.607266 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-096b3c59-ec52-48c5-ad73-6ad9ed0328fe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:47:05.607266 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:47:05.607266 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:47:05.607266 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:47:05.607266 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:47:05.607266 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:47:05.607266 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:47:05.607266 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:47:05.607266 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:47:05.607266 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:47:05.607266 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:47:05.607266 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:47:05.607266 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:47:05.607266 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:47:05.607266 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:47:05.607266 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:47:05.608566 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:47:05.608566 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:47:05.608566 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:47:05.608566 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:47:05.608566 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:47:05.608566 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:47:05.608566 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:47:05.608566 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:47:05.608566 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:47:05.608566 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:47:05.608566 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:47:05.608566 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:47:05.608566 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:47:05.608566 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:47:05.608566 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:47:05.608566 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:47:05.609453 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:47:05.609453 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:47:05.609453 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:47:05.609453 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:47:05.609453 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:47:05.609453 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:47:05.609453 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:47:05.609453 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:47:05.609453 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:47:05.609453 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:47:05.609453 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:47:05.609453 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:47:05.609453 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 616/1222] 10.222.0.72 () {56 vars in 1102 bytes} [Mon Sep 19 14:47:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:47:05.614763 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7aa26b-b2ae-4818-bed3-ea6c1950eba4 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:47:05.721716 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7aa26b-b2ae-4818-bed3-ea6c1950eba4 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:47:05.747586 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:47:05.760024 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edcf44f-2ec8-4211-8207-de3706239b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:47:05.760792 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edcf44f-2ec8-4211-8207-de3706239b7f None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:05.761201 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edcf44f-2ec8-4211-8207-de3706239b7f None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:05.761391 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edcf44f-2ec8-4211-8207-de3706239b7f None admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:05.762101 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edcf44f-2ec8-4211-8207-de3706239b7f None admin] RBAC: Adding query filter params (name=service) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:47:05.762429 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edcf44f-2ec8-4211-8207-de3706239b7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:47:05.763976 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edcf44f-2ec8-4211-8207-de3706239b7f None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:47:05.772996 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 607/1223] 10.222.0.72 () {56 vars in 1103 bytes} [Mon Sep 19 14:47:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:47:05.779426 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096b3c59-ec52-48c5-ad73-6ad9ed0328fe None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:47:05.830442 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:47:05.894935 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096b3c59-ec52-48c5-ad73-6ad9ed0328fe None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:47:05.935864 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec1b47e-3a70-4592-8561-f0534a1b82ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:47:05.936527 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec1b47e-3a70-4592-8561-f0534a1b82ae None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:05.936811 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec1b47e-3a70-4592-8561-f0534a1b82ae None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:05.937088 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec1b47e-3a70-4592-8561-f0534a1b82ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:05.949886 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec1b47e-3a70-4592-8561-f0534a1b82ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:47:05.951724 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec1b47e-3a70-4592-8561-f0534a1b82ae None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:47:05.976265 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-eec1b47e-3a70-4592-8561-f0534a1b82ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:47:05.976265 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:47:05.976265 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:47:05.976265 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:47:05.976265 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:47:05.976265 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:47:05.976265 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:47:05.976265 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:47:05.976265 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:47:05.976265 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:47:05.976265 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:47:05.976265 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:47:05.976265 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:47:05.976265 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:47:05.976265 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:47:05.976265 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:47:05.977476 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:47:05.977476 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:47:05.977476 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:47:05.977476 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:47:05.977476 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:47:05.977476 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:47:05.977476 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:47:05.977476 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:47:05.977476 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:47:05.977476 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:47:05.977476 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:47:05.977476 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:47:05.977476 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:47:05.977476 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:47:05.977476 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:47:05.977476 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:47:05.977476 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:47:05.978498 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:47:05.978498 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:47:05.978498 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:47:05.978498 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 617/1224] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:47:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:47:05.983533 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edcf44f-2ec8-4211-8207-de3706239b7f None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:47:06.099113 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edcf44f-2ec8-4211-8207-de3706239b7f None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:47:06.139753 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a417a9d-8022-4b61-a91e-c05b77dfe911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:47:06.140385 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a417a9d-8022-4b61-a91e-c05b77dfe911 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:06.140665 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a417a9d-8022-4b61-a91e-c05b77dfe911 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:06.140931 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a417a9d-8022-4b61-a91e-c05b77dfe911 None admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:06.141563 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a417a9d-8022-4b61-a91e-c05b77dfe911 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:47:06.141860 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a417a9d-8022-4b61-a91e-c05b77dfe911 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:47:06.143225 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a417a9d-8022-4b61-a91e-c05b77dfe911 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:47:06.156464 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 608/1225] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Sep 19 14:47:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:47:06.162263 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec1b47e-3a70-4592-8561-f0534a1b82ae None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:47:06.262943 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:47:06.270633 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec1b47e-3a70-4592-8561-f0534a1b82ae None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:47:06.310575 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39208c7d-68fd-4b64-8ea9-c079a95f68c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:47:06.311252 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39208c7d-68fd-4b64-8ea9-c079a95f68c2 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:06.311840 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39208c7d-68fd-4b64-8ea9-c079a95f68c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:06.312147 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39208c7d-68fd-4b64-8ea9-c079a95f68c2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:06.321208 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39208c7d-68fd-4b64-8ea9-c079a95f68c2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:47:06.323264 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39208c7d-68fd-4b64-8ea9-c079a95f68c2 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:47:06.335608 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-39208c7d-68fd-4b64-8ea9-c079a95f68c2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 19 14:47:06.335608 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:47:06.335608 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:47:06.335608 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:47:06.335608 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:47:06.335608 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:47:06.335608 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:47:06.335608 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:47:06.335608 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:47:06.335608 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:47:06.335608 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:47:06.335608 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:47:06.335608 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 14:47:06.335608 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 14:47:06.335608 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 14:47:06.335608 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 14:47:06.336806 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:47:06.336806 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:47:06.336806 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:47:06.336806 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:47:06.336806 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:47:06.336806 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:47:06.336806 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:47:06.336806 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:47:06.336806 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:47:06.336806 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:47:06.336806 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:47:06.336806 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:47:06.336806 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:47:06.336806 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:47:06.336806 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:47:06.336806 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:47:06.336806 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:47:06.336806 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:47:06.337944 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:47:06.337944 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:47:06.337944 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 14:47:06.337944 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 14:47:06.337944 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 14:47:06.337944 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 14:47:06.337944 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 14:47:06.337944 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 14:47:06.337944 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 19 14:47:06.337944 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:47:06.337944 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 618/1226] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:47:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:47:06.342749 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a417a9d-8022-4b61-a91e-c05b77dfe911 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:47:06.395876 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:47:06.458099 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a417a9d-8022-4b61-a91e-c05b77dfe911 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:47:06.496678 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b897be4a-1a27-4ad6-95c9-016370285a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:47:06.497420 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b897be4a-1a27-4ad6-95c9-016370285a22 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:06.497732 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b897be4a-1a27-4ad6-95c9-016370285a22 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:06.498062 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b897be4a-1a27-4ad6-95c9-016370285a22 None admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:06.498842 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b897be4a-1a27-4ad6-95c9-016370285a22 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:47:06.499209 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b897be4a-1a27-4ad6-95c9-016370285a22 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:47:06.500717 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b897be4a-1a27-4ad6-95c9-016370285a22 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:47:06.520262 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 609/1227] 10.222.0.72 () {56 vars in 1143 bytes} [Mon Sep 19 14:47:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:47:06.526344 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39208c7d-68fd-4b64-8ea9-c079a95f68c2 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:47:06.638646 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39208c7d-68fd-4b64-8ea9-c079a95f68c2 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:47:06.678226 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1216ce-b132-433e-9a5d-9c86eaab52ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:47:06.678953 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1216ce-b132-433e-9a5d-9c86eaab52ec None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:06.679235 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1216ce-b132-433e-9a5d-9c86eaab52ec None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:06.679505 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1216ce-b132-433e-9a5d-9c86eaab52ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:06.691364 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1216ce-b132-433e-9a5d-9c86eaab52ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:47:06.692841 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1216ce-b132-433e-9a5d-9c86eaab52ec None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:47:06.708254 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-fe1216ce-b132-433e-9a5d-9c86eaab52ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:47:06.708254 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:47:06.708254 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:47:06.708254 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:47:06.708254 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:47:06.708254 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:47:06.708254 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:47:06.708254 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:47:06.708254 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:47:06.708254 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:47:06.708254 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:47:06.708254 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:47:06.708254 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:47:06.708254 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:47:06.708254 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:47:06.708254 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:47:06.709445 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:47:06.709445 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:47:06.709445 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:47:06.709445 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:47:06.709445 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:47:06.709445 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:47:06.709445 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:47:06.709445 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:47:06.709445 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:47:06.709445 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:47:06.709445 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:47:06.709445 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:47:06.709445 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:47:06.709445 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:47:06.709445 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:47:06.709445 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:47:06.709445 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:47:06.710512 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:47:06.710512 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:47:06.710512 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:47:06.710512 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 619/1228] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:47:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:47:06.715559 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b897be4a-1a27-4ad6-95c9-016370285a22 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:47:06.824680 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b897be4a-1a27-4ad6-95c9-016370285a22 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:47:06.827031 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:47:06.861399 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e8f577-fd0f-4a13-ac36-6fe65c288a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:47:06.862028 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e8f577-fd0f-4a13-ac36-6fe65c288a20 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:06.862321 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e8f577-fd0f-4a13-ac36-6fe65c288a20 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:06.862596 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e8f577-fd0f-4a13-ac36-6fe65c288a20 None admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:06.863337 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e8f577-fd0f-4a13-ac36-6fe65c288a20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:47:06.863633 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e8f577-fd0f-4a13-ac36-6fe65c288a20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:47:06.865117 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e8f577-fd0f-4a13-ac36-6fe65c288a20 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:47:06.877185 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 610/1229] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Sep 19 14:47:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:47:06.883275 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1216ce-b132-433e-9a5d-9c86eaab52ec None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:47:06.893410 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:47:06.996775 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1216ce-b132-433e-9a5d-9c86eaab52ec None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:47:07.034326 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be187c26-7fd4-4d53-9cdd-57eebd196dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:47:07.034977 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be187c26-7fd4-4d53-9cdd-57eebd196dc6 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:07.035261 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be187c26-7fd4-4d53-9cdd-57eebd196dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:07.035540 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be187c26-7fd4-4d53-9cdd-57eebd196dc6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:07.044209 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be187c26-7fd4-4d53-9cdd-57eebd196dc6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:47:07.045703 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be187c26-7fd4-4d53-9cdd-57eebd196dc6 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:47:07.057550 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-be187c26-7fd4-4d53-9cdd-57eebd196dc6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:47:07.057550 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:47:07.057550 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:47:07.057550 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:47:07.057550 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:47:07.057550 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:47:07.057550 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:47:07.057550 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:47:07.057550 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:47:07.057550 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:47:07.057550 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:47:07.057550 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:47:07.057550 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 14:47:07.057550 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 14:47:07.057550 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 14:47:07.058881 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 14:47:07.058881 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:47:07.058881 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:47:07.058881 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:47:07.058881 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:47:07.058881 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:47:07.058881 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:47:07.058881 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:47:07.058881 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:47:07.058881 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:47:07.058881 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:47:07.058881 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:47:07.058881 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:47:07.058881 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:47:07.058881 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:47:07.058881 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:47:07.058881 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:47:07.059953 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 14:47:07.059953 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 14:47:07.059953 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:47:07.059953 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:47:07.059953 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:47:07.059953 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:47:07.059953 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:47:07.059953 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:47:07.059953 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 620/1230] 10.222.0.72 () {56 vars in 1111 bytes} [Mon Sep 19 14:47:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:47:07.066021 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e8f577-fd0f-4a13-ac36-6fe65c288a20 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:47:07.174229 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e8f577-fd0f-4a13-ac36-6fe65c288a20 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:47:07.211967 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cb8d09-1c58-48ee-947d-c15041a919c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:47:07.212600 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cb8d09-1c58-48ee-947d-c15041a919c1 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:07.212888 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cb8d09-1c58-48ee-947d-c15041a919c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:07.213150 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cb8d09-1c58-48ee-947d-c15041a919c1 None admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:07.213827 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cb8d09-1c58-48ee-947d-c15041a919c1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:47:07.214129 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cb8d09-1c58-48ee-947d-c15041a919c1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:47:07.215548 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cb8d09-1c58-48ee-947d-c15041a919c1 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:47:07.227402 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 611/1231] 10.222.0.72 () {56 vars in 1148 bytes} [Mon Sep 19 14:47:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:47:07.234522 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be187c26-7fd4-4d53-9cdd-57eebd196dc6 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:47:07.305857 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:47:07.349689 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be187c26-7fd4-4d53-9cdd-57eebd196dc6 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:47:07.389309 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d92253-da1e-4763-92d6-c6cf354a2de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:47:07.390077 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d92253-da1e-4763-92d6-c6cf354a2de0 None admin] REQUEST_METHOD: `PUT` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:07.390412 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d92253-da1e-4763-92d6-c6cf354a2de0 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:07.390716 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d92253-da1e-4763-92d6-c6cf354a2de0 None admin] PATH_INFO: `/v3/projects/51af3a14d665498c9b7a35b34dac0ef1/users/51e7a0148db8462b8ba24bac6dd15298/roles/537cde5f25284acca3c3ea9ff806d724` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:07.406381 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d92253-da1e-4763-92d6-c6cf354a2de0 None admin] RBAC: Authorizing `identity:create_grant(project_id=51af3a14d665498c9b7a35b34dac0ef1, user_id=51e7a0148db8462b8ba24bac6dd15298, role_id=537cde5f25284acca3c3ea9ff806d724)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:47:07.407978 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d92253-da1e-4763-92d6-c6cf354a2de0 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:47:07.422061 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 621/1232] 10.222.0.72 () {58 vars in 1439 bytes} [Mon Sep 19 14:47:07 2022] PUT /identity/v3/projects/51af3a14d665498c9b7a35b34dac0ef1/users/51e7a0148db8462b8ba24bac6dd15298/roles/537cde5f25284acca3c3ea9ff806d724 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:47:09.721794 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af08f6-a729-4b2c-a9d2-ef85059f28b6 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:09.722410 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af08f6-a729-4b2c-a9d2-ef85059f28b6 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:09.722503 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af08f6-a729-4b2c-a9d2-ef85059f28b6 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:09.724139 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 612/1233] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:47:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:47:09.729817 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e399ecd-ea10-4730-8af0-fa3fe42e03aa None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:09.730273 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e399ecd-ea10-4730-8af0-fa3fe42e03aa None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:09.730372 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e399ecd-ea10-4730-8af0-fa3fe42e03aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:09.751306 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-7e399ecd-ea10-4730-8af0-fa3fe42e03aa None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:47:09.752675 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-7e399ecd-ea10-4730-8af0-fa3fe42e03aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:47:09.827389 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 622/1234] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:47:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:47:10.130714 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80af08f6-a729-4b2c-a9d2-ef85059f28b6 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:47:10.159348 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:47:10.243180 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80af08f6-a729-4b2c-a9d2-ef85059f28b6 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:47:10.282331 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32a0c6f-85d1-407e-a4c6-4b60b51d6273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:47:10.282957 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32a0c6f-85d1-407e-a4c6-4b60b51d6273 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:10.283234 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32a0c6f-85d1-407e-a4c6-4b60b51d6273 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:10.283499 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32a0c6f-85d1-407e-a4c6-4b60b51d6273 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:10.293721 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32a0c6f-85d1-407e-a4c6-4b60b51d6273 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:47:10.298521 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-a32a0c6f-85d1-407e-a4c6-4b60b51d6273 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:47:10.298521 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:47:10.298521 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:47:10.298521 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:47:10.298521 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:47:10.298521 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:47:10.298521 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:47:10.298521 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:47:10.298521 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:47:10.298521 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:47:10.298521 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:47:10.298521 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:47:10.298521 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:47:10.298521 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:47:10.298521 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:47:10.298521 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:47:10.300036 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:47:10.300036 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:47:10.300036 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:47:10.300036 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:47:10.300036 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:47:10.300036 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:47:10.300036 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:47:10.300036 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:47:10.300036 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:47:10.300036 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:47:10.300036 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:47:10.300036 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:47:10.300036 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:47:10.300036 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:47:10.300036 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:47:10.300036 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:47:10.301308 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:47:10.301308 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:47:10.301308 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:47:10.301308 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:47:10.301308 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:47:10.301308 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:47:10.301308 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:47:10.301308 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:47:10.301308 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:47:10.301308 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:47:10.301308 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:47:10.301308 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:47:10.301308 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 613/1235] 10.222.0.72 () {56 vars in 1102 bytes} [Mon Sep 19 14:47:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:47:10.306044 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e399ecd-ea10-4730-8af0-fa3fe42e03aa None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:47:10.358498 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:47:10.423475 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e399ecd-ea10-4730-8af0-fa3fe42e03aa None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:47:10.461616 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb07fe1-bfd8-44e6-9349-317909705c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:47:10.462363 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb07fe1-bfd8-44e6-9349-317909705c05 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:10.462659 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb07fe1-bfd8-44e6-9349-317909705c05 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:10.463574 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb07fe1-bfd8-44e6-9349-317909705c05 None admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:10.464342 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb07fe1-bfd8-44e6-9349-317909705c05 None admin] RBAC: Adding query filter params (name=service) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:47:10.464663 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb07fe1-bfd8-44e6-9349-317909705c05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:47:10.466263 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb07fe1-bfd8-44e6-9349-317909705c05 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:47:10.475292 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 623/1236] 10.222.0.72 () {56 vars in 1103 bytes} [Mon Sep 19 14:47:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:47:10.482012 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32a0c6f-85d1-407e-a4c6-4b60b51d6273 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:47:10.579252 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:47:10.599880 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32a0c6f-85d1-407e-a4c6-4b60b51d6273 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:47:10.638798 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29e2ff9-75a5-42c3-910f-7be214996535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:47:10.639430 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e2ff9-75a5-42c3-910f-7be214996535 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:10.639714 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e2ff9-75a5-42c3-910f-7be214996535 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:10.639991 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e2ff9-75a5-42c3-910f-7be214996535 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:10.650769 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29e2ff9-75a5-42c3-910f-7be214996535 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:47:10.652265 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29e2ff9-75a5-42c3-910f-7be214996535 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:47:10.668504 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-e29e2ff9-75a5-42c3-910f-7be214996535 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:47:10.668504 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:47:10.668504 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:47:10.668504 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:47:10.668504 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:47:10.668504 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:47:10.668504 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:47:10.668504 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:47:10.668504 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:47:10.668504 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:47:10.668504 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:47:10.668504 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:47:10.668504 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:47:10.668504 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:47:10.668504 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:47:10.668504 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:47:10.670698 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:47:10.670698 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:47:10.670698 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:47:10.670698 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:47:10.670698 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:47:10.670698 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:47:10.670698 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:47:10.670698 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:47:10.670698 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:47:10.670698 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:47:10.670698 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:47:10.670698 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:47:10.670698 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:47:10.670698 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:47:10.670698 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:47:10.670698 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:47:10.670698 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:47:10.671610 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:47:10.671610 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:47:10.671610 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:47:10.671610 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 614/1237] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:47:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:47:10.675761 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb07fe1-bfd8-44e6-9349-317909705c05 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:47:10.789095 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb07fe1-bfd8-44e6-9349-317909705c05 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:47:10.798558 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:47:10.827384 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef25361-b19f-4ef8-84ce-4663d5f34715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:47:10.827989 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef25361-b19f-4ef8-84ce-4663d5f34715 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:10.828270 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef25361-b19f-4ef8-84ce-4663d5f34715 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:10.828573 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef25361-b19f-4ef8-84ce-4663d5f34715 None admin] PATH_INFO: `/v3/domains` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:10.829208 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef25361-b19f-4ef8-84ce-4663d5f34715 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:47:10.829510 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef25361-b19f-4ef8-84ce-4663d5f34715 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:47:10.830858 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef25361-b19f-4ef8-84ce-4663d5f34715 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:47:10.843225 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 624/1238] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Sep 19 14:47:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:47:10.848978 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29e2ff9-75a5-42c3-910f-7be214996535 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:47:10.962082 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29e2ff9-75a5-42c3-910f-7be214996535 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:47:10.999939 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb99b4f-64a7-4b8e-bb47-098412005651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:47:11.000588 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb99b4f-64a7-4b8e-bb47-098412005651 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:11.000876 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb99b4f-64a7-4b8e-bb47-098412005651 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:11.001134 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb99b4f-64a7-4b8e-bb47-098412005651 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:11.003782 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:47:11.010038 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb99b4f-64a7-4b8e-bb47-098412005651 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:47:11.011959 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb99b4f-64a7-4b8e-bb47-098412005651 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:47:11.025096 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-6fb99b4f-64a7-4b8e-bb47-098412005651 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 19 14:47:11.025096 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:47:11.025096 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:47:11.025096 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:47:11.025096 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:47:11.025096 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:47:11.025096 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:47:11.025096 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:47:11.025096 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:47:11.025096 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:47:11.025096 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:47:11.025096 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:47:11.025096 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 14:47:11.025096 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 14:47:11.025096 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 14:47:11.025096 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 14:47:11.026311 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:47:11.026311 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:47:11.026311 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:47:11.026311 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:47:11.026311 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:47:11.026311 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:47:11.026311 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:47:11.026311 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:47:11.026311 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:47:11.026311 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:47:11.026311 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:47:11.026311 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:47:11.026311 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:47:11.026311 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:47:11.026311 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:47:11.026311 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:47:11.026311 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:47:11.026311 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:47:11.027317 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:47:11.027317 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:47:11.027317 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 14:47:11.027317 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 14:47:11.027317 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 14:47:11.027317 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 14:47:11.027317 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 14:47:11.027317 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 14:47:11.027317 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 19 14:47:11.027317 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:47:11.027317 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 615/1239] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:47:10 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:47:11.033073 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef25361-b19f-4ef8-84ce-4663d5f34715 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:47:11.139452 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef25361-b19f-4ef8-84ce-4663d5f34715 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:47:11.176444 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad636d6d-237b-4def-98ac-0f63c2b775df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:47:11.177082 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad636d6d-237b-4def-98ac-0f63c2b775df None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:11.177325 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad636d6d-237b-4def-98ac-0f63c2b775df None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:11.177590 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad636d6d-237b-4def-98ac-0f63c2b775df None admin] PATH_INFO: `/v3/users` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:11.178346 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad636d6d-237b-4def-98ac-0f63c2b775df None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:47:11.178648 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad636d6d-237b-4def-98ac-0f63c2b775df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:47:11.180059 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad636d6d-237b-4def-98ac-0f63c2b775df None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:47:11.199657 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 625/1240] 10.222.0.72 () {56 vars in 1143 bytes} [Mon Sep 19 14:47:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:47:11.205867 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb99b4f-64a7-4b8e-bb47-098412005651 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:47:11.317190 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb99b4f-64a7-4b8e-bb47-098412005651 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:47:11.359553 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d7f6b7-2775-4980-b3f8-9b69abc720e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:47:11.360436 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d7f6b7-2775-4980-b3f8-9b69abc720e4 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:11.360825 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d7f6b7-2775-4980-b3f8-9b69abc720e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:11.361244 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d7f6b7-2775-4980-b3f8-9b69abc720e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:11.442784 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:47:11.450276 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d7f6b7-2775-4980-b3f8-9b69abc720e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:47:11.451892 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d7f6b7-2775-4980-b3f8-9b69abc720e4 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:47:11.560394 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 616/1241] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Sep 19 14:47:11 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 14:47:11.567120 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad636d6d-237b-4def-98ac-0f63c2b775df None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:47:11.598511 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:47:11.681142 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad636d6d-237b-4def-98ac-0f63c2b775df None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:47:11.719410 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd2da8c-5aa2-4738-9c93-5410cbc76fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:47:11.720419 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd2da8c-5aa2-4738-9c93-5410cbc76fc8 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:11.720734 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd2da8c-5aa2-4738-9c93-5410cbc76fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:11.721042 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd2da8c-5aa2-4738-9c93-5410cbc76fc8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:11.732670 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd2da8c-5aa2-4738-9c93-5410cbc76fc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:47:11.734129 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd2da8c-5aa2-4738-9c93-5410cbc76fc8 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:47:11.751578 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-0bd2da8c-5aa2-4738-9c93-5410cbc76fc8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:47:11.751578 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:47:11.751578 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:47:11.751578 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:47:11.751578 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:47:11.751578 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:47:11.751578 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:47:11.751578 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:47:11.751578 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:47:11.751578 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:47:11.751578 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:47:11.751578 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:47:11.751578 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:47:11.751578 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:47:11.751578 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:47:11.751578 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:47:11.752823 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:47:11.752823 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:47:11.752823 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:47:11.752823 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:47:11.752823 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:47:11.752823 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:47:11.752823 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:47:11.752823 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:47:11.752823 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:47:11.752823 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:47:11.752823 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:47:11.752823 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:47:11.752823 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:47:11.752823 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:47:11.752823 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:47:11.752823 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:47:11.752823 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:47:11.753814 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:47:11.753814 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:47:11.753814 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:47:11.753814 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 626/1242] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:47:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:47:11.759540 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d7f6b7-2775-4980-b3f8-9b69abc720e4 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:47:11.869802 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:47:11.877439 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d7f6b7-2775-4980-b3f8-9b69abc720e4 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:47:11.924307 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cce117-a605-4ced-a7c5-3660edd36d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:47:11.925239 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cce117-a605-4ced-a7c5-3660edd36d36 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:11.925739 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cce117-a605-4ced-a7c5-3660edd36d36 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:11.926326 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cce117-a605-4ced-a7c5-3660edd36d36 None admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:11.927677 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cce117-a605-4ced-a7c5-3660edd36d36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:47:11.928070 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cce117-a605-4ced-a7c5-3660edd36d36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:47:11.930119 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cce117-a605-4ced-a7c5-3660edd36d36 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:47:11.944497 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 617/1243] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Sep 19 14:47:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:47:11.950675 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd2da8c-5aa2-4738-9c93-5410cbc76fc8 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:47:12.042906 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:47:12.069169 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd2da8c-5aa2-4738-9c93-5410cbc76fc8 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:47:12.108221 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f5f630-a462-4c1d-859d-c9734316a6fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:47:12.108941 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f5f630-a462-4c1d-859d-c9734316a6fc None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:12.110167 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f5f630-a462-4c1d-859d-c9734316a6fc None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:12.110167 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f5f630-a462-4c1d-859d-c9734316a6fc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:12.116444 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f5f630-a462-4c1d-859d-c9734316a6fc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:47:12.117862 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f5f630-a462-4c1d-859d-c9734316a6fc None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:47:12.129991 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-01f5f630-a462-4c1d-859d-c9734316a6fc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:47:12.129991 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:47:12.129991 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:47:12.129991 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:47:12.129991 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:47:12.129991 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:47:12.129991 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:47:12.129991 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:47:12.129991 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:47:12.129991 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:47:12.129991 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:47:12.129991 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:47:12.129991 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 14:47:12.129991 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 14:47:12.129991 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 14:47:12.130972 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 14:47:12.130972 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:47:12.130972 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:47:12.130972 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:47:12.130972 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:47:12.130972 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:47:12.130972 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:47:12.130972 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:47:12.130972 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:47:12.130972 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:47:12.130972 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:47:12.130972 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:47:12.130972 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:47:12.130972 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:47:12.130972 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:47:12.130972 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:47:12.130972 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:47:12.131869 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 14:47:12.131869 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 14:47:12.131869 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:47:12.131869 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:47:12.131869 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:47:12.131869 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:47:12.131869 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:47:12.131869 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:47:12.131869 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 627/1244] 10.222.0.72 () {56 vars in 1111 bytes} [Mon Sep 19 14:47:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:47:12.137663 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cce117-a605-4ced-a7c5-3660edd36d36 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:47:12.252181 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cce117-a605-4ced-a7c5-3660edd36d36 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:47:12.289499 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da69e02e-ff71-49fb-a42e-6d38b72303b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:47:12.290182 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da69e02e-ff71-49fb-a42e-6d38b72303b2 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:12.290576 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da69e02e-ff71-49fb-a42e-6d38b72303b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:12.291054 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da69e02e-ff71-49fb-a42e-6d38b72303b2 None admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:12.292510 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da69e02e-ff71-49fb-a42e-6d38b72303b2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:47:12.292849 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da69e02e-ff71-49fb-a42e-6d38b72303b2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:47:12.294542 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da69e02e-ff71-49fb-a42e-6d38b72303b2 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:47:12.309555 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 618/1245] 10.222.0.72 () {56 vars in 1148 bytes} [Mon Sep 19 14:47:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:47:12.316470 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f5f630-a462-4c1d-859d-c9734316a6fc None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:47:12.434861 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f5f630-a462-4c1d-859d-c9734316a6fc None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:47:12.474120 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eff6ea1-7210-45e1-8692-9fb77d0075aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:47:12.474725 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eff6ea1-7210-45e1-8692-9fb77d0075aa None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:12.475004 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eff6ea1-7210-45e1-8692-9fb77d0075aa None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:12.475278 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eff6ea1-7210-45e1-8692-9fb77d0075aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:12.476130 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eff6ea1-7210-45e1-8692-9fb77d0075aa None admin] RBAC: Adding query filter params (role.id=537cde5f25284acca3c3ea9ff806d724, scope.project.id=51af3a14d665498c9b7a35b34dac0ef1, user.id=51e7a0148db8462b8ba24bac6dd15298) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:47:12.476551 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eff6ea1-7210-45e1-8692-9fb77d0075aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:47:12.478394 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eff6ea1-7210-45e1-8692-9fb77d0075aa None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:47:12.487943 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 628/1246] 10.222.0.72 () {56 vars in 1374 bytes} [Mon Sep 19 14:47:12 2022] GET /identity/v3/role_assignments?user.id=51e7a0148db8462b8ba24bac6dd15298&scope.project.id=51af3a14d665498c9b7a35b34dac0ef1&role.id=537cde5f25284acca3c3ea9ff806d724 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:47:14.811376 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19995921-4c7d-4c5e-aca4-02d4a50125bb None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:14.811950 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19995921-4c7d-4c5e-aca4-02d4a50125bb None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:14.811950 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19995921-4c7d-4c5e-aca4-02d4a50125bb None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:14.813771 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 619/1247] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:47:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 14:47:14.819268 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4be079-bb99-4997-b8ac-de8db468c752 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:14.819769 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4be079-bb99-4997-b8ac-de8db468c752 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:14.819905 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4be079-bb99-4997-b8ac-de8db468c752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:14.828067 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:47:14.839757 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-6d4be079-bb99-4997-b8ac-de8db468c752 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:47:14.840989 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-6d4be079-bb99-4997-b8ac-de8db468c752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:47:14.915048 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 629/1248] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:47:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:47:15.199306 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19995921-4c7d-4c5e-aca4-02d4a50125bb None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:47:15.219824 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:47:15.316349 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19995921-4c7d-4c5e-aca4-02d4a50125bb None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:47:15.355520 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a04e00-9a1c-48dc-a9a7-f6125131babb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:47:15.356845 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a04e00-9a1c-48dc-a9a7-f6125131babb None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:15.356845 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a04e00-9a1c-48dc-a9a7-f6125131babb None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:15.357056 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a04e00-9a1c-48dc-a9a7-f6125131babb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:15.367717 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a04e00-9a1c-48dc-a9a7-f6125131babb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:47:15.373194 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-69a04e00-9a1c-48dc-a9a7-f6125131babb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:47:15.373194 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:47:15.373194 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:47:15.373194 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:47:15.373194 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:47:15.373194 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:47:15.373194 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:47:15.373194 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:47:15.373194 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:47:15.373194 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:47:15.373194 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:47:15.373194 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:47:15.373194 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:47:15.373194 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:47:15.373194 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:47:15.373194 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:47:15.374154 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:47:15.374154 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:47:15.374154 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:47:15.374154 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:47:15.374154 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:47:15.374154 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:47:15.374154 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:47:15.374154 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:47:15.374154 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:47:15.374154 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:47:15.374154 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:47:15.374154 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:47:15.374154 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:47:15.374154 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:47:15.374154 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:47:15.374154 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:47:15.375085 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:47:15.375085 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:47:15.375085 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:47:15.375085 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:47:15.375085 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:47:15.375085 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:47:15.375085 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:47:15.375085 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:47:15.375085 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:47:15.375085 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:47:15.375085 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:47:15.375085 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:47:15.375085 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 620/1249] 10.222.0.72 () {56 vars in 1096 bytes} [Mon Sep 19 14:47:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:47:15.380944 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4be079-bb99-4997-b8ac-de8db468c752 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:47:15.492999 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4be079-bb99-4997-b8ac-de8db468c752 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:47:15.530370 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:47:15.537144 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6722f2a2-649d-4d34-986b-4c8964683a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:47:15.537781 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722f2a2-649d-4d34-986b-4c8964683a8e None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:15.538065 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722f2a2-649d-4d34-986b-4c8964683a8e None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:15.538338 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722f2a2-649d-4d34-986b-4c8964683a8e None admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:15.539022 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6722f2a2-649d-4d34-986b-4c8964683a8e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:47:15.539327 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6722f2a2-649d-4d34-986b-4c8964683a8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:47:15.540824 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6722f2a2-649d-4d34-986b-4c8964683a8e None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:47:15.553148 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 630/1250] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Sep 19 14:47:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:47:15.559448 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a04e00-9a1c-48dc-a9a7-f6125131babb None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:47:15.652734 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:47:15.677147 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a04e00-9a1c-48dc-a9a7-f6125131babb None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:47:15.715118 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac5ae23-c13b-4ddd-9def-59ebbfcddf8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:47:15.715760 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac5ae23-c13b-4ddd-9def-59ebbfcddf8b None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:15.716040 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac5ae23-c13b-4ddd-9def-59ebbfcddf8b None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:15.716311 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac5ae23-c13b-4ddd-9def-59ebbfcddf8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:15.727472 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac5ae23-c13b-4ddd-9def-59ebbfcddf8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:47:15.729201 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac5ae23-c13b-4ddd-9def-59ebbfcddf8b None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:47:15.745325 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-aac5ae23-c13b-4ddd-9def-59ebbfcddf8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:47:15.745325 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:47:15.745325 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:47:15.745325 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:47:15.745325 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:47:15.745325 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:47:15.745325 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:47:15.745325 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:47:15.745325 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:47:15.745325 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:47:15.745325 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:47:15.745325 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:47:15.745325 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:47:15.745325 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:47:15.745325 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:47:15.745325 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:47:15.746500 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:47:15.746500 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:47:15.746500 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:47:15.746500 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:47:15.746500 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:47:15.746500 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:47:15.746500 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:47:15.746500 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:47:15.746500 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:47:15.746500 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:47:15.746500 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:47:15.746500 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:47:15.746500 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:47:15.746500 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:47:15.746500 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:47:15.746500 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:47:15.746500 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:47:15.747601 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:47:15.747601 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:47:15.747601 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:47:15.748666 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 621/1251] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:47:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:47:15.752414 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6722f2a2-649d-4d34-986b-4c8964683a8e None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:47:15.857859 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6722f2a2-649d-4d34-986b-4c8964683a8e None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:47:15.894380 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bf2115-962d-4d71-aff2-d3cba88d91ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:47:15.895000 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bf2115-962d-4d71-aff2-d3cba88d91ee None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:15.895279 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bf2115-962d-4d71-aff2-d3cba88d91ee None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:15.895551 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bf2115-962d-4d71-aff2-d3cba88d91ee None admin] PATH_INFO: `/v3/domains` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:15.896199 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bf2115-962d-4d71-aff2-d3cba88d91ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:47:15.896533 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bf2115-962d-4d71-aff2-d3cba88d91ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:47:15.897905 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bf2115-962d-4d71-aff2-d3cba88d91ee None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:47:15.912469 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 631/1252] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Sep 19 14:47:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:47:15.918902 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac5ae23-c13b-4ddd-9def-59ebbfcddf8b None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:47:16.030230 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac5ae23-c13b-4ddd-9def-59ebbfcddf8b None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:47:16.059673 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:47:16.068224 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d3b6fe-755f-4ddb-98b6-14faca98cd61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:47:16.068885 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d3b6fe-755f-4ddb-98b6-14faca98cd61 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:16.069166 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d3b6fe-755f-4ddb-98b6-14faca98cd61 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:16.069439 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d3b6fe-755f-4ddb-98b6-14faca98cd61 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:16.078015 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d3b6fe-755f-4ddb-98b6-14faca98cd61 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:47:16.079458 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d3b6fe-755f-4ddb-98b6-14faca98cd61 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:47:16.091605 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-e7d3b6fe-755f-4ddb-98b6-14faca98cd61 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 19 14:47:16.091605 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:47:16.091605 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:47:16.091605 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:47:16.091605 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:47:16.091605 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:47:16.091605 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:47:16.091605 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:47:16.091605 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:47:16.091605 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:47:16.091605 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:47:16.091605 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:47:16.091605 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 14:47:16.091605 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 14:47:16.091605 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 14:47:16.091605 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 14:47:16.092821 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:47:16.092821 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:47:16.092821 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:47:16.092821 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:47:16.092821 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:47:16.092821 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:47:16.092821 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:47:16.092821 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:47:16.092821 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:47:16.092821 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:47:16.092821 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:47:16.092821 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:47:16.092821 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:47:16.092821 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:47:16.092821 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:47:16.092821 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:47:16.092821 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:47:16.092821 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:47:16.094063 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:47:16.094063 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:47:16.094063 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 14:47:16.094063 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 14:47:16.094063 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 14:47:16.094063 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 14:47:16.094063 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 14:47:16.094063 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 14:47:16.094063 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 19 14:47:16.094063 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:47:16.094063 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 622/1253] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:47:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:47:16.100644 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bf2115-962d-4d71-aff2-d3cba88d91ee None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:47:16.158488 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:47:16.204624 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bf2115-962d-4d71-aff2-d3cba88d91ee None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:47:16.237420 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577c5e33-cb0a-48d4-9fce-572abda02e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:47:16.238013 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c5e33-cb0a-48d4-9fce-572abda02e9c None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:16.238287 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c5e33-cb0a-48d4-9fce-572abda02e9c None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:16.238553 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c5e33-cb0a-48d4-9fce-572abda02e9c None admin] PATH_INFO: `/v3/users` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:16.239261 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577c5e33-cb0a-48d4-9fce-572abda02e9c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:47:16.239558 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577c5e33-cb0a-48d4-9fce-572abda02e9c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:47:16.240994 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577c5e33-cb0a-48d4-9fce-572abda02e9c None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:47:16.257741 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 632/1254] 10.222.0.72 () {56 vars in 1143 bytes} [Mon Sep 19 14:47:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:47:16.263682 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d3b6fe-755f-4ddb-98b6-14faca98cd61 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:47:16.362842 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d3b6fe-755f-4ddb-98b6-14faca98cd61 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:47:16.395538 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba2e598-9cfc-441c-a95d-b2e995d30017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:47:16.396121 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba2e598-9cfc-441c-a95d-b2e995d30017 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:16.396427 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba2e598-9cfc-441c-a95d-b2e995d30017 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:16.396704 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba2e598-9cfc-441c-a95d-b2e995d30017 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:16.450559 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:47:16.462781 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba2e598-9cfc-441c-a95d-b2e995d30017 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:47:16.464277 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba2e598-9cfc-441c-a95d-b2e995d30017 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:47:16.562646 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 623/1255] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Sep 19 14:47:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 14:47:16.569041 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577c5e33-cb0a-48d4-9fce-572abda02e9c None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:47:16.670967 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577c5e33-cb0a-48d4-9fce-572abda02e9c None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:47:16.683350 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:47:16.704381 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fecb36-bac0-4097-9de7-746739dc3ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:47:16.704999 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fecb36-bac0-4097-9de7-746739dc3ae4 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:16.705277 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fecb36-bac0-4097-9de7-746739dc3ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:16.705547 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fecb36-bac0-4097-9de7-746739dc3ae4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:16.716252 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fecb36-bac0-4097-9de7-746739dc3ae4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:47:16.717690 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fecb36-bac0-4097-9de7-746739dc3ae4 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:47:16.732388 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-39fecb36-bac0-4097-9de7-746739dc3ae4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:47:16.732388 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:47:16.732388 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:47:16.732388 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:47:16.732388 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:47:16.732388 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:47:16.732388 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:47:16.732388 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:47:16.732388 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:47:16.732388 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:47:16.732388 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:47:16.732388 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:47:16.732388 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:47:16.732388 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:47:16.732388 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:47:16.732388 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:47:16.733494 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:47:16.733494 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:47:16.733494 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:47:16.733494 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:47:16.733494 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:47:16.733494 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:47:16.733494 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:47:16.733494 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:47:16.733494 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:47:16.733494 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:47:16.733494 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:47:16.733494 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:47:16.733494 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:47:16.733494 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:47:16.733494 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:47:16.733494 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:47:16.733494 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:47:16.734412 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:47:16.734412 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:47:16.734412 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:47:16.734412 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 633/1256] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:47:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:47:16.739290 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba2e598-9cfc-441c-a95d-b2e995d30017 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:47:16.825262 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:47:16.837232 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba2e598-9cfc-441c-a95d-b2e995d30017 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:47:16.871518 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d46a1a-13fc-4fe2-82ce-817acf04471f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:47:16.872111 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d46a1a-13fc-4fe2-82ce-817acf04471f None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:16.872419 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d46a1a-13fc-4fe2-82ce-817acf04471f None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:16.872693 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d46a1a-13fc-4fe2-82ce-817acf04471f None admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:16.873318 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d46a1a-13fc-4fe2-82ce-817acf04471f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:47:16.873617 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d46a1a-13fc-4fe2-82ce-817acf04471f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:47:16.874978 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d46a1a-13fc-4fe2-82ce-817acf04471f None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:47:16.886081 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 624/1257] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Sep 19 14:47:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:47:16.891872 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fecb36-bac0-4097-9de7-746739dc3ae4 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:47:16.990356 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fecb36-bac0-4097-9de7-746739dc3ae4 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:47:17.022486 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fcb620-b5a1-4861-88a2-acf56c257fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:47:17.023099 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fcb620-b5a1-4861-88a2-acf56c257fc4 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:17.023380 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fcb620-b5a1-4861-88a2-acf56c257fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:17.023649 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fcb620-b5a1-4861-88a2-acf56c257fc4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:17.030255 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fcb620-b5a1-4861-88a2-acf56c257fc4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:47:17.031673 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fcb620-b5a1-4861-88a2-acf56c257fc4 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:47:17.043297 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-e5fcb620-b5a1-4861-88a2-acf56c257fc4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:47:17.043297 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:47:17.043297 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:47:17.043297 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:47:17.043297 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:47:17.043297 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:47:17.043297 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:47:17.043297 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:47:17.043297 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:47:17.043297 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:47:17.043297 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:47:17.043297 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:47:17.043297 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 14:47:17.043297 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 14:47:17.043297 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 14:47:17.044368 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 14:47:17.044368 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:47:17.044368 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:47:17.044368 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:47:17.044368 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:47:17.044368 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:47:17.044368 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:47:17.044368 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:47:17.044368 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:47:17.044368 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:47:17.044368 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:47:17.044368 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:47:17.044368 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:47:17.044368 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:47:17.044368 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:47:17.044368 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:47:17.044368 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:47:17.045497 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 14:47:17.045497 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 14:47:17.045497 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:47:17.045497 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:47:17.045497 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:47:17.045497 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:47:17.045497 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:47:17.045497 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:47:17.045497 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 634/1258] 10.222.0.72 () {56 vars in 1111 bytes} [Mon Sep 19 14:47:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:47:17.052191 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d46a1a-13fc-4fe2-82ce-817acf04471f None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:47:17.150896 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d46a1a-13fc-4fe2-82ce-817acf04471f None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:47:17.187504 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baa4c2c-23b0-49c3-bb59-1d62fd7cd652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:47:17.188373 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa4c2c-23b0-49c3-bb59-1d62fd7cd652 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:17.188654 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa4c2c-23b0-49c3-bb59-1d62fd7cd652 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:17.188924 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa4c2c-23b0-49c3-bb59-1d62fd7cd652 None admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:17.189603 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baa4c2c-23b0-49c3-bb59-1d62fd7cd652 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:47:17.189907 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baa4c2c-23b0-49c3-bb59-1d62fd7cd652 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:47:17.191323 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baa4c2c-23b0-49c3-bb59-1d62fd7cd652 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:47:17.202882 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 625/1259] 10.222.0.72 () {56 vars in 1148 bytes} [Mon Sep 19 14:47:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:47:17.208836 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fcb620-b5a1-4861-88a2-acf56c257fc4 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:47:17.234232 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:47:17.307528 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fcb620-b5a1-4861-88a2-acf56c257fc4 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:47:17.340087 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868d1970-4cd8-4bd2-9f49-7008d43ea5f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:47:17.340707 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868d1970-4cd8-4bd2-9f49-7008d43ea5f8 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:17.340991 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868d1970-4cd8-4bd2-9f49-7008d43ea5f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:17.341265 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868d1970-4cd8-4bd2-9f49-7008d43ea5f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:17.341976 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868d1970-4cd8-4bd2-9f49-7008d43ea5f8 None admin] RBAC: Adding query filter params (role.id=ddb643577b2e4e478100ec370decfaeb, scope.project.id=51af3a14d665498c9b7a35b34dac0ef1, user.id=51e7a0148db8462b8ba24bac6dd15298) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:47:17.342287 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868d1970-4cd8-4bd2-9f49-7008d43ea5f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:47:17.343695 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868d1970-4cd8-4bd2-9f49-7008d43ea5f8 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:47:17.348933 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 635/1260] 10.222.0.72 () {56 vars in 1374 bytes} [Mon Sep 19 14:47:17 2022] GET /identity/v3/role_assignments?user.id=51e7a0148db8462b8ba24bac6dd15298&scope.project.id=51af3a14d665498c9b7a35b34dac0ef1&role.id=ddb643577b2e4e478100ec370decfaeb => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:47:19.450994 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b50f7-c204-461d-b040-3c9f84ea1d47 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:19.451523 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b50f7-c204-461d-b040-3c9f84ea1d47 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:19.451523 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b50f7-c204-461d-b040-3c9f84ea1d47 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:19.452892 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 626/1261] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:47:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:47:19.457988 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5610ec85-cf70-4efd-8ec7-bde687bfff95 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:19.458417 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5610ec85-cf70-4efd-8ec7-bde687bfff95 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:19.458518 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5610ec85-cf70-4efd-8ec7-bde687bfff95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:19.477488 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-5610ec85-cf70-4efd-8ec7-bde687bfff95 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:47:19.478669 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-5610ec85-cf70-4efd-8ec7-bde687bfff95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:47:19.543231 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 636/1262] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:47:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:47:19.818510 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9b50f7-c204-461d-b040-3c9f84ea1d47 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:47:19.830066 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:47:19.921771 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9b50f7-c204-461d-b040-3c9f84ea1d47 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:47:19.956072 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e175aab5-b5e7-4bfe-8e19-c2f85cd72cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:47:19.956721 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e175aab5-b5e7-4bfe-8e19-c2f85cd72cb2 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:19.957004 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e175aab5-b5e7-4bfe-8e19-c2f85cd72cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:19.957278 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e175aab5-b5e7-4bfe-8e19-c2f85cd72cb2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:19.967415 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e175aab5-b5e7-4bfe-8e19-c2f85cd72cb2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:47:19.972285 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-e175aab5-b5e7-4bfe-8e19-c2f85cd72cb2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:47:19.972285 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:47:19.972285 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:47:19.972285 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:47:19.972285 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:47:19.972285 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:47:19.972285 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:47:19.972285 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:47:19.972285 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:47:19.972285 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:47:19.972285 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:47:19.972285 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:47:19.972285 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:47:19.972285 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:47:19.972285 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:47:19.972285 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:47:19.973376 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:47:19.973376 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:47:19.973376 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:47:19.973376 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:47:19.973376 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:47:19.973376 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:47:19.973376 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:47:19.973376 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:47:19.973376 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:47:19.973376 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:47:19.973376 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:47:19.973376 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:47:19.973376 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:47:19.973376 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:47:19.973376 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:47:19.973376 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:47:19.974408 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:47:19.974408 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:47:19.974408 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:47:19.974408 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:47:19.974408 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:47:19.974408 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:47:19.974408 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:47:19.974408 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:47:19.974408 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:47:19.974408 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:47:19.974408 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:47:19.974408 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:47:19.974408 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 627/1263] 10.222.0.72 () {56 vars in 1096 bytes} [Mon Sep 19 14:47:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:47:19.979919 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5610ec85-cf70-4efd-8ec7-bde687bfff95 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:47:19.998179 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:47:20.077611 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5610ec85-cf70-4efd-8ec7-bde687bfff95 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:47:20.110423 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160941e7-b6ca-4740-bc95-fc4673d217f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:47:20.111019 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160941e7-b6ca-4740-bc95-fc4673d217f3 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:20.111297 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160941e7-b6ca-4740-bc95-fc4673d217f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:20.111565 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160941e7-b6ca-4740-bc95-fc4673d217f3 None admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:20.112220 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160941e7-b6ca-4740-bc95-fc4673d217f3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:47:20.112555 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160941e7-b6ca-4740-bc95-fc4673d217f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:47:20.113905 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160941e7-b6ca-4740-bc95-fc4673d217f3 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:47:20.122210 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 637/1264] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Sep 19 14:47:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:47:20.127951 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e175aab5-b5e7-4bfe-8e19-c2f85cd72cb2 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:47:20.197238 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:47:20.230898 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e175aab5-b5e7-4bfe-8e19-c2f85cd72cb2 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:47:20.263634 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9101d7c-89ba-457f-a556-3a4a50cf8e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:47:20.264252 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9101d7c-89ba-457f-a556-3a4a50cf8e44 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:20.264559 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9101d7c-89ba-457f-a556-3a4a50cf8e44 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:20.264834 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9101d7c-89ba-457f-a556-3a4a50cf8e44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:20.274964 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9101d7c-89ba-457f-a556-3a4a50cf8e44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:47:20.276464 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9101d7c-89ba-457f-a556-3a4a50cf8e44 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:47:20.290227 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-e9101d7c-89ba-457f-a556-3a4a50cf8e44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:47:20.290227 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:47:20.290227 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:47:20.290227 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:47:20.290227 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:47:20.290227 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:47:20.290227 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:47:20.290227 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:47:20.290227 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:47:20.290227 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:47:20.290227 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:47:20.290227 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:47:20.290227 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:47:20.290227 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:47:20.290227 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:47:20.290227 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:47:20.291814 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:47:20.291814 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:47:20.291814 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:47:20.291814 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:47:20.291814 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:47:20.291814 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:47:20.291814 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:47:20.291814 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:47:20.291814 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:47:20.291814 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:47:20.291814 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:47:20.291814 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:47:20.291814 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:47:20.291814 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:47:20.291814 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:47:20.291814 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:47:20.291814 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:47:20.292891 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:47:20.292891 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:47:20.292891 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:47:20.292891 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 628/1265] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:47:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:47:20.297609 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160941e7-b6ca-4740-bc95-fc4673d217f3 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:47:20.375880 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:47:20.394575 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160941e7-b6ca-4740-bc95-fc4673d217f3 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:47:20.427341 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d44dab6-b028-40ff-847e-978030e9f9be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:47:20.427931 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d44dab6-b028-40ff-847e-978030e9f9be None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:20.428211 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d44dab6-b028-40ff-847e-978030e9f9be None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:20.428512 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d44dab6-b028-40ff-847e-978030e9f9be None admin] PATH_INFO: `/v3/domains` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:20.429145 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d44dab6-b028-40ff-847e-978030e9f9be None admin] RBAC: Adding query filter params (name=Default) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:47:20.429447 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d44dab6-b028-40ff-847e-978030e9f9be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:47:20.430793 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d44dab6-b028-40ff-847e-978030e9f9be None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:47:20.442433 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 638/1266] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Sep 19 14:47:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:47:20.448049 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9101d7c-89ba-457f-a556-3a4a50cf8e44 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:47:20.545848 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9101d7c-89ba-457f-a556-3a4a50cf8e44 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:47:20.570610 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:47:20.587116 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53223e5d-22a2-4d68-b573-88c94ed2aa7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:47:20.588292 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53223e5d-22a2-4d68-b573-88c94ed2aa7c None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:20.588682 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53223e5d-22a2-4d68-b573-88c94ed2aa7c None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:20.589019 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53223e5d-22a2-4d68-b573-88c94ed2aa7c None admin] PATH_INFO: `/v3/users/placement` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:20.596679 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53223e5d-22a2-4d68-b573-88c94ed2aa7c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:47:20.598111 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53223e5d-22a2-4d68-b573-88c94ed2aa7c None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:47:20.609781 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-53223e5d-22a2-4d68-b573-88c94ed2aa7c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 19 14:47:20.609781 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:47:20.609781 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:47:20.609781 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:47:20.609781 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:47:20.609781 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:47:20.609781 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:47:20.609781 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:47:20.609781 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:47:20.609781 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:47:20.609781 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:47:20.609781 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:47:20.609781 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 14:47:20.609781 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 14:47:20.609781 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 14:47:20.609781 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 14:47:20.610853 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:47:20.610853 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:47:20.610853 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:47:20.610853 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:47:20.610853 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:47:20.610853 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:47:20.610853 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:47:20.610853 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:47:20.610853 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:47:20.610853 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:47:20.610853 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:47:20.610853 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:47:20.610853 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:47:20.610853 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:47:20.610853 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:47:20.610853 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:47:20.610853 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:47:20.610853 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:47:20.611974 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:47:20.611974 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:47:20.611974 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 14:47:20.611974 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 14:47:20.611974 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 14:47:20.611974 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 14:47:20.611974 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 14:47:20.611974 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 14:47:20.611974 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 19 14:47:20.611974 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:47:20.611974 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 629/1267] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:47:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:47:20.616746 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d44dab6-b028-40ff-847e-978030e9f9be None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:47:20.713453 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d44dab6-b028-40ff-847e-978030e9f9be None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:47:20.746082 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96540eea-bbdf-4591-87cb-b6b24c70f95b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:47:20.746676 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96540eea-bbdf-4591-87cb-b6b24c70f95b None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:20.746953 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96540eea-bbdf-4591-87cb-b6b24c70f95b None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:20.747221 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96540eea-bbdf-4591-87cb-b6b24c70f95b None admin] PATH_INFO: `/v3/users` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:20.747931 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96540eea-bbdf-4591-87cb-b6b24c70f95b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:47:20.748233 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96540eea-bbdf-4591-87cb-b6b24c70f95b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:47:20.749666 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96540eea-bbdf-4591-87cb-b6b24c70f95b None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:47:20.757895 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:47:20.767289 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 639/1268] 10.222.0.72 () {56 vars in 1143 bytes} [Mon Sep 19 14:47:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:47:20.773060 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53223e5d-22a2-4d68-b573-88c94ed2aa7c None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:47:20.871301 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53223e5d-22a2-4d68-b573-88c94ed2aa7c None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:47:20.905015 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b117bc-0a4f-46d2-b494-591903aa4a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:47:20.905633 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b117bc-0a4f-46d2-b494-591903aa4a0f None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:20.905914 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b117bc-0a4f-46d2-b494-591903aa4a0f None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:20.906186 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b117bc-0a4f-46d2-b494-591903aa4a0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:20.916555 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b117bc-0a4f-46d2-b494-591903aa4a0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:47:20.917986 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b117bc-0a4f-46d2-b494-591903aa4a0f None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:47:20.931756 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-e4b117bc-0a4f-46d2-b494-591903aa4a0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:47:20.931756 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:47:20.931756 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:47:20.931756 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:47:20.931756 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:47:20.931756 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:47:20.931756 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:47:20.931756 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:47:20.931756 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:47:20.931756 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:47:20.931756 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:47:20.931756 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:47:20.931756 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:47:20.931756 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:47:20.931756 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:47:20.931756 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:47:20.932883 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:47:20.932883 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:47:20.932883 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:47:20.932883 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:47:20.932883 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:47:20.932883 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:47:20.932883 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:47:20.932883 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:47:20.932883 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:47:20.932883 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:47:20.932883 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:47:20.932883 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:47:20.932883 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:47:20.932883 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:47:20.932883 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:47:20.932883 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:47:20.932883 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:47:20.934214 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:47:20.934214 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:47:20.934214 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:47:20.934214 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 630/1269] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:47:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:47:20.938845 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96540eea-bbdf-4591-87cb-b6b24c70f95b None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:47:21.034188 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96540eea-bbdf-4591-87cb-b6b24c70f95b None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:47:21.066388 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8d7eb2-7646-478a-be2d-65fae405a521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:47:21.066975 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8d7eb2-7646-478a-be2d-65fae405a521 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:21.067249 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8d7eb2-7646-478a-be2d-65fae405a521 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:21.067516 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8d7eb2-7646-478a-be2d-65fae405a521 None admin] PATH_INFO: `/v3/domains` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:21.068138 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8d7eb2-7646-478a-be2d-65fae405a521 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:47:21.068457 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8d7eb2-7646-478a-be2d-65fae405a521 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:47:21.069791 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8d7eb2-7646-478a-be2d-65fae405a521 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:47:21.080956 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 640/1270] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Sep 19 14:47:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:47:21.086578 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b117bc-0a4f-46d2-b494-591903aa4a0f None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:47:21.117706 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:47:21.185380 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b117bc-0a4f-46d2-b494-591903aa4a0f None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:47:21.218379 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7175bf06-c35c-4ab8-8e60-d61384fcef50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:47:21.218986 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7175bf06-c35c-4ab8-8e60-d61384fcef50 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:21.219265 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7175bf06-c35c-4ab8-8e60-d61384fcef50 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:21.219539 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7175bf06-c35c-4ab8-8e60-d61384fcef50 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:21.225952 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7175bf06-c35c-4ab8-8e60-d61384fcef50 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:47:21.227374 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7175bf06-c35c-4ab8-8e60-d61384fcef50 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:47:21.238499 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-7175bf06-c35c-4ab8-8e60-d61384fcef50 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:47:21.238499 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:47:21.238499 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:47:21.238499 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:47:21.238499 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:47:21.238499 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:47:21.238499 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:47:21.238499 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:47:21.238499 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:47:21.238499 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:47:21.238499 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:47:21.238499 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:47:21.238499 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 14:47:21.238499 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 14:47:21.238499 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 14:47:21.239521 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 14:47:21.239521 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:47:21.239521 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:47:21.239521 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:47:21.239521 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:47:21.239521 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:47:21.239521 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:47:21.239521 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:47:21.239521 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:47:21.239521 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:47:21.239521 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:47:21.239521 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:47:21.239521 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:47:21.239521 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:47:21.239521 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:47:21.239521 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:47:21.239521 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:47:21.240495 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 14:47:21.240495 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 14:47:21.240495 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:47:21.240495 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:47:21.240495 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:47:21.240495 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:47:21.240495 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:47:21.240495 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:47:21.240495 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 631/1271] 10.222.0.72 () {56 vars in 1111 bytes} [Mon Sep 19 14:47:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:47:21.245934 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8d7eb2-7646-478a-be2d-65fae405a521 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:47:21.301933 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:47:21.343205 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8d7eb2-7646-478a-be2d-65fae405a521 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:47:21.375543 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619cb961-f5de-4b0b-bcac-68574f8689b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:47:21.376138 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619cb961-f5de-4b0b-bcac-68574f8689b8 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:21.376463 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619cb961-f5de-4b0b-bcac-68574f8689b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:21.376721 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619cb961-f5de-4b0b-bcac-68574f8689b8 None admin] PATH_INFO: `/v3/projects` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:21.377407 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619cb961-f5de-4b0b-bcac-68574f8689b8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:47:21.377710 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619cb961-f5de-4b0b-bcac-68574f8689b8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:47:21.379120 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619cb961-f5de-4b0b-bcac-68574f8689b8 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:47:21.391305 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 641/1272] 10.222.0.72 () {56 vars in 1148 bytes} [Mon Sep 19 14:47:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:47:21.397211 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7175bf06-c35c-4ab8-8e60-d61384fcef50 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:47:21.487638 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:47:21.497094 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7175bf06-c35c-4ab8-8e60-d61384fcef50 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:47:21.529384 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed1e368-e676-4d19-a34c-b39eff76d617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:47:21.530022 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed1e368-e676-4d19-a34c-b39eff76d617 None admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:21.530301 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed1e368-e676-4d19-a34c-b39eff76d617 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:21.530576 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed1e368-e676-4d19-a34c-b39eff76d617 None admin] PATH_INFO: `/v3/projects/51af3a14d665498c9b7a35b34dac0ef1/users/51e7a0148db8462b8ba24bac6dd15298/roles/ddb643577b2e4e478100ec370decfaeb` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:21.532442 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed1e368-e676-4d19-a34c-b39eff76d617 None admin] RBAC: Authorizing `identity:create_grant(project_id=51af3a14d665498c9b7a35b34dac0ef1, user_id=51e7a0148db8462b8ba24bac6dd15298, role_id=ddb643577b2e4e478100ec370decfaeb)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:47:21.533856 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed1e368-e676-4d19-a34c-b39eff76d617 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:47:21.546419 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 632/1273] 10.222.0.72 () {58 vars in 1439 bytes} [Mon Sep 19 14:47:21 2022] PUT /identity/v3/projects/51af3a14d665498c9b7a35b34dac0ef1/users/51e7a0148db8462b8ba24bac6dd15298/roles/ddb643577b2e4e478100ec370decfaeb => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:47:23.693899 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de50771-bdb1-484e-a88c-dc6a1d288a50 None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:23.694457 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de50771-bdb1-484e-a88c-dc6a1d288a50 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:23.694457 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de50771-bdb1-484e-a88c-dc6a1d288a50 None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:23.695739 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 642/1274] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:47:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:47:23.701799 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f8ff5b-3d14-49d4-a4c7-79fa701dcbce None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:23.702188 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f8ff5b-3d14-49d4-a4c7-79fa701dcbce None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:23.702350 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f8ff5b-3d14-49d4-a4c7-79fa701dcbce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:23.720645 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-f4f8ff5b-3d14-49d4-a4c7-79fa701dcbce None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:47:23.721823 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-f4f8ff5b-3d14-49d4-a4c7-79fa701dcbce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:47:23.786775 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 633/1275] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:47:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:47:24.055207 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de50771-bdb1-484e-a88c-dc6a1d288a50 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:47:24.154377 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de50771-bdb1-484e-a88c-dc6a1d288a50 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:47:24.170987 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:47:24.189523 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d202c8-e7b1-4aeb-8025-156d090a3b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:47:24.190147 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d202c8-e7b1-4aeb-8025-156d090a3b91 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:24.190427 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d202c8-e7b1-4aeb-8025-156d090a3b91 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:24.190696 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d202c8-e7b1-4aeb-8025-156d090a3b91 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:24.201080 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d202c8-e7b1-4aeb-8025-156d090a3b91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:47:24.205940 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-e9d202c8-e7b1-4aeb-8025-156d090a3b91 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:47:24.205940 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:47:24.205940 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:47:24.205940 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:47:24.205940 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:47:24.205940 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:47:24.205940 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:47:24.205940 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:47:24.205940 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:47:24.205940 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:47:24.205940 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:47:24.205940 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:47:24.205940 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:47:24.205940 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:47:24.205940 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:47:24.205940 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:47:24.207021 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:47:24.207021 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:47:24.207021 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:47:24.207021 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:47:24.207021 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:47:24.207021 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:47:24.207021 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:47:24.207021 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:47:24.207021 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:47:24.207021 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:47:24.207021 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:47:24.207021 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:47:24.207021 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:47:24.207021 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:47:24.207021 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:47:24.207021 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:47:24.208056 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:47:24.208056 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:47:24.208056 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:47:24.208056 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:47:24.208056 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:47:24.208056 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:47:24.208056 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:47:24.208056 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:47:24.208056 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:47:24.208056 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:47:24.208056 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:47:24.208056 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:47:24.208056 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 643/1276] 10.222.0.72 () {56 vars in 1096 bytes} [Mon Sep 19 14:47:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:47:24.213248 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f8ff5b-3d14-49d4-a4c7-79fa701dcbce None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:47:24.290555 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:47:24.310453 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f8ff5b-3d14-49d4-a4c7-79fa701dcbce None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:47:24.343454 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4574ddc-4ba8-4d21-a2b7-f0329b502413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:47:24.344049 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4574ddc-4ba8-4d21-a2b7-f0329b502413 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:24.344350 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4574ddc-4ba8-4d21-a2b7-f0329b502413 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:24.344629 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4574ddc-4ba8-4d21-a2b7-f0329b502413 None admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:24.345278 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4574ddc-4ba8-4d21-a2b7-f0329b502413 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:47:24.345580 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4574ddc-4ba8-4d21-a2b7-f0329b502413 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:47:24.346932 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4574ddc-4ba8-4d21-a2b7-f0329b502413 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:47:24.354854 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 634/1277] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Sep 19 14:47:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:47:24.360740 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d202c8-e7b1-4aeb-8025-156d090a3b91 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:47:24.457202 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d202c8-e7b1-4aeb-8025-156d090a3b91 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:47:24.489701 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6d300c-86e4-4776-8dc0-9fce1b9d0013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:47:24.490304 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6d300c-86e4-4776-8dc0-9fce1b9d0013 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:24.490579 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6d300c-86e4-4776-8dc0-9fce1b9d0013 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:24.490848 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6d300c-86e4-4776-8dc0-9fce1b9d0013 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:24.500956 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6d300c-86e4-4776-8dc0-9fce1b9d0013 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:47:24.502361 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6d300c-86e4-4776-8dc0-9fce1b9d0013 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:47:24.516392 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-3f6d300c-86e4-4776-8dc0-9fce1b9d0013 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:47:24.516392 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:47:24.516392 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:47:24.516392 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:47:24.516392 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:47:24.516392 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:47:24.516392 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:47:24.516392 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:47:24.516392 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:47:24.516392 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:47:24.516392 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:47:24.516392 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:47:24.516392 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:47:24.516392 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:47:24.516392 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:47:24.516392 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:47:24.517549 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:47:24.517549 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:47:24.517549 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:47:24.517549 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:47:24.517549 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:47:24.517549 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:47:24.517549 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:47:24.517549 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:47:24.517549 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:47:24.517549 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:47:24.517549 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:47:24.517549 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:47:24.517549 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:47:24.517549 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:47:24.517549 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:47:24.517549 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:47:24.517549 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:47:24.518595 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:47:24.518595 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:47:24.518595 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:47:24.518595 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 644/1278] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:47:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:47:24.523187 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4574ddc-4ba8-4d21-a2b7-f0329b502413 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:47:24.631663 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4574ddc-4ba8-4d21-a2b7-f0329b502413 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:47:24.663400 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fa52ad-6037-45cb-8ea2-9a07d87572a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:47:24.663992 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fa52ad-6037-45cb-8ea2-9a07d87572a6 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:24.664269 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fa52ad-6037-45cb-8ea2-9a07d87572a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:24.664565 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fa52ad-6037-45cb-8ea2-9a07d87572a6 None admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:24.665190 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fa52ad-6037-45cb-8ea2-9a07d87572a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:47:24.665490 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fa52ad-6037-45cb-8ea2-9a07d87572a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:47:24.667367 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fa52ad-6037-45cb-8ea2-9a07d87572a6 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:47:24.678976 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 635/1279] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Sep 19 14:47:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:47:24.685312 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6d300c-86e4-4776-8dc0-9fce1b9d0013 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:47:24.715011 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:47:24.781911 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6d300c-86e4-4776-8dc0-9fce1b9d0013 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:47:24.814812 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2c0177-73c1-4414-8f0b-d7dbc3a17e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:47:24.815425 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2c0177-73c1-4414-8f0b-d7dbc3a17e2e None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:24.815710 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2c0177-73c1-4414-8f0b-d7dbc3a17e2e None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:24.815982 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2c0177-73c1-4414-8f0b-d7dbc3a17e2e None admin] PATH_INFO: `/v3/users/placement` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:24.823277 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2c0177-73c1-4414-8f0b-d7dbc3a17e2e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:47:24.824751 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2c0177-73c1-4414-8f0b-d7dbc3a17e2e None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:47:24.835582 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-4b2c0177-73c1-4414-8f0b-d7dbc3a17e2e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 19 14:47:24.835582 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:47:24.835582 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:47:24.835582 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:47:24.835582 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:47:24.835582 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:47:24.835582 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:47:24.835582 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:47:24.835582 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:47:24.835582 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:47:24.835582 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:47:24.835582 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:47:24.835582 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 14:47:24.835582 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 14:47:24.835582 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 14:47:24.835582 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 14:47:24.840458 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:47:24.840458 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:47:24.840458 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:47:24.840458 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:47:24.840458 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:47:24.840458 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:47:24.840458 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:47:24.840458 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:47:24.840458 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:47:24.840458 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:47:24.840458 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:47:24.840458 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:47:24.840458 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:47:24.840458 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:47:24.840458 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:47:24.840458 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:47:24.840458 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:47:24.840458 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:47:24.841666 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:47:24.841666 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:47:24.841666 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 14:47:24.841666 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 14:47:24.841666 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 14:47:24.841666 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 14:47:24.841666 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 14:47:24.841666 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 14:47:24.841666 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 19 14:47:24.841666 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:47:24.841666 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 645/1280] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:47:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:47:24.843118 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fa52ad-6037-45cb-8ea2-9a07d87572a6 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:47:24.846917 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:47:24.943252 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fa52ad-6037-45cb-8ea2-9a07d87572a6 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:47:24.976638 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a634a2-9921-43e7-ae1c-e91759e26320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:47:24.977235 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a634a2-9921-43e7-ae1c-e91759e26320 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:24.977516 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a634a2-9921-43e7-ae1c-e91759e26320 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:24.977790 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a634a2-9921-43e7-ae1c-e91759e26320 None admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:24.979301 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a634a2-9921-43e7-ae1c-e91759e26320 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:47:24.979607 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a634a2-9921-43e7-ae1c-e91759e26320 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:47:24.981056 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a634a2-9921-43e7-ae1c-e91759e26320 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:47:24.997645 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 636/1281] 10.222.0.72 () {56 vars in 1143 bytes} [Mon Sep 19 14:47:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:47:25.003516 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2c0177-73c1-4414-8f0b-d7dbc3a17e2e None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:47:25.092908 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:47:25.102532 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2c0177-73c1-4414-8f0b-d7dbc3a17e2e None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:47:25.136729 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30b626c-9dcf-48bd-bb85-4d7595e4e98d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:47:25.137320 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30b626c-9dcf-48bd-bb85-4d7595e4e98d None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:25.137602 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30b626c-9dcf-48bd-bb85-4d7595e4e98d None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:25.137876 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30b626c-9dcf-48bd-bb85-4d7595e4e98d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:25.202553 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30b626c-9dcf-48bd-bb85-4d7595e4e98d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:47:25.203920 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30b626c-9dcf-48bd-bb85-4d7595e4e98d None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:47:25.289402 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:47:25.300057 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 646/1282] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Sep 19 14:47:25 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 14:47:25.305929 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a634a2-9921-43e7-ae1c-e91759e26320 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:47:25.367865 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:47:25.405674 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a634a2-9921-43e7-ae1c-e91759e26320 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:47:25.438372 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444089fc-0976-4aa3-aff4-e92235f05bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:47:25.438991 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444089fc-0976-4aa3-aff4-e92235f05bfa None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:25.439270 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444089fc-0976-4aa3-aff4-e92235f05bfa None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:25.439541 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444089fc-0976-4aa3-aff4-e92235f05bfa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:25.449732 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444089fc-0976-4aa3-aff4-e92235f05bfa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:47:25.451150 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444089fc-0976-4aa3-aff4-e92235f05bfa None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:47:25.465866 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-444089fc-0976-4aa3-aff4-e92235f05bfa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:47:25.465866 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:47:25.465866 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:47:25.465866 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:47:25.465866 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:47:25.465866 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:47:25.465866 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:47:25.465866 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:47:25.465866 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:47:25.465866 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:47:25.465866 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:47:25.465866 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:47:25.465866 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:47:25.465866 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:47:25.465866 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:47:25.465866 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:47:25.466956 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:47:25.466956 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:47:25.466956 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:47:25.466956 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:47:25.466956 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:47:25.466956 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:47:25.466956 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:47:25.466956 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:47:25.466956 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:47:25.466956 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:47:25.466956 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:47:25.466956 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:47:25.466956 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:47:25.466956 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:47:25.466956 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:47:25.466956 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:47:25.466956 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:47:25.468060 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:47:25.468060 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:47:25.468060 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:47:25.468060 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 637/1283] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:47:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:47:25.472676 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30b626c-9dcf-48bd-bb85-4d7595e4e98d None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:47:25.568547 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30b626c-9dcf-48bd-bb85-4d7595e4e98d None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:47:25.601092 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea2e219-746c-4320-b4f8-ebf51489fd44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:47:25.601680 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea2e219-746c-4320-b4f8-ebf51489fd44 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:25.601956 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea2e219-746c-4320-b4f8-ebf51489fd44 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:25.602226 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea2e219-746c-4320-b4f8-ebf51489fd44 None admin] PATH_INFO: `/v3/domains` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:25.602847 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea2e219-746c-4320-b4f8-ebf51489fd44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:47:25.603142 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea2e219-746c-4320-b4f8-ebf51489fd44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:47:25.604995 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea2e219-746c-4320-b4f8-ebf51489fd44 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:47:25.615585 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 647/1284] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Sep 19 14:47:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:47:25.621928 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444089fc-0976-4aa3-aff4-e92235f05bfa None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:47:25.719218 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444089fc-0976-4aa3-aff4-e92235f05bfa None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:47:25.732914 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:47:25.757165 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43a6373-3a94-4b57-8b1e-ca164b1d8202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:47:25.758132 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a6373-3a94-4b57-8b1e-ca164b1d8202 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:25.758593 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a6373-3a94-4b57-8b1e-ca164b1d8202 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:25.759046 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a6373-3a94-4b57-8b1e-ca164b1d8202 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:25.766755 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43a6373-3a94-4b57-8b1e-ca164b1d8202 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:47:25.768189 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43a6373-3a94-4b57-8b1e-ca164b1d8202 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:47:25.779863 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application [None req-c43a6373-3a94-4b57-8b1e-ca164b1d8202 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:47:25.779863 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:47:25.779863 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:47:25.779863 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:47:25.779863 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:47:25.779863 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:47:25.779863 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:47:25.779863 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:47:25.779863 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:47:25.779863 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:47:25.779863 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:47:25.779863 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:47:25.779863 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 14:47:25.779863 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 14:47:25.779863 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 14:47:25.780941 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 14:47:25.780941 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:47:25.780941 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:47:25.780941 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:47:25.780941 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:47:25.780941 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:47:25.780941 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:47:25.780941 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:47:25.780941 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application with Lock( Sep 19 14:47:25.780941 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:47:25.780941 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:47:25.780941 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:47:25.780941 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:47:25.780941 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:47:25.780941 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:47:25.780941 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:47:25.780941 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:47:25.782036 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 14:47:25.782036 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 14:47:25.782036 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:47:25.782036 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:47:25.782036 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:47:25.782036 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:47:25.782036 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:47:25.782036 dv-cinder-756711-11-smb devstack@keystone.service[81451]: ERROR keystone.server.flask.application Sep 19 14:47:25.782036 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 638/1285] 10.222.0.72 () {56 vars in 1111 bytes} [Mon Sep 19 14:47:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:47:25.786804 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea2e219-746c-4320-b4f8-ebf51489fd44 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:47:25.835627 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:47:25.885068 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea2e219-746c-4320-b4f8-ebf51489fd44 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:47:25.918620 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7d9791-d85f-4511-9f14-a1e9667ff11e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:47:25.919223 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d9791-d85f-4511-9f14-a1e9667ff11e None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:25.919502 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d9791-d85f-4511-9f14-a1e9667ff11e None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:25.919775 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d9791-d85f-4511-9f14-a1e9667ff11e None admin] PATH_INFO: `/v3/projects` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:25.920491 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7d9791-d85f-4511-9f14-a1e9667ff11e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:47:25.920800 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7d9791-d85f-4511-9f14-a1e9667ff11e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:47:25.922210 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7d9791-d85f-4511-9f14-a1e9667ff11e None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:47:25.933801 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 648/1286] 10.222.0.72 () {56 vars in 1148 bytes} [Mon Sep 19 14:47:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:47:25.940088 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43a6373-3a94-4b57-8b1e-ca164b1d8202 None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:47:26.038056 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43a6373-3a94-4b57-8b1e-ca164b1d8202 None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:47:26.070358 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87188f02-8f00-497a-9967-8470f7d146d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:47:26.070944 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87188f02-8f00-497a-9967-8470f7d146d3 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:26.071224 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87188f02-8f00-497a-9967-8470f7d146d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:26.071496 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87188f02-8f00-497a-9967-8470f7d146d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:26.072736 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87188f02-8f00-497a-9967-8470f7d146d3 None admin] RBAC: Adding query filter params (role.id=ddb643577b2e4e478100ec370decfaeb, scope.project.id=51af3a14d665498c9b7a35b34dac0ef1, user.id=51e7a0148db8462b8ba24bac6dd15298) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:47:26.073044 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87188f02-8f00-497a-9967-8470f7d146d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:47:26.074454 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87188f02-8f00-497a-9967-8470f7d146d3 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:47:26.080054 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 639/1287] 10.222.0.72 () {56 vars in 1374 bytes} [Mon Sep 19 14:47:25 2022] GET /identity/v3/role_assignments?user.id=51e7a0148db8462b8ba24bac6dd15298&scope.project.id=51af3a14d665498c9b7a35b34dac0ef1&role.id=ddb643577b2e4e478100ec370decfaeb => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:47:28.207609 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b3252-b2c4-41a3-bdfe-5dd27371ef2a None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:28.208112 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b3252-b2c4-41a3-bdfe-5dd27371ef2a None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:28.208198 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b3252-b2c4-41a3-bdfe-5dd27371ef2a None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:28.209551 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 649/1288] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:47:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:47:28.214863 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d6bfe7-8a59-407c-abe6-7ebb4a7ea33a None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:28.215263 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d6bfe7-8a59-407c-abe6-7ebb4a7ea33a None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:28.215411 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d6bfe7-8a59-407c-abe6-7ebb4a7ea33a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:28.234017 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-36d6bfe7-8a59-407c-abe6-7ebb4a7ea33a None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:47:28.235209 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-36d6bfe7-8a59-407c-abe6-7ebb4a7ea33a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:47:28.264431 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:47:28.300157 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 640/1289] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:47:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:47:28.570284 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714b3252-b2c4-41a3-bdfe-5dd27371ef2a None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:47:28.677813 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714b3252-b2c4-41a3-bdfe-5dd27371ef2a None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:47:28.688059 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:47:28.710996 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a55870-eea4-4c6c-abe1-d76652ecc5d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:47:28.711620 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a55870-eea4-4c6c-abe1-d76652ecc5d0 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:28.711901 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a55870-eea4-4c6c-abe1-d76652ecc5d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:28.712175 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a55870-eea4-4c6c-abe1-d76652ecc5d0 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:28.713414 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a55870-eea4-4c6c-abe1-d76652ecc5d0 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:47:28.714776 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a55870-eea4-4c6c-abe1-d76652ecc5d0 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:47:28.723504 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-c0a55870-eea4-4c6c-abe1-d76652ecc5d0 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 19 14:47:28.723504 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:47:28.723504 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 14:47:28.723504 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 14:47:28.723504 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 14:47:28.723504 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 14:47:28.723504 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 14:47:28.723504 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:47:28.723504 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 19 14:47:28.723504 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:47:28.723504 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 14:47:28.723504 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:47:28.723504 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:47:28.723504 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:47:28.723504 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:47:28.723504 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:47:28.723504 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:47:28.724907 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:47:28.724907 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:47:28.724907 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:47:28.724907 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:47:28.724907 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:47:28.724907 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:47:28.724907 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 14:47:28.724907 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 14:47:28.724907 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 14:47:28.724907 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 14:47:28.724907 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:47:28.724907 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:47:28.724907 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:47:28.724907 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:47:28.724907 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:47:28.724907 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:47:28.726031 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:47:28.726031 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:47:28.726031 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:47:28.726031 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:47:28.726031 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:47:28.726031 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:47:28.726031 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:47:28.726031 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:47:28.726031 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:47:28.726031 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:47:28.726031 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 14:47:28.726031 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:47:28.726031 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 19 14:47:28.726031 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:47:28.726031 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 650/1290] 10.222.0.72 () {56 vars in 1117 bytes} [Mon Sep 19 14:47:28 2022] GET /identity/v3/services/placement => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:47:28.731280 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d6bfe7-8a59-407c-abe6-7ebb4a7ea33a None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:47:28.827775 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d6bfe7-8a59-407c-abe6-7ebb4a7ea33a None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:47:28.861534 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec28b18-1d19-47e9-bd52-a6ae7db99e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:47:28.862130 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec28b18-1d19-47e9-bd52-a6ae7db99e53 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:28.862415 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec28b18-1d19-47e9-bd52-a6ae7db99e53 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:28.862691 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec28b18-1d19-47e9-bd52-a6ae7db99e53 None admin] PATH_INFO: `/v3/services` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:28.863313 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec28b18-1d19-47e9-bd52-a6ae7db99e53 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:47:28.863619 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec28b18-1d19-47e9-bd52-a6ae7db99e53 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:47:28.865010 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec28b18-1d19-47e9-bd52-a6ae7db99e53 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:47:28.869857 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 641/1291] 10.222.0.72 () {56 vars in 1116 bytes} [Mon Sep 19 14:47:28 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:47:28.875771 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a55870-eea4-4c6c-abe1-d76652ecc5d0 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:47:28.973035 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a55870-eea4-4c6c-abe1-d76652ecc5d0 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:47:29.004874 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05e1ab0-5126-45f2-acdf-b8031ac4d144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:47:29.005462 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05e1ab0-5126-45f2-acdf-b8031ac4d144 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:29.005741 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05e1ab0-5126-45f2-acdf-b8031ac4d144 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:29.006010 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05e1ab0-5126-45f2-acdf-b8031ac4d144 None admin] PATH_INFO: `/v3/services` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:29.006627 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05e1ab0-5126-45f2-acdf-b8031ac4d144 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:47:29.006927 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05e1ab0-5126-45f2-acdf-b8031ac4d144 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:47:29.008267 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05e1ab0-5126-45f2-acdf-b8031ac4d144 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:47:29.013317 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 651/1292] 10.222.0.72 () {56 vars in 1116 bytes} [Mon Sep 19 14:47:28 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:47:31.173269 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db3fad7-ab7e-4905-a9b6-4eac34460cd1 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:31.173764 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db3fad7-ab7e-4905-a9b6-4eac34460cd1 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:31.173764 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db3fad7-ab7e-4905-a9b6-4eac34460cd1 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:31.175069 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 642/1293] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:47:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:47:31.180302 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c41d172-b67b-4be9-ab07-e0805048c486 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:31.180744 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c41d172-b67b-4be9-ab07-e0805048c486 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:31.180870 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c41d172-b67b-4be9-ab07-e0805048c486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:31.200594 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-6c41d172-b67b-4be9-ab07-e0805048c486 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:47:31.201770 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-6c41d172-b67b-4be9-ab07-e0805048c486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:47:31.230125 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:47:31.265699 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 652/1294] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:47:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:47:31.536044 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db3fad7-ab7e-4905-a9b6-4eac34460cd1 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:47:31.569222 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:47:31.639280 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db3fad7-ab7e-4905-a9b6-4eac34460cd1 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:47:31.672789 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b12805-9d6f-408f-b2d8-463387f8b6a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:47:31.673383 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b12805-9d6f-408f-b2d8-463387f8b6a9 None admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:31.673664 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b12805-9d6f-408f-b2d8-463387f8b6a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:31.673937 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b12805-9d6f-408f-b2d8-463387f8b6a9 None admin] PATH_INFO: `/v3/services` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:31.674575 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b12805-9d6f-408f-b2d8-463387f8b6a9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:47:31.675924 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b12805-9d6f-408f-b2d8-463387f8b6a9 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:47:31.689903 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 643/1295] 10.222.0.72 () {60 vars in 1141 bytes} [Mon Sep 19 14:47:31 2022] POST /identity/v3/services => generated 246 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:47:33.862056 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4dcae1-1e97-4f81-ae9b-407ed6243b07 None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:33.862596 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4dcae1-1e97-4f81-ae9b-407ed6243b07 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:33.862596 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4dcae1-1e97-4f81-ae9b-407ed6243b07 None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:33.863920 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 653/1296] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:47:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:47:33.869660 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a70984-94ef-4bf6-8686-2341b5fc5b16 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:33.870170 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a70984-94ef-4bf6-8686-2341b5fc5b16 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:33.870264 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a70984-94ef-4bf6-8686-2341b5fc5b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:33.888476 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-99a70984-94ef-4bf6-8686-2341b5fc5b16 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:47:33.889647 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-99a70984-94ef-4bf6-8686-2341b5fc5b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:47:33.960447 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 644/1297] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:47:33 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 14:47:34.229384 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4dcae1-1e97-4f81-ae9b-407ed6243b07 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:47:34.329990 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4dcae1-1e97-4f81-ae9b-407ed6243b07 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:47:34.362747 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067d8664-362f-4ad2-9df5-8fdfd2d3d869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:47:34.363364 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d8664-362f-4ad2-9df5-8fdfd2d3d869 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:34.363645 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d8664-362f-4ad2-9df5-8fdfd2d3d869 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:34.363918 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d8664-362f-4ad2-9df5-8fdfd2d3d869 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:34.364519 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067d8664-362f-4ad2-9df5-8fdfd2d3d869 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:47:34.365875 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067d8664-362f-4ad2-9df5-8fdfd2d3d869 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:47:34.375155 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-067d8664-362f-4ad2-9df5-8fdfd2d3d869 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 19 14:47:34.375155 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:47:34.375155 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 14:47:34.375155 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 14:47:34.375155 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 14:47:34.375155 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 14:47:34.375155 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 14:47:34.375155 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:47:34.375155 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 19 14:47:34.375155 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:47:34.375155 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 14:47:34.375155 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:47:34.375155 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:47:34.375155 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:47:34.375155 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:47:34.375155 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:47:34.375155 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:47:34.376322 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:47:34.376322 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:47:34.376322 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:47:34.376322 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:47:34.376322 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:47:34.376322 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:47:34.376322 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 14:47:34.376322 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 14:47:34.376322 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 14:47:34.376322 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 14:47:34.376322 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:47:34.376322 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:47:34.376322 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:47:34.376322 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:47:34.376322 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:47:34.376322 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:47:34.377188 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:47:34.377188 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:47:34.377188 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:47:34.377188 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:47:34.377188 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:47:34.377188 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:47:34.377188 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:47:34.377188 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:47:34.377188 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:47:34.377188 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:47:34.377188 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 14:47:34.377188 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:47:34.377188 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 19 14:47:34.377188 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:47:34.377188 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 654/1298] 10.222.0.72 () {56 vars in 1117 bytes} [Mon Sep 19 14:47:34 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:47:34.382358 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a70984-94ef-4bf6-8686-2341b5fc5b16 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:47:34.399987 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:47:34.478828 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a70984-94ef-4bf6-8686-2341b5fc5b16 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:47:34.511255 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d035f35-e81c-43bd-a27b-f8271c853f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:47:34.511783 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d035f35-e81c-43bd-a27b-f8271c853f6e None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:34.512058 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d035f35-e81c-43bd-a27b-f8271c853f6e None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:34.512350 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d035f35-e81c-43bd-a27b-f8271c853f6e None admin] PATH_INFO: `/v3/services` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:34.513022 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d035f35-e81c-43bd-a27b-f8271c853f6e None admin] RBAC: Adding query filter params (name=placement) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:47:34.513317 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d035f35-e81c-43bd-a27b-f8271c853f6e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:47:34.514660 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d035f35-e81c-43bd-a27b-f8271c853f6e None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:47:34.519562 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 645/1299] 10.222.0.72 () {56 vars in 1116 bytes} [Mon Sep 19 14:47:34 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:47:34.525897 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067d8664-362f-4ad2-9df5-8fdfd2d3d869 None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:47:34.558599 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:47:34.631177 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067d8664-362f-4ad2-9df5-8fdfd2d3d869 None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:47:34.663553 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e9973d-7782-4de8-a6bc-5d0afb98b297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:47:34.664149 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9973d-7782-4de8-a6bc-5d0afb98b297 None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:34.664455 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9973d-7782-4de8-a6bc-5d0afb98b297 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:34.664723 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9973d-7782-4de8-a6bc-5d0afb98b297 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:34.665400 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e9973d-7782-4de8-a6bc-5d0afb98b297 None admin] RBAC: Adding query filter params (interface=public, service_id=6e0b0f8db5954209ba333e767937834e, region_id=RegionOne) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:47:34.666287 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e9973d-7782-4de8-a6bc-5d0afb98b297 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:47:34.667608 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e9973d-7782-4de8-a6bc-5d0afb98b297 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:47:34.672420 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 655/1300] 10.222.0.72 () {56 vars in 1251 bytes} [Mon Sep 19 14:47:34 2022] GET /identity/v3/endpoints?service_id=6e0b0f8db5954209ba333e767937834e&interface=public®ion_id=RegionOne => generated 194 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:47:34.678086 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d035f35-e81c-43bd-a27b-f8271c853f6e None admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:47:34.757459 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:47:34.776573 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d035f35-e81c-43bd-a27b-f8271c853f6e None admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:47:34.809730 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7fa1f0-b0e4-4969-a2c5-dd7e6d5ed77c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:47:34.810333 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7fa1f0-b0e4-4969-a2c5-dd7e6d5ed77c None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:34.810617 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7fa1f0-b0e4-4969-a2c5-dd7e6d5ed77c None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:34.810890 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7fa1f0-b0e4-4969-a2c5-dd7e6d5ed77c None admin] PATH_INFO: `/v3/services` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:34.811491 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7fa1f0-b0e4-4969-a2c5-dd7e6d5ed77c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:47:34.812899 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7fa1f0-b0e4-4969-a2c5-dd7e6d5ed77c None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:47:34.819950 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 646/1301] 10.222.0.72 () {56 vars in 1087 bytes} [Mon Sep 19 14:47:34 2022] GET /identity/v3/services => generated 2191 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:47:36.955333 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e043b4-6dd7-4a4f-aa3d-e31108677720 None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:36.955787 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e043b4-6dd7-4a4f-aa3d-e31108677720 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:36.955903 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e043b4-6dd7-4a4f-aa3d-e31108677720 None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:36.957230 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 656/1302] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:47:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:47:36.962357 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb069f-d60b-4693-98fa-d38a52f67ae3 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:36.963337 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb069f-d60b-4693-98fa-d38a52f67ae3 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:36.963443 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb069f-d60b-4693-98fa-d38a52f67ae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:36.981718 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-f3eb069f-d60b-4693-98fa-d38a52f67ae3 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:47:36.982885 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-f3eb069f-d60b-4693-98fa-d38a52f67ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:47:37.046966 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 647/1303] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:47:36 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:47:37.312588 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e043b4-6dd7-4a4f-aa3d-e31108677720 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:47:37.404979 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:47:37.411728 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e043b4-6dd7-4a4f-aa3d-e31108677720 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:47:37.443943 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5255eaf-3301-48c3-baf9-332dda22d04b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:47:37.444580 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5255eaf-3301-48c3-baf9-332dda22d04b None admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:37.444857 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5255eaf-3301-48c3-baf9-332dda22d04b None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:37.445125 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5255eaf-3301-48c3-baf9-332dda22d04b None admin] PATH_INFO: `/v3/services/placement` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:37.445692 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5255eaf-3301-48c3-baf9-332dda22d04b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:47:37.447677 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5255eaf-3301-48c3-baf9-332dda22d04b None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:47:37.456193 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application [None req-d5255eaf-3301-48c3-baf9-332dda22d04b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 19 14:47:37.456193 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:47:37.456193 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 14:47:37.456193 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 14:47:37.456193 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 14:47:37.456193 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 14:47:37.456193 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 14:47:37.456193 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:47:37.456193 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 19 14:47:37.456193 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:47:37.456193 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 14:47:37.456193 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:47:37.456193 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:47:37.456193 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:47:37.456193 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:47:37.456193 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:47:37.456193 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:47:37.457370 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:47:37.457370 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:47:37.457370 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:47:37.457370 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:47:37.457370 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:47:37.457370 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:47:37.457370 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 14:47:37.457370 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 14:47:37.457370 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 14:47:37.457370 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 14:47:37.457370 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:47:37.457370 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:47:37.457370 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:47:37.457370 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:47:37.457370 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:47:37.457370 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:47:37.458402 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:47:37.458402 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application with Lock( Sep 19 14:47:37.458402 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:47:37.458402 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:47:37.458402 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:47:37.458402 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:47:37.458402 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:47:37.458402 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:47:37.458402 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:47:37.458402 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:47:37.458402 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 14:47:37.458402 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:47:37.458402 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 19 14:47:37.458402 dv-cinder-756711-11-smb devstack@keystone.service[81452]: ERROR keystone.server.flask.application Sep 19 14:47:37.458402 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 657/1304] 10.222.0.72 () {56 vars in 1117 bytes} [Mon Sep 19 14:47:37 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:47:37.463820 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eb069f-d60b-4693-98fa-d38a52f67ae3 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:47:37.537096 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:47:37.559802 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eb069f-d60b-4693-98fa-d38a52f67ae3 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:47:37.595221 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c083fba-ce6b-4ed7-b3b5-ef6165157252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:47:37.595792 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c083fba-ce6b-4ed7-b3b5-ef6165157252 None admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:37.596109 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c083fba-ce6b-4ed7-b3b5-ef6165157252 None admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:37.596445 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c083fba-ce6b-4ed7-b3b5-ef6165157252 None admin] PATH_INFO: `/v3/services` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:37.597103 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c083fba-ce6b-4ed7-b3b5-ef6165157252 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:47:37.597442 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c083fba-ce6b-4ed7-b3b5-ef6165157252 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:47:37.598837 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c083fba-ce6b-4ed7-b3b5-ef6165157252 None admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:47:37.604153 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 648/1305] 10.222.0.72 () {56 vars in 1116 bytes} [Mon Sep 19 14:47:37 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:47:37.609990 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5255eaf-3301-48c3-baf9-332dda22d04b None admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:47:37.708948 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5255eaf-3301-48c3-baf9-332dda22d04b None admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:47:37.741218 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a097a645-0118-4065-8456-21c531b94679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:47:37.741807 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a097a645-0118-4065-8456-21c531b94679 None admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:37.742088 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a097a645-0118-4065-8456-21c531b94679 None admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:37.742361 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a097a645-0118-4065-8456-21c531b94679 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:37.743020 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a097a645-0118-4065-8456-21c531b94679 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:47:37.745008 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a097a645-0118-4065-8456-21c531b94679 None admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:47:37.764102 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 658/1306] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Sep 19 14:47:37 2022] POST /identity/v3/endpoints => generated 331 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 14:47:47.601610 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=30 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:47:47.759939 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:48:42.017121 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b866c7-1b6e-4c8d-9ae1-871536805542 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:42.018102 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b866c7-1b6e-4c8d-9ae1-871536805542 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:42.018564 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b866c7-1b6e-4c8d-9ae1-871536805542 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:42.026309 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41432dad-b32b-46bb-bd52-ae65fa75c992 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:42.027192 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41432dad-b32b-46bb-bd52-ae65fa75c992 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:42.027632 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41432dad-b32b-46bb-bd52-ae65fa75c992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:42.032577 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 649/1307] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:48:42 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:48:42.142424 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-41432dad-b32b-46bb-bd52-ae65fa75c992 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:48:42.143967 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-41432dad-b32b-46bb-bd52-ae65fa75c992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:48:42.265906 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 659/1308] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:48:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:48:42.578442 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42beadff-aea3-4c78-812a-51c45fc76ee6 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:42.578771 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42beadff-aea3-4c78-812a-51c45fc76ee6 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:42.579098 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42beadff-aea3-4c78-812a-51c45fc76ee6 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:42.580910 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 650/1309] 10.222.0.72 () {54 vars in 963 bytes} [Mon Sep 19 14:48:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:48:42.587273 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0dad13-0164-44ff-8fa4-a56c8bfe8d18 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:42.587690 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0dad13-0164-44ff-8fa4-a56c8bfe8d18 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:42.587971 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0dad13-0164-44ff-8fa4-a56c8bfe8d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:42.677374 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-1e0dad13-0164-44ff-8fa4-a56c8bfe8d18 None None] MFA Rules not processed for user `f4c2b78646374cb79ded4b7b59ba49c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:48:42.678597 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-1e0dad13-0164-44ff-8fa4-a56c8bfe8d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:48:42.702287 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:48:42.771328 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 660/1310] 10.222.0.72 () {58 vars in 1060 bytes} [Mon Sep 19 14:48:42 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:48:42.780921 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42beadff-aea3-4c78-812a-51c45fc76ee6 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:48:42.782648 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-42beadff-aea3-4c78-812a-51c45fc76ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:48:42.909518 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42beadff-aea3-4c78-812a-51c45fc76ee6 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:48:42.991787 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f7c871-4cad-42f8-b30d-17c9a8af4341 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c2b78646374cb79ded4b7b59ba49c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:48:42.993409 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f7c871-4cad-42f8-b30d-17c9a8af4341 service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:42.993870 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f7c871-4cad-42f8-b30d-17c9a8af4341 service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:42.994286 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f7c871-4cad-42f8-b30d-17c9a8af4341 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:42.996062 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-d9f7c871-4cad-42f8-b30d-17c9a8af4341 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:48:43.058044 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:48:43.121034 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f7c871-4cad-42f8-b30d-17c9a8af4341 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:48:43.123371 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f7c871-4cad-42f8-b30d-17c9a8af4341 service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:48:43.149625 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 651/1311] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:48:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:48:45.654778 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025fcf88-97d3-411f-bac6-503239bb66fd None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:45.655298 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025fcf88-97d3-411f-bac6-503239bb66fd None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:45.655298 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025fcf88-97d3-411f-bac6-503239bb66fd None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:45.656794 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 661/1312] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:48:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:48:45.662049 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e10a9-cb56-4841-98e3-8b383d06d02f None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:45.662466 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e10a9-cb56-4841-98e3-8b383d06d02f None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:45.662586 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e10a9-cb56-4841-98e3-8b383d06d02f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:45.733997 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-124e10a9-cb56-4841-98e3-8b383d06d02f None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:48:45.735180 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-124e10a9-cb56-4841-98e3-8b383d06d02f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:48:45.829936 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 652/1313] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:48:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:48:46.120693 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025fcf88-97d3-411f-bac6-503239bb66fd None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:48:46.122236 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-025fcf88-97d3-411f-bac6-503239bb66fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:48:46.224843 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025fcf88-97d3-411f-bac6-503239bb66fd None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:48:46.294733 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:48:46.297212 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8630a73d-4f27-4e01-b388-b16cab603891 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c2b78646374cb79ded4b7b59ba49c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:48:46.297916 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8630a73d-4f27-4e01-b388-b16cab603891 service neutron] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:46.298424 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8630a73d-4f27-4e01-b388-b16cab603891 service neutron] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:46.298718 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8630a73d-4f27-4e01-b388-b16cab603891 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:46.300700 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-8630a73d-4f27-4e01-b388-b16cab603891 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:48:46.406572 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8630a73d-4f27-4e01-b388-b16cab603891 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:48:46.407982 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8630a73d-4f27-4e01-b388-b16cab603891 service neutron] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:48:46.426022 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 662/1314] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:48:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:48:48.849662 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d414db-8def-4c4d-9474-48867b535e3e None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:48.850199 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d414db-8def-4c4d-9474-48867b535e3e None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:48.850199 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d414db-8def-4c4d-9474-48867b535e3e None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:48.851560 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 653/1315] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:48:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:48:48.857000 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb168f7-88e9-4b04-8f65-e55c78f87484 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:48.857397 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb168f7-88e9-4b04-8f65-e55c78f87484 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:48.857547 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb168f7-88e9-4b04-8f65-e55c78f87484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:48.923664 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-adb168f7-88e9-4b04-8f65-e55c78f87484 None None] MFA Rules not processed for user `2d21d93228b342d49931ee559e5dfa9c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:48:48.924916 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-adb168f7-88e9-4b04-8f65-e55c78f87484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:48:48.977345 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:48:49.022072 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 663/1316] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:48:48 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:48:49.310541 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d414db-8def-4c4d-9474-48867b535e3e None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:48:49.312074 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-68d414db-8def-4c4d-9474-48867b535e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:48:49.322579 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:48:49.416731 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d414db-8def-4c4d-9474-48867b535e3e None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:48:49.488215 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da58735-9b83-40f5-831f-2ec3ba884dab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c2b78646374cb79ded4b7b59ba49c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:48:49.488826 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da58735-9b83-40f5-831f-2ec3ba884dab service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:49.489105 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da58735-9b83-40f5-831f-2ec3ba884dab service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:49.489370 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da58735-9b83-40f5-831f-2ec3ba884dab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:49.490938 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-9da58735-9b83-40f5-831f-2ec3ba884dab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:48:49.550840 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:48:49.598404 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da58735-9b83-40f5-831f-2ec3ba884dab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:48:49.599754 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da58735-9b83-40f5-831f-2ec3ba884dab service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:48:49.617214 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 654/1317] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:48:49 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:48:52.314674 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032c5539-e2b3-471d-897f-0221a7e66a82 None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:52.315489 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032c5539-e2b3-471d-897f-0221a7e66a82 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:52.315489 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032c5539-e2b3-471d-897f-0221a7e66a82 None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:52.316875 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 664/1318] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:48:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:48:52.322550 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0c36e6-98a4-4f6e-870f-cc65f55ecf82 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:52.322930 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0c36e6-98a4-4f6e-870f-cc65f55ecf82 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:52.323097 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0c36e6-98a4-4f6e-870f-cc65f55ecf82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:52.387618 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-8d0c36e6-98a4-4f6e-870f-cc65f55ecf82 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:48:52.388836 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-8d0c36e6-98a4-4f6e-870f-cc65f55ecf82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:48:52.483259 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 655/1319] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:48:52 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:48:52.772720 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032c5539-e2b3-471d-897f-0221a7e66a82 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:48:52.774863 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-032c5539-e2b3-471d-897f-0221a7e66a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:48:52.876125 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032c5539-e2b3-471d-897f-0221a7e66a82 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:48:52.950723 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d64d6e-364f-4b47-87a4-265597f01011 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c2b78646374cb79ded4b7b59ba49c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:48:52.951326 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d64d6e-364f-4b47-87a4-265597f01011 service neutron] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:52.951605 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d64d6e-364f-4b47-87a4-265597f01011 service neutron] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:52.951874 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d64d6e-364f-4b47-87a4-265597f01011 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:52.953521 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-a1d64d6e-364f-4b47-87a4-265597f01011 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:48:52.960424 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:48:53.062061 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d64d6e-364f-4b47-87a4-265597f01011 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:48:53.063415 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d64d6e-364f-4b47-87a4-265597f01011 service neutron] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:48:53.081407 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 665/1320] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:48:52 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:48:55.889936 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5794c44-ecc1-4725-a3cb-464e8535bf73 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:55.890471 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5794c44-ecc1-4725-a3cb-464e8535bf73 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:55.890471 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5794c44-ecc1-4725-a3cb-464e8535bf73 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:55.892404 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 656/1321] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:48:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:48:55.897429 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b33ae6-59ba-4c63-9de7-26084079c12d None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:55.897816 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b33ae6-59ba-4c63-9de7-26084079c12d None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:55.898010 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b33ae6-59ba-4c63-9de7-26084079c12d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:55.973278 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-40b33ae6-59ba-4c63-9de7-26084079c12d None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:48:55.974538 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-40b33ae6-59ba-4c63-9de7-26084079c12d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:48:56.038351 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:48:56.081650 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 666/1322] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:48:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:48:56.379316 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a6175-0601-4dc4-8566-d2bd71504fd1 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:56.379716 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a6175-0601-4dc4-8566-d2bd71504fd1 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:56.380061 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a6175-0601-4dc4-8566-d2bd71504fd1 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:56.381510 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 657/1323] 10.222.0.72 () {54 vars in 963 bytes} [Mon Sep 19 14:48:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:48:56.388115 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48556c1-0061-47e7-9986-762ef32d0f34 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:56.388503 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48556c1-0061-47e7-9986-762ef32d0f34 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:56.388855 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48556c1-0061-47e7-9986-762ef32d0f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:56.466621 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-e48556c1-0061-47e7-9986-762ef32d0f34 None None] MFA Rules not processed for user `f4c2b78646374cb79ded4b7b59ba49c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:48:56.467837 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-e48556c1-0061-47e7-9986-762ef32d0f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:48:56.543888 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 667/1324] 10.222.0.72 () {58 vars in 1060 bytes} [Mon Sep 19 14:48:56 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 14:48:56.552941 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94a6175-0601-4dc4-8566-d2bd71504fd1 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:48:56.554502 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-b94a6175-0601-4dc4-8566-d2bd71504fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:48:56.575690 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:48:56.661663 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94a6175-0601-4dc4-8566-d2bd71504fd1 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:48:56.735409 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290528ad-b702-4814-916c-2254f1ee5b65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c2b78646374cb79ded4b7b59ba49c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:48:56.736002 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290528ad-b702-4814-916c-2254f1ee5b65 service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:56.736277 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290528ad-b702-4814-916c-2254f1ee5b65 service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:56.736575 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290528ad-b702-4814-916c-2254f1ee5b65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:56.738163 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-290528ad-b702-4814-916c-2254f1ee5b65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:48:56.808013 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:48:56.845243 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290528ad-b702-4814-916c-2254f1ee5b65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:48:56.846666 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290528ad-b702-4814-916c-2254f1ee5b65 service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:48:56.864566 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 658/1325] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:48:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:48:59.314811 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b4a30-8acd-49d4-bbd8-adf327232816 None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:59.315572 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b4a30-8acd-49d4-bbd8-adf327232816 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:59.315572 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b4a30-8acd-49d4-bbd8-adf327232816 None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:59.317023 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 668/1326] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:48:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:48:59.322254 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030cd6d3-aab9-406f-a279-cfded6515282 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:59.322656 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030cd6d3-aab9-406f-a279-cfded6515282 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:59.322937 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030cd6d3-aab9-406f-a279-cfded6515282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:59.390492 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-030cd6d3-aab9-406f-a279-cfded6515282 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:48:59.391688 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-030cd6d3-aab9-406f-a279-cfded6515282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:48:59.489704 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 659/1327] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:48:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 14:48:59.782024 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116b4a30-8acd-49d4-bbd8-adf327232816 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:48:59.783662 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-116b4a30-8acd-49d4-bbd8-adf327232816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:48:59.870777 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:48:59.935647 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116b4a30-8acd-49d4-bbd8-adf327232816 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:00.024486 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd706d2-0766-4f3e-ba2a-1642a468a21c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c2b78646374cb79ded4b7b59ba49c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:00.025103 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd706d2-0766-4f3e-ba2a-1642a468a21c service neutron] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:00.025389 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd706d2-0766-4f3e-ba2a-1642a468a21c service neutron] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:00.025663 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd706d2-0766-4f3e-ba2a-1642a468a21c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:00.027381 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-afd706d2-0766-4f3e-ba2a-1642a468a21c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:00.155151 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:00.157891 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd706d2-0766-4f3e-ba2a-1642a468a21c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:00.161250 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd706d2-0766-4f3e-ba2a-1642a468a21c service neutron] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:00.183965 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 669/1328] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:48:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:49:02.453390 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1820b1e-4479-4271-861d-d973479b051f None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:02.453904 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1820b1e-4479-4271-861d-d973479b051f None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:02.453904 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1820b1e-4479-4271-861d-d973479b051f None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:02.455260 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 660/1329] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:49:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:49:02.460743 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2971939e-701d-4130-b507-7bac261b01ed None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:02.461265 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2971939e-701d-4130-b507-7bac261b01ed None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:02.461862 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2971939e-701d-4130-b507-7bac261b01ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:02.531015 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-2971939e-701d-4130-b507-7bac261b01ed None None] MFA Rules not processed for user `2d21d93228b342d49931ee559e5dfa9c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:49:02.532239 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-2971939e-701d-4130-b507-7bac261b01ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:02.631134 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 670/1330] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:49:02 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:49:02.909784 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1820b1e-4479-4271-861d-d973479b051f None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:02.911377 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-a1820b1e-4479-4271-861d-d973479b051f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:02.943213 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:03.015951 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1820b1e-4479-4271-861d-d973479b051f None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:03.095277 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903ce104-bdd5-4325-839f-da83daaa57fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c2b78646374cb79ded4b7b59ba49c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:03.095884 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903ce104-bdd5-4325-839f-da83daaa57fa service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:03.096170 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903ce104-bdd5-4325-839f-da83daaa57fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:03.096478 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903ce104-bdd5-4325-839f-da83daaa57fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:03.098088 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-903ce104-bdd5-4325-839f-da83daaa57fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:03.179257 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:03.214291 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903ce104-bdd5-4325-839f-da83daaa57fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:03.215741 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903ce104-bdd5-4325-839f-da83daaa57fa service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:03.234525 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 661/1331] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:49:02 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:49:05.782587 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff21163-2d91-4f43-ba4e-8c45ba1861e8 None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:05.783149 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff21163-2d91-4f43-ba4e-8c45ba1861e8 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:05.783149 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff21163-2d91-4f43-ba4e-8c45ba1861e8 None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:05.784473 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 671/1332] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:49:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:49:05.789683 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ea8989-59f7-4a78-9acd-4b2b487a658c None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:05.790199 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ea8989-59f7-4a78-9acd-4b2b487a658c None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:05.790304 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ea8989-59f7-4a78-9acd-4b2b487a658c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:05.855972 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-b9ea8989-59f7-4a78-9acd-4b2b487a658c None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:49:05.857227 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-b9ea8989-59f7-4a78-9acd-4b2b487a658c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:05.956293 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 662/1333] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:49:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:49:06.244967 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff21163-2d91-4f43-ba4e-8c45ba1861e8 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:06.246527 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-dff21163-2d91-4f43-ba4e-8c45ba1861e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:06.314928 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:06.348137 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff21163-2d91-4f43-ba4e-8c45ba1861e8 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:06.419647 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7557ddf8-ede2-4ee3-8c22-c8d9d79a2939 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c2b78646374cb79ded4b7b59ba49c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:06.420239 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7557ddf8-ede2-4ee3-8c22-c8d9d79a2939 service neutron] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:06.420536 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7557ddf8-ede2-4ee3-8c22-c8d9d79a2939 service neutron] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:06.420802 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7557ddf8-ede2-4ee3-8c22-c8d9d79a2939 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:06.422370 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-7557ddf8-ede2-4ee3-8c22-c8d9d79a2939 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:06.529452 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7557ddf8-ede2-4ee3-8c22-c8d9d79a2939 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:06.530800 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7557ddf8-ede2-4ee3-8c22-c8d9d79a2939 service neutron] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:06.540504 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:06.549837 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 672/1334] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:49:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:49:08.741821 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c776f60d-5af0-47ab-922c-d7dd20ab5116 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:08.742347 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c776f60d-5af0-47ab-922c-d7dd20ab5116 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:08.742347 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c776f60d-5af0-47ab-922c-d7dd20ab5116 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:08.744382 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 663/1335] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:49:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:49:08.749883 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc8a850-cf78-4992-94fb-d8c049a249bc None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:08.750302 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc8a850-cf78-4992-94fb-d8c049a249bc None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:08.750470 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc8a850-cf78-4992-94fb-d8c049a249bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:08.817187 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-1bc8a850-cf78-4992-94fb-d8c049a249bc None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:49:08.818355 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-1bc8a850-cf78-4992-94fb-d8c049a249bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:08.913614 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 673/1336] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:49:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:49:09.202298 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c776f60d-5af0-47ab-922c-d7dd20ab5116 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:09.203866 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-c776f60d-5af0-47ab-922c-d7dd20ab5116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:09.243872 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:09.308634 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c776f60d-5af0-47ab-922c-d7dd20ab5116 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:09.383758 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da5c82b-0789-4530-8128-5eda037af711 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c2b78646374cb79ded4b7b59ba49c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:09.384454 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da5c82b-0789-4530-8128-5eda037af711 service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:09.384772 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da5c82b-0789-4530-8128-5eda037af711 service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:09.385073 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da5c82b-0789-4530-8128-5eda037af711 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:09.386708 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-9da5c82b-0789-4530-8128-5eda037af711 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:09.470806 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:09.496938 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da5c82b-0789-4530-8128-5eda037af711 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:09.498406 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da5c82b-0789-4530-8128-5eda037af711 service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:09.516806 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 664/1337] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:49:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:49:11.969687 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0146c522-7be7-4fd1-8bc8-ad3e5107a214 None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:11.970246 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0146c522-7be7-4fd1-8bc8-ad3e5107a214 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:11.970246 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0146c522-7be7-4fd1-8bc8-ad3e5107a214 None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:11.971574 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 674/1338] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:49:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:49:11.977124 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4b9342-2cdf-42fd-9a96-91580ea89487 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:11.977516 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4b9342-2cdf-42fd-9a96-91580ea89487 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:11.977684 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4b9342-2cdf-42fd-9a96-91580ea89487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:12.045804 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-7a4b9342-2cdf-42fd-9a96-91580ea89487 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:49:12.047030 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-7a4b9342-2cdf-42fd-9a96-91580ea89487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:12.142908 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 665/1339] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:49:11 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:49:12.427719 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0146c522-7be7-4fd1-8bc8-ad3e5107a214 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:12.429312 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-0146c522-7be7-4fd1-8bc8-ad3e5107a214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:12.504074 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:12.531816 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0146c522-7be7-4fd1-8bc8-ad3e5107a214 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:12.604599 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c73d13f-271f-4f70-9f58-e6d1d9c3cf54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c2b78646374cb79ded4b7b59ba49c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:12.605198 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c73d13f-271f-4f70-9f58-e6d1d9c3cf54 service neutron] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:12.605475 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c73d13f-271f-4f70-9f58-e6d1d9c3cf54 service neutron] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:12.605744 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c73d13f-271f-4f70-9f58-e6d1d9c3cf54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:12.607347 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-0c73d13f-271f-4f70-9f58-e6d1d9c3cf54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:12.715515 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c73d13f-271f-4f70-9f58-e6d1d9c3cf54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:12.716980 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c73d13f-271f-4f70-9f58-e6d1d9c3cf54 service neutron] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:12.734619 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 675/1340] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:49:12 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:49:16.834210 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09bb6d7-04ea-4a32-a076-82931ff5b291 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:16.834731 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09bb6d7-04ea-4a32-a076-82931ff5b291 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:16.834731 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09bb6d7-04ea-4a32-a076-82931ff5b291 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:16.836235 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 666/1341] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:49:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:49:16.841758 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ba1d1-bf71-43e5-88f0-ed782a725edd None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:16.842224 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ba1d1-bf71-43e5-88f0-ed782a725edd None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:16.842336 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ba1d1-bf71-43e5-88f0-ed782a725edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:16.848583 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:16.918587 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-7e6ba1d1-bf71-43e5-88f0-ed782a725edd None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:49:16.920497 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-7e6ba1d1-bf71-43e5-88f0-ed782a725edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:17.020343 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 676/1342] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:49:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:49:17.309904 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09bb6d7-04ea-4a32-a076-82931ff5b291 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:17.311474 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-e09bb6d7-04ea-4a32-a076-82931ff5b291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:17.362541 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:17.417871 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09bb6d7-04ea-4a32-a076-82931ff5b291 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:17.501344 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e68f469-1fd2-4a0e-8150-016d913564b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c2b78646374cb79ded4b7b59ba49c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:17.501949 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e68f469-1fd2-4a0e-8150-016d913564b7 service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:17.502233 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e68f469-1fd2-4a0e-8150-016d913564b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:17.502508 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e68f469-1fd2-4a0e-8150-016d913564b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:17.504104 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-4e68f469-1fd2-4a0e-8150-016d913564b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:17.598350 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:17.615551 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e68f469-1fd2-4a0e-8150-016d913564b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:17.617074 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e68f469-1fd2-4a0e-8150-016d913564b7 service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:17.635170 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 667/1343] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:49:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:49:20.458762 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e8341b-29bc-4de7-bb34-c9108d11e1e4 None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:20.459283 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e8341b-29bc-4de7-bb34-c9108d11e1e4 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:20.459283 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e8341b-29bc-4de7-bb34-c9108d11e1e4 None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:20.460661 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 677/1344] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:49:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:49:20.466679 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491d761a-090a-443a-8a3d-24e490e75ca4 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:20.467104 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491d761a-090a-443a-8a3d-24e490e75ca4 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:20.467211 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491d761a-090a-443a-8a3d-24e490e75ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:20.533406 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-491d761a-090a-443a-8a3d-24e490e75ca4 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:49:20.534611 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-491d761a-090a-443a-8a3d-24e490e75ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:20.644572 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 668/1345] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:49:20 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:49:20.935171 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e8341b-29bc-4de7-bb34-c9108d11e1e4 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:20.936851 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-86e8341b-29bc-4de7-bb34-c9108d11e1e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:21.034113 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:21.051706 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e8341b-29bc-4de7-bb34-c9108d11e1e4 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:21.128774 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2bd64d-3e94-4562-8cb9-cf569a161b5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c2b78646374cb79ded4b7b59ba49c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:21.129292 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2bd64d-3e94-4562-8cb9-cf569a161b5d service neutron] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:21.129565 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2bd64d-3e94-4562-8cb9-cf569a161b5d service neutron] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:21.129834 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2bd64d-3e94-4562-8cb9-cf569a161b5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:21.131412 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-5a2bd64d-3e94-4562-8cb9-cf569a161b5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:21.247067 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2bd64d-3e94-4562-8cb9-cf569a161b5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:21.248540 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2bd64d-3e94-4562-8cb9-cf569a161b5d service neutron] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:21.267048 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 678/1346] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:49:20 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:49:25.408984 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabf228e-b927-4c55-a873-0b56576f56c0 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:25.409505 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabf228e-b927-4c55-a873-0b56576f56c0 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:25.409505 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabf228e-b927-4c55-a873-0b56576f56c0 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:25.410851 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 669/1347] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:49:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:49:25.417328 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe74550-871c-45b3-96af-c40415ef9ea4 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:25.417765 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe74550-871c-45b3-96af-c40415ef9ea4 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:25.417861 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe74550-871c-45b3-96af-c40415ef9ea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:25.434128 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:25.490529 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-dfe74550-871c-45b3-96af-c40415ef9ea4 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:49:25.491726 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-dfe74550-871c-45b3-96af-c40415ef9ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:25.608449 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 679/1348] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:49:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:49:25.896762 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabf228e-b927-4c55-a873-0b56576f56c0 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:25.898288 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-cabf228e-b927-4c55-a873-0b56576f56c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:25.956847 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:26.003482 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabf228e-b927-4c55-a873-0b56576f56c0 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:26.076528 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330b1355-2227-4d13-ba2e-191f40017554 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c2b78646374cb79ded4b7b59ba49c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:26.077125 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b1355-2227-4d13-ba2e-191f40017554 service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:26.077403 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b1355-2227-4d13-ba2e-191f40017554 service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:26.077671 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b1355-2227-4d13-ba2e-191f40017554 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:26.079264 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-330b1355-2227-4d13-ba2e-191f40017554 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:26.183054 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:26.187071 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330b1355-2227-4d13-ba2e-191f40017554 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:26.188534 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330b1355-2227-4d13-ba2e-191f40017554 service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:26.206902 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 670/1349] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:49:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:49:31.098832 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ea3c2-ab6f-4c07-b9db-f1096818c6ab None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:31.099326 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ea3c2-ab6f-4c07-b9db-f1096818c6ab None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:31.099410 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ea3c2-ab6f-4c07-b9db-f1096818c6ab None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:31.101725 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 680/1350] 10.222.0.72 () {54 vars in 921 bytes} [Mon Sep 19 14:49:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:49:31.108392 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e929723-b9ac-4f04-8c4e-34e6ed439f60 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:31.108392 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e929723-b9ac-4f04-8c4e-34e6ed439f60 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:31.108392 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e929723-b9ac-4f04-8c4e-34e6ed439f60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:31.214485 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-8e929723-b9ac-4f04-8c4e-34e6ed439f60 None None] MFA Rules not processed for user `51e7a0148db8462b8ba24bac6dd15298`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:49:31.216063 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-8e929723-b9ac-4f04-8c4e-34e6ed439f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:31.367551 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 671/1351] 10.222.0.72 () {58 vars in 1018 bytes} [Mon Sep 19 14:49:31 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:49:35.556916 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08358f73-9e0a-4275-95bf-9eab1262b62d None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:35.557433 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08358f73-9e0a-4275-95bf-9eab1262b62d None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:35.557744 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08358f73-9e0a-4275-95bf-9eab1262b62d None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:35.559388 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 681/1352] 10.222.0.72 () {54 vars in 921 bytes} [Mon Sep 19 14:49:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:49:35.564589 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d2ba53-fd66-4ce9-9362-3331e2777e43 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:35.565001 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d2ba53-fd66-4ce9-9362-3331e2777e43 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:35.565148 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d2ba53-fd66-4ce9-9362-3331e2777e43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:35.608906 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=59 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:35.624497 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:35.650119 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-90d2ba53-fd66-4ce9-9362-3331e2777e43 None None] MFA Rules not processed for user `51e7a0148db8462b8ba24bac6dd15298`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:49:35.651329 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-90d2ba53-fd66-4ce9-9362-3331e2777e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:35.764795 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 672/1353] 10.222.0.72 () {58 vars in 1018 bytes} [Mon Sep 19 14:49:35 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:49:37.126698 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bb8b2f-8804-4fef-819d-dc4aed097859 None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:37.127258 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bb8b2f-8804-4fef-819d-dc4aed097859 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:37.127352 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bb8b2f-8804-4fef-819d-dc4aed097859 None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:37.128807 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 682/1354] 10.222.0.72 () {54 vars in 921 bytes} [Mon Sep 19 14:49:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:49:37.134061 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2758c164-b8dc-4a64-8d62-f10eabb7f34f None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:37.134609 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2758c164-b8dc-4a64-8d62-f10eabb7f34f None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:37.134609 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2758c164-b8dc-4a64-8d62-f10eabb7f34f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:37.214010 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-2758c164-b8dc-4a64-8d62-f10eabb7f34f None None] MFA Rules not processed for user `51e7a0148db8462b8ba24bac6dd15298`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:49:37.215271 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-2758c164-b8dc-4a64-8d62-f10eabb7f34f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:37.260440 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:37.326932 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 673/1355] 10.222.0.72 () {58 vars in 1018 bytes} [Mon Sep 19 14:49:37 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:49:41.042177 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a4980a-c66d-4668-9d1c-27782969d4e6 None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:41.043117 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a4980a-c66d-4668-9d1c-27782969d4e6 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:41.043841 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a4980a-c66d-4668-9d1c-27782969d4e6 None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:41.046667 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 683/1356] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:49:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:49:41.051862 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1540178-2da0-48cc-8c42-ddb0f1874830 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:41.052488 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1540178-2da0-48cc-8c42-ddb0f1874830 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:41.054572 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1540178-2da0-48cc-8c42-ddb0f1874830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:41.150887 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-d1540178-2da0-48cc-8c42-ddb0f1874830 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:49:41.152420 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-d1540178-2da0-48cc-8c42-ddb0f1874830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:41.272368 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 674/1357] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:49:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:49:41.602558 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625bea1a-c4fc-413b-bb89-e2b00c384edf None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:41.602894 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625bea1a-c4fc-413b-bb89-e2b00c384edf None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:41.603512 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625bea1a-c4fc-413b-bb89-e2b00c384edf None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:41.605050 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 684/1358] 10.222.0.72 () {54 vars in 965 bytes} [Mon Sep 19 14:49:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:49:41.612048 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b6d3cd-cd70-45cd-8027-93a659b731bd None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:41.612355 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b6d3cd-cd70-45cd-8027-93a659b731bd None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:41.612643 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b6d3cd-cd70-45cd-8027-93a659b731bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:41.630692 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:41.696921 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-d8b6d3cd-cd70-45cd-8027-93a659b731bd None None] MFA Rules not processed for user `055439dc35e946f4a82535c684f9b60d`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:49:41.698313 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-d8b6d3cd-cd70-45cd-8027-93a659b731bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:41.849342 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 675/1359] 10.222.0.72 () {58 vars in 1062 bytes} [Mon Sep 19 14:49:41 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:49:41.858279 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625bea1a-c4fc-413b-bb89-e2b00c384edf None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:41.860816 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-625bea1a-c4fc-413b-bb89-e2b00c384edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:42.039483 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625bea1a-c4fc-413b-bb89-e2b00c384edf None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:42.124965 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:42.170027 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b520c4b-958e-4c9f-85cb-443d219cd23f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055439dc35e946f4a82535c684f9b60d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:42.170626 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b520c4b-958e-4c9f-85cb-443d219cd23f service nova] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:42.170899 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b520c4b-958e-4c9f-85cb-443d219cd23f service nova] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:42.171169 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b520c4b-958e-4c9f-85cb-443d219cd23f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:42.172792 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-1b520c4b-958e-4c9f-85cb-443d219cd23f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:42.274196 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b520c4b-958e-4c9f-85cb-443d219cd23f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:42.276640 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b520c4b-958e-4c9f-85cb-443d219cd23f service nova] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:42.296199 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 685/1360] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:49:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:49:44.781357 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10a2d32-ead9-4baa-a573-e8bb9d79af29 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:44.781357 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10a2d32-ead9-4baa-a573-e8bb9d79af29 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:44.783573 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10a2d32-ead9-4baa-a573-e8bb9d79af29 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:44.787550 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 676/1361] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:49:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:49:44.788292 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca55df-025d-47c6-a946-52813115ef87 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:44.788793 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca55df-025d-47c6-a946-52813115ef87 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:44.788793 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca55df-025d-47c6-a946-52813115ef87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:44.875188 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-97ca55df-025d-47c6-a946-52813115ef87 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:49:44.876545 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-97ca55df-025d-47c6-a946-52813115ef87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:44.923190 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:44.987130 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 686/1362] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:49:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:49:45.277367 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10a2d32-ead9-4baa-a573-e8bb9d79af29 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:45.278925 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-d10a2d32-ead9-4baa-a573-e8bb9d79af29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:45.350660 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:45.466213 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10a2d32-ead9-4baa-a573-e8bb9d79af29 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:45.598696 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c37b6af-109d-4234-9fb2-bc7752c617d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055439dc35e946f4a82535c684f9b60d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:45.599310 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c37b6af-109d-4234-9fb2-bc7752c617d9 service nova] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:45.599590 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c37b6af-109d-4234-9fb2-bc7752c617d9 service nova] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:45.599863 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c37b6af-109d-4234-9fb2-bc7752c617d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:45.601506 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-6c37b6af-109d-4234-9fb2-bc7752c617d9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:45.625209 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:45.696180 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c37b6af-109d-4234-9fb2-bc7752c617d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:45.698591 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c37b6af-109d-4234-9fb2-bc7752c617d9 service nova] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:45.717684 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 677/1363] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:49:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:49:48.221819 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72113306-f825-41a4-a280-c0630b682a47 None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:48.222416 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72113306-f825-41a4-a280-c0630b682a47 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:48.222416 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72113306-f825-41a4-a280-c0630b682a47 None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:48.223860 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 687/1364] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:49:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:49:48.229926 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed08a44d-7acd-4e53-9f37-cf10e7055db1 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:48.230351 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed08a44d-7acd-4e53-9f37-cf10e7055db1 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:48.230536 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed08a44d-7acd-4e53-9f37-cf10e7055db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:48.299925 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-ed08a44d-7acd-4e53-9f37-cf10e7055db1 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:49:48.301140 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-ed08a44d-7acd-4e53-9f37-cf10e7055db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:48.406208 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:48.409760 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 678/1365] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:49:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:49:48.709716 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4947d2b-012b-4155-a24a-563128558210 None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:48.711111 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4947d2b-012b-4155-a24a-563128558210 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:48.711470 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4947d2b-012b-4155-a24a-563128558210 None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:48.713492 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 688/1366] 10.222.0.72 () {54 vars in 965 bytes} [Mon Sep 19 14:49:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:49:48.719404 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd79567-ccfe-4aa6-9558-c69ba27bc6f2 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:48.719821 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd79567-ccfe-4aa6-9558-c69ba27bc6f2 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:48.720201 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd79567-ccfe-4aa6-9558-c69ba27bc6f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:48.801784 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-acd79567-ccfe-4aa6-9558-c69ba27bc6f2 None None] MFA Rules not processed for user `055439dc35e946f4a82535c684f9b60d`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:49:48.802995 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-acd79567-ccfe-4aa6-9558-c69ba27bc6f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:48.939461 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 679/1367] 10.222.0.72 () {58 vars in 1062 bytes} [Mon Sep 19 14:49:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 14:49:48.948366 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4947d2b-012b-4155-a24a-563128558210 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:48.949975 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-a4947d2b-012b-4155-a24a-563128558210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:49.110192 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4947d2b-012b-4155-a24a-563128558210 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:49.131134 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:49.240571 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8381615d-c78a-492c-a79d-94087fdb8dc0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055439dc35e946f4a82535c684f9b60d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:49.241893 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8381615d-c78a-492c-a79d-94087fdb8dc0 service nova] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:49.242167 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8381615d-c78a-492c-a79d-94087fdb8dc0 service nova] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:49.242431 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8381615d-c78a-492c-a79d-94087fdb8dc0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:49.244581 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-8381615d-c78a-492c-a79d-94087fdb8dc0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:49.340393 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8381615d-c78a-492c-a79d-94087fdb8dc0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:49.342026 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8381615d-c78a-492c-a79d-94087fdb8dc0 service nova] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:49.364520 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 689/1368] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:49:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:49:49.472450 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8530ac-e506-435a-92ec-b2a3a9d90ef9 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:49.472450 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8530ac-e506-435a-92ec-b2a3a9d90ef9 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:49.472450 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8530ac-e506-435a-92ec-b2a3a9d90ef9 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:49.473074 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 680/1369] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:49:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:49:49.479194 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5f73e-923e-4709-aa40-aa90613c2a8d None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:49.479563 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5f73e-923e-4709-aa40-aa90613c2a8d None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:49.479962 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5f73e-923e-4709-aa40-aa90613c2a8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:49.523166 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:49.569148 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-33e5f73e-923e-4709-aa40-aa90613c2a8d None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:49:49.570622 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-33e5f73e-923e-4709-aa40-aa90613c2a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:49.698862 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 690/1370] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:49:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:49:50.050420 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7535efa-5186-4a4d-abc1-59fa7b7006eb None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:50.050420 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7535efa-5186-4a4d-abc1-59fa7b7006eb None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:50.050420 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7535efa-5186-4a4d-abc1-59fa7b7006eb None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:50.051513 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 681/1371] 10.222.0.72 () {54 vars in 962 bytes} [Mon Sep 19 14:49:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:49:50.056615 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a384849c-2b88-4e78-97bc-461ea8bab236 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:50.056982 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a384849c-2b88-4e78-97bc-461ea8bab236 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:50.057330 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a384849c-2b88-4e78-97bc-461ea8bab236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:50.140119 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-a384849c-2b88-4e78-97bc-461ea8bab236 None None] MFA Rules not processed for user `139dc7a4f1dc48fe8faea848bd1ac0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:49:50.141793 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-a384849c-2b88-4e78-97bc-461ea8bab236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:50.197846 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:50.231271 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 691/1372] 10.222.0.72 () {58 vars in 1059 bytes} [Mon Sep 19 14:49:50 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:49:50.239251 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7535efa-5186-4a4d-abc1-59fa7b7006eb None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:50.240880 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-c7535efa-5186-4a4d-abc1-59fa7b7006eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:50.294502 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:50.354550 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7535efa-5186-4a4d-abc1-59fa7b7006eb None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:50.438847 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ea466b-2c1e-4f61-a382-40640462b2e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139dc7a4f1dc48fe8faea848bd1ac0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:50.439335 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea466b-2c1e-4f61-a382-40640462b2e8 service cinder] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:50.439624 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea466b-2c1e-4f61-a382-40640462b2e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:50.439970 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea466b-2c1e-4f61-a382-40640462b2e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:50.441753 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-95ea466b-2c1e-4f61-a382-40640462b2e8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:50.553099 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:50.568135 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ea466b-2c1e-4f61-a382-40640462b2e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:50.569640 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ea466b-2c1e-4f61-a382-40640462b2e8 service cinder] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:50.589607 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 682/1373] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:49:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:49:51.619815 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc314b10-0dcb-4d1a-ac65-7e970bc22b69 None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:51.620385 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc314b10-0dcb-4d1a-ac65-7e970bc22b69 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:51.620385 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc314b10-0dcb-4d1a-ac65-7e970bc22b69 None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:51.621631 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 692/1374] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:49:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:49:51.626862 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc750d-426b-46fe-8b8c-2ad15964a63a None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:51.627252 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc750d-426b-46fe-8b8c-2ad15964a63a None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:51.627508 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc750d-426b-46fe-8b8c-2ad15964a63a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:51.692701 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-c5dc750d-426b-46fe-8b8c-2ad15964a63a None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:49:51.693898 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-c5dc750d-426b-46fe-8b8c-2ad15964a63a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:51.790500 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 683/1375] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:49:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:49:52.082071 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc314b10-0dcb-4d1a-ac65-7e970bc22b69 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:52.083681 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-dc314b10-0dcb-4d1a-ac65-7e970bc22b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:52.250907 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc314b10-0dcb-4d1a-ac65-7e970bc22b69 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:52.303642 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:52.371872 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50904a2-67c9-4418-90b9-f9485825c0ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055439dc35e946f4a82535c684f9b60d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:52.372520 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50904a2-67c9-4418-90b9-f9485825c0ad service nova] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:52.372804 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50904a2-67c9-4418-90b9-f9485825c0ad service nova] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:52.373078 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50904a2-67c9-4418-90b9-f9485825c0ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:52.374769 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-b50904a2-67c9-4418-90b9-f9485825c0ad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:52.471607 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50904a2-67c9-4418-90b9-f9485825c0ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:52.473286 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50904a2-67c9-4418-90b9-f9485825c0ad service nova] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:52.491958 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 693/1376] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:49:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:49:54.741633 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ddc000-2508-46ed-86cf-7caca3b78ef6 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:54.742156 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ddc000-2508-46ed-86cf-7caca3b78ef6 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:54.742239 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ddc000-2508-46ed-86cf-7caca3b78ef6 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:54.744171 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 684/1377] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:49:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:49:54.749868 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43443480-e1c2-4fc4-86b6-5547151c7136 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:54.750330 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43443480-e1c2-4fc4-86b6-5547151c7136 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:54.750642 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43443480-e1c2-4fc4-86b6-5547151c7136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:54.820359 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-43443480-e1c2-4fc4-86b6-5547151c7136 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:49:54.821759 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-43443480-e1c2-4fc4-86b6-5547151c7136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:54.829288 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:54.938466 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 694/1378] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:49:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:49:55.232413 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ddc000-2508-46ed-86cf-7caca3b78ef6 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:55.233976 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-b3ddc000-2508-46ed-86cf-7caca3b78ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:55.299298 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:55.391723 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ddc000-2508-46ed-86cf-7caca3b78ef6 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:55.511246 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f42468-8ef8-455e-bc8d-6028a80f4905 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055439dc35e946f4a82535c684f9b60d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:55.511846 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f42468-8ef8-455e-bc8d-6028a80f4905 service nova] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:55.512120 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f42468-8ef8-455e-bc8d-6028a80f4905 service nova] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:55.512411 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f42468-8ef8-455e-bc8d-6028a80f4905 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:55.513976 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-f7f42468-8ef8-455e-bc8d-6028a80f4905 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:55.533417 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:55.612763 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f42468-8ef8-455e-bc8d-6028a80f4905 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:55.614267 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f42468-8ef8-455e-bc8d-6028a80f4905 service nova] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:55.633664 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 685/1379] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:49:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:49:57.893659 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728d6cab-c81b-48c1-990b-48b687a1fb71 None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:57.894199 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728d6cab-c81b-48c1-990b-48b687a1fb71 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:57.894199 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728d6cab-c81b-48c1-990b-48b687a1fb71 None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:57.895532 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 695/1380] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:49:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:49:57.901751 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9787b21-f996-4246-9253-67bffaf8180e None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:57.902148 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9787b21-f996-4246-9253-67bffaf8180e None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:57.902289 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9787b21-f996-4246-9253-67bffaf8180e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:57.972594 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-f9787b21-f996-4246-9253-67bffaf8180e None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:49:57.973872 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-f9787b21-f996-4246-9253-67bffaf8180e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:58.080107 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:58.102825 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 686/1381] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:49:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 14:49:58.416085 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728d6cab-c81b-48c1-990b-48b687a1fb71 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:58.417636 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-728d6cab-c81b-48c1-990b-48b687a1fb71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:58.562902 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:58.578116 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728d6cab-c81b-48c1-990b-48b687a1fb71 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:58.710832 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02eab4b-2254-44d2-998d-bfba3d4aa3b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055439dc35e946f4a82535c684f9b60d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:58.711469 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02eab4b-2254-44d2-998d-bfba3d4aa3b9 service nova] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:58.712413 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02eab4b-2254-44d2-998d-bfba3d4aa3b9 service nova] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:58.712736 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02eab4b-2254-44d2-998d-bfba3d4aa3b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:58.714499 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-a02eab4b-2254-44d2-998d-bfba3d4aa3b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:58.810039 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02eab4b-2254-44d2-998d-bfba3d4aa3b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:58.811711 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02eab4b-2254-44d2-998d-bfba3d4aa3b9 service nova] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:58.822975 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:58.832210 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 696/1382] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:49:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:50:01.028118 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06dd879-0589-41b9-8709-39d9576e9b63 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:01.028664 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06dd879-0589-41b9-8709-39d9576e9b63 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:01.028664 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06dd879-0589-41b9-8709-39d9576e9b63 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:01.030088 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 687/1383] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:50:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:50:01.035393 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf9048-d840-4ab2-8640-e6ddd8672a12 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:01.035842 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf9048-d840-4ab2-8640-e6ddd8672a12 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:01.035939 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf9048-d840-4ab2-8640-e6ddd8672a12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:01.105056 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-1dbf9048-d840-4ab2-8640-e6ddd8672a12 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:50:01.106330 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-1dbf9048-d840-4ab2-8640-e6ddd8672a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:01.207812 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 697/1384] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:50:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:50:01.498390 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06dd879-0589-41b9-8709-39d9576e9b63 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:01.500455 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-f06dd879-0589-41b9-8709-39d9576e9b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:01.682512 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06dd879-0589-41b9-8709-39d9576e9b63 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:01.773229 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:01.839476 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3bc037-1c78-4996-afcb-e5354ea9da73 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055439dc35e946f4a82535c684f9b60d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:01.840111 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3bc037-1c78-4996-afcb-e5354ea9da73 service nova] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:01.840431 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3bc037-1c78-4996-afcb-e5354ea9da73 service nova] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:01.840713 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3bc037-1c78-4996-afcb-e5354ea9da73 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:01.842372 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-ce3bc037-1c78-4996-afcb-e5354ea9da73 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:01.969925 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3bc037-1c78-4996-afcb-e5354ea9da73 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:01.971568 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3bc037-1c78-4996-afcb-e5354ea9da73 service nova] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:01.993329 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 688/1385] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:50:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:50:04.311501 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9d5c00-77c0-4272-9151-04f24c3bf598 None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:04.312039 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9d5c00-77c0-4272-9151-04f24c3bf598 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:04.312039 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9d5c00-77c0-4272-9151-04f24c3bf598 None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:04.313412 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 698/1386] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:50:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:50:04.318884 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8859ecfc-7ce1-452e-bbcb-07c4328b523a None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:04.319312 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8859ecfc-7ce1-452e-bbcb-07c4328b523a None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:04.319420 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8859ecfc-7ce1-452e-bbcb-07c4328b523a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:04.385205 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-8859ecfc-7ce1-452e-bbcb-07c4328b523a None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:50:04.386412 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-8859ecfc-7ce1-452e-bbcb-07c4328b523a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:04.420572 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:04.485432 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 689/1387] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:50:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:50:04.777562 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9d5c00-77c0-4272-9151-04f24c3bf598 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:04.779403 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-2b9d5c00-77c0-4272-9151-04f24c3bf598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:04.859849 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:04.936697 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9d5c00-77c0-4272-9151-04f24c3bf598 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:05.051700 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee9c004-73de-4a9a-ab16-0065d8275048 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055439dc35e946f4a82535c684f9b60d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:05.052341 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee9c004-73de-4a9a-ab16-0065d8275048 service nova] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:05.052674 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee9c004-73de-4a9a-ab16-0065d8275048 service nova] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:05.052958 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee9c004-73de-4a9a-ab16-0065d8275048 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:05.054586 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-1ee9c004-73de-4a9a-ab16-0065d8275048 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:05.094211 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:05.147664 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee9c004-73de-4a9a-ab16-0065d8275048 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:05.149382 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee9c004-73de-4a9a-ab16-0065d8275048 service nova] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:05.167355 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 699/1388] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:50:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:50:05.878865 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bf2757-42c4-4849-86fd-a4bfd9550b52 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:05.879431 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bf2757-42c4-4849-86fd-a4bfd9550b52 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:05.879431 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bf2757-42c4-4849-86fd-a4bfd9550b52 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:05.880794 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 690/1389] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:50:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:50:05.886202 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8573ffec-23bf-4f9c-b84f-c396cf44013f None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:05.886636 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8573ffec-23bf-4f9c-b84f-c396cf44013f None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:05.886745 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8573ffec-23bf-4f9c-b84f-c396cf44013f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:05.956264 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-8573ffec-23bf-4f9c-b84f-c396cf44013f None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:50:05.957509 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-8573ffec-23bf-4f9c-b84f-c396cf44013f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:06.057101 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 700/1390] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:50:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:50:06.361440 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d7882f-b948-4153-9f06-f4e187c687d6 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:06.361890 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d7882f-b948-4153-9f06-f4e187c687d6 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:06.362234 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d7882f-b948-4153-9f06-f4e187c687d6 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:06.363673 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 691/1391] 10.222.0.72 () {54 vars in 962 bytes} [Mon Sep 19 14:50:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:50:06.369804 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df551bbd-a8ef-4e31-92e5-fc498ea2274b None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:06.370165 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df551bbd-a8ef-4e31-92e5-fc498ea2274b None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:06.370512 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df551bbd-a8ef-4e31-92e5-fc498ea2274b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:06.386210 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:06.448242 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-df551bbd-a8ef-4e31-92e5-fc498ea2274b None None] MFA Rules not processed for user `4d6d4ecf8f4849939d6510a6228b29dc`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:50:06.449484 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-df551bbd-a8ef-4e31-92e5-fc498ea2274b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:06.524661 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 701/1392] 10.222.0.72 () {58 vars in 1059 bytes} [Mon Sep 19 14:50:06 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:50:06.532571 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d7882f-b948-4153-9f06-f4e187c687d6 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:06.534092 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-62d7882f-b948-4153-9f06-f4e187c687d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:06.638468 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d7882f-b948-4153-9f06-f4e187c687d6 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:06.697157 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:06.712236 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fcd55c-4f20-4370-8070-5e1ec6d15a8e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d6d4ecf8f4849939d6510a6228b29dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:06.712877 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fcd55c-4f20-4370-8070-5e1ec6d15a8e service glance] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:06.713415 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fcd55c-4f20-4370-8070-5e1ec6d15a8e service glance] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:06.713685 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fcd55c-4f20-4370-8070-5e1ec6d15a8e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:06.715254 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-b9fcd55c-4f20-4370-8070-5e1ec6d15a8e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:06.824675 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fcd55c-4f20-4370-8070-5e1ec6d15a8e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:06.826358 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fcd55c-4f20-4370-8070-5e1ec6d15a8e service glance] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:06.844464 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 692/1393] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:50:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:50:07.408429 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf091f7c-a648-4c3d-b1c0-d8726d59bc3c None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:07.409205 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf091f7c-a648-4c3d-b1c0-d8726d59bc3c None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:07.409205 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf091f7c-a648-4c3d-b1c0-d8726d59bc3c None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:07.410308 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 702/1394] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:50:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:50:07.417132 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac2c8f4-c74a-4677-bf5a-28eaf41f3480 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:07.417705 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac2c8f4-c74a-4677-bf5a-28eaf41f3480 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:07.417705 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac2c8f4-c74a-4677-bf5a-28eaf41f3480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:07.495653 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-6ac2c8f4-c74a-4677-bf5a-28eaf41f3480 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:50:07.496837 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-6ac2c8f4-c74a-4677-bf5a-28eaf41f3480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:07.539540 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:07.606004 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47102882-005e-473f-a7d2-70f22c6f0425 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:07.606280 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47102882-005e-473f-a7d2-70f22c6f0425 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:07.606549 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47102882-005e-473f-a7d2-70f22c6f0425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:07.607524 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 693/1395] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:50:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 14:50:07.672968 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-47102882-005e-473f-a7d2-70f22c6f0425 None None] MFA Rules not processed for user `afbbbf11f3234297ab1dd509f064480f`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:50:07.674171 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-47102882-005e-473f-a7d2-70f22c6f0425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:07.730372 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:07.763617 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 703/1396] 10.222.0.72 () {58 vars in 1009 bytes} [Mon Sep 19 14:50:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 14:50:07.808041 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26efb48-bfbb-471f-80fd-512b5c565510 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:07.808347 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26efb48-bfbb-471f-80fd-512b5c565510 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:07.808663 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26efb48-bfbb-471f-80fd-512b5c565510 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:07.809996 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 694/1397] 10.222.0.72 () {54 vars in 943 bytes} [Mon Sep 19 14:50:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:50:07.816756 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3f27c-b4dd-477a-9945-a45e0f4d8a59 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:07.817043 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3f27c-b4dd-477a-9945-a45e0f4d8a59 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:07.817315 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3f27c-b4dd-477a-9945-a45e0f4d8a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:07.903143 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-10b3f27c-b4dd-477a-9945-a45e0f4d8a59 None None] MFA Rules not processed for user `8504425c3a414608b030d0cf1af78af5`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:50:07.905364 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-10b3f27c-b4dd-477a-9945-a45e0f4d8a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:07.918010 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26efb48-bfbb-471f-80fd-512b5c565510 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:07.919539 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-f26efb48-bfbb-471f-80fd-512b5c565510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:08.025248 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 704/1398] 10.222.0.72 () {58 vars in 1040 bytes} [Mon Sep 19 14:50:07 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:50:08.034850 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b3f27c-b4dd-477a-9945-a45e0f4d8a59 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:08.045567 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b3f27c-b4dd-477a-9945-a45e0f4d8a59 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:08.072708 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:08.075390 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26efb48-bfbb-471f-80fd-512b5c565510 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:08.104589 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:08.163231 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a9f62a-1576-4495-9e81-1f4462af3113 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8504425c3a414608b030d0cf1af78af5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:08.163854 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a9f62a-1576-4495-9e81-1f4462af3113 service swift] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:08.164123 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a9f62a-1576-4495-9e81-1f4462af3113 service swift] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:08.164507 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a9f62a-1576-4495-9e81-1f4462af3113 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:08.166504 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-e8a9f62a-1576-4495-9e81-1f4462af3113 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:08.200752 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012a331c-7aa0-489d-8977-b1bd962dcbf0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055439dc35e946f4a82535c684f9b60d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:08.201397 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012a331c-7aa0-489d-8977-b1bd962dcbf0 service nova] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:08.201834 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012a331c-7aa0-489d-8977-b1bd962dcbf0 service nova] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:08.202076 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012a331c-7aa0-489d-8977-b1bd962dcbf0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:08.203676 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-012a331c-7aa0-489d-8977-b1bd962dcbf0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:08.253710 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a9f62a-1576-4495-9e81-1f4462af3113 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:08.255427 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a9f62a-1576-4495-9e81-1f4462af3113 service swift] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:08.264498 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 705/1399] 10.222.0.72 () {60 vars in 1384 bytes} [Mon Sep 19 14:50:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 19 14:50:08.301995 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012a331c-7aa0-489d-8977-b1bd962dcbf0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:08.303641 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012a331c-7aa0-489d-8977-b1bd962dcbf0 service nova] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:08.323811 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 695/1400] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:50:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 14:50:10.573834 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d430002-6c13-4d99-97c1-adea6db3f975 None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:10.574431 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d430002-6c13-4d99-97c1-adea6db3f975 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:10.574431 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d430002-6c13-4d99-97c1-adea6db3f975 None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:10.576634 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 706/1401] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:50:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:50:10.581438 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ccb02d-95b9-4bc3-b152-1f95e65aa4f6 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:10.581955 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ccb02d-95b9-4bc3-b152-1f95e65aa4f6 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:10.582049 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ccb02d-95b9-4bc3-b152-1f95e65aa4f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:10.620731 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:10.655519 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-39ccb02d-95b9-4bc3-b152-1f95e65aa4f6 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:50:10.658082 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-39ccb02d-95b9-4bc3-b152-1f95e65aa4f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:10.767318 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 696/1402] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:50:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:50:11.065399 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d430002-6c13-4d99-97c1-adea6db3f975 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:11.067196 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-0d430002-6c13-4d99-97c1-adea6db3f975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:11.131285 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:11.228032 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d430002-6c13-4d99-97c1-adea6db3f975 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:11.358935 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db8a25d-f7af-489a-b9bd-bdebad67ce62 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055439dc35e946f4a82535c684f9b60d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:11.359684 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db8a25d-f7af-489a-b9bd-bdebad67ce62 service nova] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:11.359974 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db8a25d-f7af-489a-b9bd-bdebad67ce62 service nova] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:11.360242 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db8a25d-f7af-489a-b9bd-bdebad67ce62 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:11.361894 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-9db8a25d-f7af-489a-b9bd-bdebad67ce62 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:11.386544 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:11.470810 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db8a25d-f7af-489a-b9bd-bdebad67ce62 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:11.472504 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db8a25d-f7af-489a-b9bd-bdebad67ce62 service nova] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:11.491257 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 707/1403] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:50:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:50:13.769388 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adadc9a1-51c5-4bd4-b106-715046b11e1c None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:13.769965 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adadc9a1-51c5-4bd4-b106-715046b11e1c None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:13.769965 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adadc9a1-51c5-4bd4-b106-715046b11e1c None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:13.777674 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 697/1404] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:50:13 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:50:13.780794 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb64796a-3831-4cf3-9e06-635657387b39 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:13.780794 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb64796a-3831-4cf3-9e06-635657387b39 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:13.781363 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb64796a-3831-4cf3-9e06-635657387b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:13.922486 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-cb64796a-3831-4cf3-9e06-635657387b39 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:50:13.923720 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-cb64796a-3831-4cf3-9e06-635657387b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:14.026463 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:14.032894 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 708/1405] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:50:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:50:14.326174 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adadc9a1-51c5-4bd4-b106-715046b11e1c None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:14.327743 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-adadc9a1-51c5-4bd4-b106-715046b11e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:14.444261 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:14.494886 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adadc9a1-51c5-4bd4-b106-715046b11e1c None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:14.620754 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32416267-be06-4d6a-9444-d18848d8e246 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055439dc35e946f4a82535c684f9b60d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:14.621284 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32416267-be06-4d6a-9444-d18848d8e246 service nova] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:14.621556 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32416267-be06-4d6a-9444-d18848d8e246 service nova] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:14.621836 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32416267-be06-4d6a-9444-d18848d8e246 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:14.623467 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-32416267-be06-4d6a-9444-d18848d8e246 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:14.703915 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:14.724307 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32416267-be06-4d6a-9444-d18848d8e246 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:14.725961 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32416267-be06-4d6a-9444-d18848d8e246 service nova] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:14.745617 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 698/1406] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:50:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 14:50:16.942404 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ea969-c82f-4fce-ba7c-2f103b9fcb1a None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:16.942970 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ea969-c82f-4fce-ba7c-2f103b9fcb1a None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:16.943079 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ea969-c82f-4fce-ba7c-2f103b9fcb1a None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:16.944349 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 709/1407] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:50:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:50:16.949841 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72696c7c-8b61-498e-a047-e624ffc0722d None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:16.950278 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72696c7c-8b61-498e-a047-e624ffc0722d None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:16.950508 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72696c7c-8b61-498e-a047-e624ffc0722d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:17.023755 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-72696c7c-8b61-498e-a047-e624ffc0722d None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:50:17.025106 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-72696c7c-8b61-498e-a047-e624ffc0722d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:17.136433 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 699/1408] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:50:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:50:17.425836 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189ea969-c82f-4fce-ba7c-2f103b9fcb1a None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:17.427425 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-189ea969-c82f-4fce-ba7c-2f103b9fcb1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:17.596201 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189ea969-c82f-4fce-ba7c-2f103b9fcb1a None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:17.671726 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:17.724572 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3559bc3-4f96-4ad3-b8d1-cd0337b8c8a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055439dc35e946f4a82535c684f9b60d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:17.725169 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3559bc3-4f96-4ad3-b8d1-cd0337b8c8a2 service nova] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:17.725454 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3559bc3-4f96-4ad3-b8d1-cd0337b8c8a2 service nova] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:17.725711 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3559bc3-4f96-4ad3-b8d1-cd0337b8c8a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:17.727388 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-b3559bc3-4f96-4ad3-b8d1-cd0337b8c8a2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:17.830574 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3559bc3-4f96-4ad3-b8d1-cd0337b8c8a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:17.832108 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3559bc3-4f96-4ad3-b8d1-cd0337b8c8a2 service nova] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:17.853623 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 710/1409] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:50:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 14:50:27.134058 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=79 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:27.850770 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=64 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:31.277492 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c4f20-b560-4260-b2c3-fd1422bdfdaf None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:31.278071 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c4f20-b560-4260-b2c3-fd1422bdfdaf None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:31.278071 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c4f20-b560-4260-b2c3-fd1422bdfdaf None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:31.279425 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 700/1410] 10.222.0.72 () {54 vars in 918 bytes} [Mon Sep 19 14:50:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:50:31.284366 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4567d96d-b787-4943-a8e1-9ab99281460d None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:31.284776 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4567d96d-b787-4943-a8e1-9ab99281460d None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:31.284921 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4567d96d-b787-4943-a8e1-9ab99281460d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:31.362376 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-4567d96d-b787-4943-a8e1-9ab99281460d None None] MFA Rules not processed for user `51e7a0148db8462b8ba24bac6dd15298`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:50:31.363574 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-4567d96d-b787-4943-a8e1-9ab99281460d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:31.468751 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 711/1411] 10.222.0.72 () {58 vars in 1015 bytes} [Mon Sep 19 14:50:31 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:50:31.483873 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7899f1ea-4cd5-449d-a5ed-8ac6b8e68e3a None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:31.484159 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7899f1ea-4cd5-449d-a5ed-8ac6b8e68e3a None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:31.484465 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7899f1ea-4cd5-449d-a5ed-8ac6b8e68e3a None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:31.485809 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 701/1412] 10.222.0.72 () {54 vars in 918 bytes} [Mon Sep 19 14:50:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:50:31.490639 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa3d2d9-4f37-4685-9cfa-60d778f916e5 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:31.490928 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa3d2d9-4f37-4685-9cfa-60d778f916e5 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:31.491206 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa3d2d9-4f37-4685-9cfa-60d778f916e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:31.563220 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:31.565862 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-1fa3d2d9-4f37-4685-9cfa-60d778f916e5 None None] MFA Rules not processed for user `055439dc35e946f4a82535c684f9b60d`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:50:31.567952 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-1fa3d2d9-4f37-4685-9cfa-60d778f916e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:31.683353 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 712/1413] 10.222.0.72 () {58 vars in 1015 bytes} [Mon Sep 19 14:50:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 14:50:34.263634 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae058b37-2093-41ed-bd5b-aa8a1555d70f None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:34.264175 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae058b37-2093-41ed-bd5b-aa8a1555d70f None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:34.264175 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae058b37-2093-41ed-bd5b-aa8a1555d70f None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:34.265562 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 702/1414] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 14:50:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:50:34.271044 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbad959-b876-4618-b4a5-2e251d269e24 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:34.271425 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbad959-b876-4618-b4a5-2e251d269e24 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:34.271601 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbad959-b876-4618-b4a5-2e251d269e24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:34.338669 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-cbbad959-b876-4618-b4a5-2e251d269e24 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:50:34.339891 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-cbbad959-b876-4618-b4a5-2e251d269e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:34.394592 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:34.435885 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 713/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 14:50:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:50:34.726346 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae058b37-2093-41ed-bd5b-aa8a1555d70f None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:34.727841 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-ae058b37-2093-41ed-bd5b-aa8a1555d70f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:34.873461 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae058b37-2093-41ed-bd5b-aa8a1555d70f None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:34.948066 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:34.988115 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82810ccb-e642-48e8-b970-d0066786ce03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055439dc35e946f4a82535c684f9b60d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:34.988686 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82810ccb-e642-48e8-b970-d0066786ce03 service nova] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:34.988969 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82810ccb-e642-48e8-b970-d0066786ce03 service nova] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:34.989242 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82810ccb-e642-48e8-b970-d0066786ce03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:34.990856 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-82810ccb-e642-48e8-b970-d0066786ce03 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:35.081757 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82810ccb-e642-48e8-b970-d0066786ce03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:35.083358 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82810ccb-e642-48e8-b970-d0066786ce03 service nova] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:35.101202 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 703/1416] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:50:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 14:50:36.245964 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a00228-190f-4919-b305-188d712aaee8 None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:36.246514 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a00228-190f-4919-b305-188d712aaee8 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:36.246514 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a00228-190f-4919-b305-188d712aaee8 None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:36.247860 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 714/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 14:50:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:50:36.254568 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e175eb-0a2f-46b3-9e61-60afe862810f None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:36.255012 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e175eb-0a2f-46b3-9e61-60afe862810f None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:36.255106 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e175eb-0a2f-46b3-9e61-60afe862810f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:36.331166 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-f3e175eb-0a2f-46b3-9e61-60afe862810f None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:50:36.332414 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-f3e175eb-0a2f-46b3-9e61-60afe862810f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:36.359503 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:36.428565 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 704/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 14:50:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:50:36.580676 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a00228-190f-4919-b305-188d712aaee8 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:36.582177 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-66a00228-190f-4919-b305-188d712aaee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:36.726927 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a00228-190f-4919-b305-188d712aaee8 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:36.767554 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:36.841232 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ada796-7a36-42ca-857b-a7686e9d96df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055439dc35e946f4a82535c684f9b60d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:36.841755 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ada796-7a36-42ca-857b-a7686e9d96df service nova] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:36.842042 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ada796-7a36-42ca-857b-a7686e9d96df service nova] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:36.842315 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ada796-7a36-42ca-857b-a7686e9d96df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:36.843936 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-45ada796-7a36-42ca-857b-a7686e9d96df service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:36.939041 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ada796-7a36-42ca-857b-a7686e9d96df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:36.940680 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ada796-7a36-42ca-857b-a7686e9d96df service nova] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:36.958568 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 715/1419] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:50:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:50:38.095548 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e46e4b-2fd2-44bf-a69f-a10ea3d9464d None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:38.096115 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e46e4b-2fd2-44bf-a69f-a10ea3d9464d None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:38.096115 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e46e4b-2fd2-44bf-a69f-a10ea3d9464d None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:38.097508 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 705/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 14:50:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:50:38.104685 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8129b967-a290-47cc-bb55-cca684a6a790 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:38.105111 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8129b967-a290-47cc-bb55-cca684a6a790 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:38.105231 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8129b967-a290-47cc-bb55-cca684a6a790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:38.158573 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:38.181872 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-8129b967-a290-47cc-bb55-cca684a6a790 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:50:38.183013 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-8129b967-a290-47cc-bb55-cca684a6a790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:38.278062 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 716/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 14:50:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:50:38.430991 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e46e4b-2fd2-44bf-a69f-a10ea3d9464d None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:38.432591 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-90e46e4b-2fd2-44bf-a69f-a10ea3d9464d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:38.581806 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e46e4b-2fd2-44bf-a69f-a10ea3d9464d None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:38.594405 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:38.697432 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efccf8f1-a4b7-4424-bb6e-460d52dedc3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055439dc35e946f4a82535c684f9b60d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:38.697954 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efccf8f1-a4b7-4424-bb6e-460d52dedc3c service nova] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:38.698234 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efccf8f1-a4b7-4424-bb6e-460d52dedc3c service nova] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:38.698540 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efccf8f1-a4b7-4424-bb6e-460d52dedc3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:38.700145 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-efccf8f1-a4b7-4424-bb6e-460d52dedc3c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:38.788018 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efccf8f1-a4b7-4424-bb6e-460d52dedc3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:38.789951 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efccf8f1-a4b7-4424-bb6e-460d52dedc3c service nova] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:38.808415 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 706/1422] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:50:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:50:39.938350 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cc8259-a01c-47a7-ae6d-b69bbf872c5f None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:39.938884 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cc8259-a01c-47a7-ae6d-b69bbf872c5f None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:39.938884 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cc8259-a01c-47a7-ae6d-b69bbf872c5f None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:39.940265 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 717/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 14:50:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:50:39.946852 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f98e11-0ebd-4ff6-9a0f-09c8e1e4e76b None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:39.947274 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f98e11-0ebd-4ff6-9a0f-09c8e1e4e76b None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:39.947410 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f98e11-0ebd-4ff6-9a0f-09c8e1e4e76b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:39.967227 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:40.023970 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-b0f98e11-0ebd-4ff6-9a0f-09c8e1e4e76b None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:50:40.025217 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-b0f98e11-0ebd-4ff6-9a0f-09c8e1e4e76b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:40.124204 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 707/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 14:50:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:50:40.273656 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cc8259-a01c-47a7-ae6d-b69bbf872c5f None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:40.275291 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-44cc8259-a01c-47a7-ae6d-b69bbf872c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:40.384590 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:40.419877 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cc8259-a01c-47a7-ae6d-b69bbf872c5f None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:40.529088 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5527e9e9-7baa-4a3f-94d2-f8bb008210ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055439dc35e946f4a82535c684f9b60d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:40.529634 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5527e9e9-7baa-4a3f-94d2-f8bb008210ad service nova] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:40.529914 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5527e9e9-7baa-4a3f-94d2-f8bb008210ad service nova] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:40.530184 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5527e9e9-7baa-4a3f-94d2-f8bb008210ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:40.531883 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-5527e9e9-7baa-4a3f-94d2-f8bb008210ad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:40.608891 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:40.622629 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5527e9e9-7baa-4a3f-94d2-f8bb008210ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:40.624267 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5527e9e9-7baa-4a3f-94d2-f8bb008210ad service nova] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:40.642230 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 718/1425] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:50:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:50:41.765934 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f878d-4011-44fa-801e-702e5229cf78 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:41.766534 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f878d-4011-44fa-801e-702e5229cf78 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:41.766534 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f878d-4011-44fa-801e-702e5229cf78 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:41.767916 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 708/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 14:50:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:50:41.774754 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f8311-8e0a-4e87-95ab-f562f4bfdd7c None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:41.775220 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f8311-8e0a-4e87-95ab-f562f4bfdd7c None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:41.775333 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f8311-8e0a-4e87-95ab-f562f4bfdd7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:41.849085 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-990f8311-8e0a-4e87-95ab-f562f4bfdd7c None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:50:41.850280 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-990f8311-8e0a-4e87-95ab-f562f4bfdd7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:41.947703 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 719/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 14:50:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 14:50:42.101102 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852f878d-4011-44fa-801e-702e5229cf78 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:42.102894 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-852f878d-4011-44fa-801e-702e5229cf78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:42.186070 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:42.247304 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852f878d-4011-44fa-801e-702e5229cf78 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:42.361320 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d21f9f-2940-4faa-a365-f1222c3bb9a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055439dc35e946f4a82535c684f9b60d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:42.361842 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d21f9f-2940-4faa-a365-f1222c3bb9a9 service nova] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:42.362124 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d21f9f-2940-4faa-a365-f1222c3bb9a9 service nova] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:42.362397 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d21f9f-2940-4faa-a365-f1222c3bb9a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:42.364030 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-19d21f9f-2940-4faa-a365-f1222c3bb9a9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:42.413062 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:42.455220 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d21f9f-2940-4faa-a365-f1222c3bb9a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:42.456898 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d21f9f-2940-4faa-a365-f1222c3bb9a9 service nova] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:42.475300 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 709/1428] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:50:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:50:43.534790 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc389c7-4b01-47bc-8ab0-4800bb294f85 None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:43.535336 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc389c7-4b01-47bc-8ab0-4800bb294f85 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:43.535336 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc389c7-4b01-47bc-8ab0-4800bb294f85 None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:43.536708 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 720/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 14:50:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:50:43.544069 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3c94a6-3ad1-412f-ad97-e32d8e088d13 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:43.544535 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3c94a6-3ad1-412f-ad97-e32d8e088d13 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:43.544688 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3c94a6-3ad1-412f-ad97-e32d8e088d13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:43.625621 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-da3c94a6-3ad1-412f-ad97-e32d8e088d13 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:50:43.626897 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-da3c94a6-3ad1-412f-ad97-e32d8e088d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:43.725883 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 710/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 14:50:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:50:43.876986 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc389c7-4b01-47bc-8ab0-4800bb294f85 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:43.878535 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-ebc389c7-4b01-47bc-8ab0-4800bb294f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:43.931238 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:44.026756 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc389c7-4b01-47bc-8ab0-4800bb294f85 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:44.139950 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f36a4ab-6962-4325-a0f3-19685b91c7f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055439dc35e946f4a82535c684f9b60d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:44.140570 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f36a4ab-6962-4325-a0f3-19685b91c7f6 service nova] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:44.140851 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f36a4ab-6962-4325-a0f3-19685b91c7f6 service nova] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:44.141127 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f36a4ab-6962-4325-a0f3-19685b91c7f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:44.142709 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-2f36a4ab-6962-4325-a0f3-19685b91c7f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:44.149677 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:44.230198 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f36a4ab-6962-4325-a0f3-19685b91c7f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:44.231783 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f36a4ab-6962-4325-a0f3-19685b91c7f6 service nova] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:44.249713 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 721/1431] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:50:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:50:45.305997 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed581ac-7b65-442b-9370-3897f6e87727 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:45.306549 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed581ac-7b65-442b-9370-3897f6e87727 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:45.306646 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed581ac-7b65-442b-9370-3897f6e87727 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:45.307919 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 711/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 14:50:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:50:45.314065 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01cb904-679e-4249-9729-528e01e120c9 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:45.314514 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01cb904-679e-4249-9729-528e01e120c9 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:45.314612 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01cb904-679e-4249-9729-528e01e120c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:45.389559 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-f01cb904-679e-4249-9729-528e01e120c9 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:50:45.390747 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-f01cb904-679e-4249-9729-528e01e120c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:45.456823 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:45.486480 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 722/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 14:50:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:50:45.639958 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed581ac-7b65-442b-9370-3897f6e87727 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:45.641430 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-3ed581ac-7b65-442b-9370-3897f6e87727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:45.659148 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:45.787129 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed581ac-7b65-442b-9370-3897f6e87727 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:45.874183 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:45.900894 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6465b46a-73ed-4576-9097-199f0c17b315 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055439dc35e946f4a82535c684f9b60d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:45.901429 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6465b46a-73ed-4576-9097-199f0c17b315 service nova] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:45.901708 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6465b46a-73ed-4576-9097-199f0c17b315 service nova] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:45.901981 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6465b46a-73ed-4576-9097-199f0c17b315 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:45.903608 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-6465b46a-73ed-4576-9097-199f0c17b315 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:45.992157 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6465b46a-73ed-4576-9097-199f0c17b315 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:45.993787 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6465b46a-73ed-4576-9097-199f0c17b315 service nova] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:46.011909 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 712/1434] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:50:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:50:47.062841 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1185c4-b440-4b12-975f-bac7862019ff None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:47.063438 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1185c4-b440-4b12-975f-bac7862019ff None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:47.063438 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1185c4-b440-4b12-975f-bac7862019ff None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:47.064770 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 723/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 14:50:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:50:47.071757 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804112ed-3401-454d-a11f-474dd2e80f3b None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:47.072225 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804112ed-3401-454d-a11f-474dd2e80f3b None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:47.072340 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804112ed-3401-454d-a11f-474dd2e80f3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:47.146786 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-804112ed-3401-454d-a11f-474dd2e80f3b None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:50:47.148022 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-804112ed-3401-454d-a11f-474dd2e80f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:47.188874 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:47.244396 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 713/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 14:50:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:50:47.394550 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1185c4-b440-4b12-975f-bac7862019ff None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:47.396096 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-5a1185c4-b440-4b12-975f-bac7862019ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:47.538936 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1185c4-b440-4b12-975f-bac7862019ff None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:47.596354 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:47.655270 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab81b1c-c96f-408a-90e7-46118965445e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055439dc35e946f4a82535c684f9b60d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:47.655869 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab81b1c-c96f-408a-90e7-46118965445e service nova] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:47.656145 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab81b1c-c96f-408a-90e7-46118965445e service nova] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:47.656439 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab81b1c-c96f-408a-90e7-46118965445e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:47.658013 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-2ab81b1c-c96f-408a-90e7-46118965445e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:47.746616 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab81b1c-c96f-408a-90e7-46118965445e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:47.748200 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab81b1c-c96f-408a-90e7-46118965445e service nova] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:47.766535 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 724/1437] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:50:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:50:48.828493 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a181c358-28d2-43b8-aa90-323b066db31a None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:48.829066 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a181c358-28d2-43b8-aa90-323b066db31a None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:48.829066 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a181c358-28d2-43b8-aa90-323b066db31a None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:48.830480 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 714/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 14:50:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:50:48.836777 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfc0986-7e3b-4a9e-a044-9dc7ca7dc8e5 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:48.837246 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfc0986-7e3b-4a9e-a044-9dc7ca7dc8e5 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:48.837373 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfc0986-7e3b-4a9e-a044-9dc7ca7dc8e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:48.912884 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-cdfc0986-7e3b-4a9e-a044-9dc7ca7dc8e5 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:50:48.914734 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-cdfc0986-7e3b-4a9e-a044-9dc7ca7dc8e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:48.916811 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:49.011782 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 725/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 14:50:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:50:49.159111 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a181c358-28d2-43b8-aa90-323b066db31a None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:49.160583 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-a181c358-28d2-43b8-aa90-323b066db31a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:49.308653 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a181c358-28d2-43b8-aa90-323b066db31a None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:49.336059 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:49.421531 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dc2671-7d1f-4698-9469-6db6c46e198b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055439dc35e946f4a82535c684f9b60d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:49.422052 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc2671-7d1f-4698-9469-6db6c46e198b service nova] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:49.422328 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc2671-7d1f-4698-9469-6db6c46e198b service nova] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:49.422597 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc2671-7d1f-4698-9469-6db6c46e198b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:49.424168 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-98dc2671-7d1f-4698-9469-6db6c46e198b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:49.511099 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dc2671-7d1f-4698-9469-6db6c46e198b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:49.512742 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dc2671-7d1f-4698-9469-6db6c46e198b service nova] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:49.531041 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 715/1440] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:50:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:50:51.608493 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9f05f3-eb74-44b4-bda0-b8146c00aa70 None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:51.609012 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9f05f3-eb74-44b4-bda0-b8146c00aa70 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:51.609012 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9f05f3-eb74-44b4-bda0-b8146c00aa70 None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:51.610333 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 726/1441] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 14:50:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:50:51.615599 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0184a94c-95d0-418c-944c-305403fc1004 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:51.616035 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0184a94c-95d0-418c-944c-305403fc1004 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:51.616177 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0184a94c-95d0-418c-944c-305403fc1004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:51.657417 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:51.682950 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-0184a94c-95d0-418c-944c-305403fc1004 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:50:51.684139 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-0184a94c-95d0-418c-944c-305403fc1004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:51.778798 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 716/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 14:50:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:50:52.066488 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9f05f3-eb74-44b4-bda0-b8146c00aa70 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:52.068048 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-bf9f05f3-eb74-44b4-bda0-b8146c00aa70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:52.170515 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9f05f3-eb74-44b4-bda0-b8146c00aa70 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:52.204860 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:52.246951 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a011d02a-74e1-4445-9120-5c3034fed6af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c2b78646374cb79ded4b7b59ba49c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:52.247549 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a011d02a-74e1-4445-9120-5c3034fed6af service neutron] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:52.247831 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a011d02a-74e1-4445-9120-5c3034fed6af service neutron] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:52.248101 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a011d02a-74e1-4445-9120-5c3034fed6af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:52.249728 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-a011d02a-74e1-4445-9120-5c3034fed6af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:52.357817 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a011d02a-74e1-4445-9120-5c3034fed6af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:52.359251 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a011d02a-74e1-4445-9120-5c3034fed6af service neutron] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:52.377070 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 727/1443] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:50:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:50:54.656000 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca3bfab-5747-4986-9081-446f60c29522 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:54.656592 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca3bfab-5747-4986-9081-446f60c29522 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:54.656592 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca3bfab-5747-4986-9081-446f60c29522 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:54.657951 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 717/1444] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 14:50:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:50:54.663346 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ab9ec-e4f6-4107-9fda-e5c0e27c8cf1 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:54.663804 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ab9ec-e4f6-4107-9fda-e5c0e27c8cf1 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:54.664082 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ab9ec-e4f6-4107-9fda-e5c0e27c8cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:54.730451 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-7a4ab9ec-e4f6-4107-9fda-e5c0e27c8cf1 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:50:54.731652 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-7a4ab9ec-e4f6-4107-9fda-e5c0e27c8cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:54.745125 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:54.829307 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 728/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 14:50:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:50:55.110395 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca3bfab-5747-4986-9081-446f60c29522 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:55.111918 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-bca3bfab-5747-4986-9081-446f60c29522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:55.214320 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca3bfab-5747-4986-9081-446f60c29522 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:55.227330 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:55.286146 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10159622-68bf-430f-8f05-982435a1273f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c2b78646374cb79ded4b7b59ba49c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:55.286735 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10159622-68bf-430f-8f05-982435a1273f service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:55.287008 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10159622-68bf-430f-8f05-982435a1273f service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:55.287273 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10159622-68bf-430f-8f05-982435a1273f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:55.289757 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-10159622-68bf-430f-8f05-982435a1273f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:55.394934 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10159622-68bf-430f-8f05-982435a1273f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:55.396384 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10159622-68bf-430f-8f05-982435a1273f service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:55.415150 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 718/1446] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:50:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:50:57.862843 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe9af5b-aa98-49ac-bfd2-834c9531c932 None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:57.863379 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe9af5b-aa98-49ac-bfd2-834c9531c932 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:57.863379 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe9af5b-aa98-49ac-bfd2-834c9531c932 None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:57.864759 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 729/1447] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 14:50:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:50:57.870228 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771aba03-9a9a-457f-9d9b-d26904b821ef None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:57.870685 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771aba03-9a9a-457f-9d9b-d26904b821ef None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:57.870784 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771aba03-9a9a-457f-9d9b-d26904b821ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:57.922734 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:57.940589 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-771aba03-9a9a-457f-9d9b-d26904b821ef None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:50:57.942062 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-771aba03-9a9a-457f-9d9b-d26904b821ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:58.038380 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 719/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 14:50:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:50:58.329920 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe9af5b-aa98-49ac-bfd2-834c9531c932 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:58.331500 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-dfe9af5b-aa98-49ac-bfd2-834c9531c932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:58.434014 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe9af5b-aa98-49ac-bfd2-834c9531c932 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:58.473982 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:58.509891 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105ad978-ebf3-48e7-9b1c-00c63b7f1278 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c2b78646374cb79ded4b7b59ba49c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:58.510489 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ad978-ebf3-48e7-9b1c-00c63b7f1278 service neutron] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:58.510770 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ad978-ebf3-48e7-9b1c-00c63b7f1278 service neutron] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:58.511045 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ad978-ebf3-48e7-9b1c-00c63b7f1278 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:58.512676 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-105ad978-ebf3-48e7-9b1c-00c63b7f1278 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:58.621171 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105ad978-ebf3-48e7-9b1c-00c63b7f1278 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:58.622521 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105ad978-ebf3-48e7-9b1c-00c63b7f1278 service neutron] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:58.640654 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 730/1449] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:50:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:51:00.974117 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d37ee82-618f-48ec-9258-fb37cc209176 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:00.974639 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d37ee82-618f-48ec-9258-fb37cc209176 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:00.974756 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d37ee82-618f-48ec-9258-fb37cc209176 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:00.976257 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 720/1450] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 14:51:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:51:00.981708 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d6719-2446-4522-a191-3d8665e48ab2 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:00.982132 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d6719-2446-4522-a191-3d8665e48ab2 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:00.982261 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d6719-2446-4522-a191-3d8665e48ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:01.047355 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-423d6719-2446-4522-a191-3d8665e48ab2 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:51:01.048596 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-423d6719-2446-4522-a191-3d8665e48ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:51:01.069572 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:01.144618 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 731/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 14:51:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:51:01.426423 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d37ee82-618f-48ec-9258-fb37cc209176 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:01.427934 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-8d37ee82-618f-48ec-9258-fb37cc209176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:51:01.529668 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d37ee82-618f-48ec-9258-fb37cc209176 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:01.550649 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:01.604431 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb86708f-82db-4504-9655-414b3ebdb8a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c2b78646374cb79ded4b7b59ba49c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:01.604964 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb86708f-82db-4504-9655-414b3ebdb8a7 service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:01.605241 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb86708f-82db-4504-9655-414b3ebdb8a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:01.605510 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb86708f-82db-4504-9655-414b3ebdb8a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:01.607093 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-bb86708f-82db-4504-9655-414b3ebdb8a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:51:01.713100 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb86708f-82db-4504-9655-414b3ebdb8a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:01.714513 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb86708f-82db-4504-9655-414b3ebdb8a7 service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:01.732478 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 721/1452] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:51:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:51:03.954766 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afceb3c-cb1f-44b2-a086-9625de710505 None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:03.955295 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afceb3c-cb1f-44b2-a086-9625de710505 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:03.955295 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afceb3c-cb1f-44b2-a086-9625de710505 None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:03.956722 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 732/1453] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 14:51:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:51:03.962195 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d48b11-31d7-4428-9cc5-e7534f955040 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:03.962614 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d48b11-31d7-4428-9cc5-e7534f955040 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:03.962727 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d48b11-31d7-4428-9cc5-e7534f955040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:04.025129 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:04.027924 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-a3d48b11-31d7-4428-9cc5-e7534f955040 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:51:04.029704 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-a3d48b11-31d7-4428-9cc5-e7534f955040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:51:04.126594 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 722/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 14:51:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:51:04.414508 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afceb3c-cb1f-44b2-a086-9625de710505 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:04.416149 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-4afceb3c-cb1f-44b2-a086-9625de710505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:51:04.518366 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afceb3c-cb1f-44b2-a086-9625de710505 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:04.566925 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:04.591815 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443cf5f9-2bab-4058-b61c-9380cf5f04a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c2b78646374cb79ded4b7b59ba49c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:04.592439 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443cf5f9-2bab-4058-b61c-9380cf5f04a3 service neutron] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:04.592722 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443cf5f9-2bab-4058-b61c-9380cf5f04a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:04.592996 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443cf5f9-2bab-4058-b61c-9380cf5f04a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:04.594596 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-443cf5f9-2bab-4058-b61c-9380cf5f04a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:51:04.820700 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443cf5f9-2bab-4058-b61c-9380cf5f04a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:04.822129 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443cf5f9-2bab-4058-b61c-9380cf5f04a3 service neutron] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:04.840775 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 733/1455] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:51:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:51:07.102378 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ef07bc-de47-41e0-b215-42fa0e1dc6cc None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:07.102945 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ef07bc-de47-41e0-b215-42fa0e1dc6cc None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:07.102945 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ef07bc-de47-41e0-b215-42fa0e1dc6cc None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:07.104272 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 723/1456] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 14:51:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:51:07.109738 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a0681-c3ce-4f47-8944-27d8a08017ee None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:07.110193 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a0681-c3ce-4f47-8944-27d8a08017ee None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:07.110300 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a0681-c3ce-4f47-8944-27d8a08017ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:07.173627 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-9c1a0681-c3ce-4f47-8944-27d8a08017ee None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:51:07.174733 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-9c1a0681-c3ce-4f47-8944-27d8a08017ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:51:07.203039 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:07.269431 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 734/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 14:51:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:51:07.554854 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ef07bc-de47-41e0-b215-42fa0e1dc6cc None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:07.556409 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-56ef07bc-de47-41e0-b215-42fa0e1dc6cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:51:07.659666 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ef07bc-de47-41e0-b215-42fa0e1dc6cc None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:07.687337 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:07.736452 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae7c9d4-5729-4ce0-814d-2f39947ceb3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c2b78646374cb79ded4b7b59ba49c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:07.737053 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae7c9d4-5729-4ce0-814d-2f39947ceb3b service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:07.737333 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae7c9d4-5729-4ce0-814d-2f39947ceb3b service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:07.737607 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae7c9d4-5729-4ce0-814d-2f39947ceb3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:07.739208 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-eae7c9d4-5729-4ce0-814d-2f39947ceb3b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:51:07.847555 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae7c9d4-5729-4ce0-814d-2f39947ceb3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:07.848948 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae7c9d4-5729-4ce0-814d-2f39947ceb3b service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:07.868102 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 724/1458] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:51:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:51:10.111637 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b238c11-0838-4c36-80e4-4deb8faa2364 None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:10.112209 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b238c11-0838-4c36-80e4-4deb8faa2364 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:10.112209 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b238c11-0838-4c36-80e4-4deb8faa2364 None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:10.113542 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 735/1459] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 14:51:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:51:10.119332 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30664888-3056-4443-a807-fec578e0caac None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:10.119761 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30664888-3056-4443-a807-fec578e0caac None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:10.119880 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30664888-3056-4443-a807-fec578e0caac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:10.185084 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-30664888-3056-4443-a807-fec578e0caac None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:51:10.186194 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-30664888-3056-4443-a807-fec578e0caac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:51:10.194773 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:10.283272 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 725/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 14:51:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:51:10.567924 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b238c11-0838-4c36-80e4-4deb8faa2364 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:10.570180 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-8b238c11-0838-4c36-80e4-4deb8faa2364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:51:10.672714 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b238c11-0838-4c36-80e4-4deb8faa2364 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:10.729132 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:10.747129 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cfcaed-7e7b-4cea-b4dd-de47f9999a3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c2b78646374cb79ded4b7b59ba49c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:10.747756 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cfcaed-7e7b-4cea-b4dd-de47f9999a3d service neutron] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:10.748032 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cfcaed-7e7b-4cea-b4dd-de47f9999a3d service neutron] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:10.748298 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cfcaed-7e7b-4cea-b4dd-de47f9999a3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:10.749931 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-20cfcaed-7e7b-4cea-b4dd-de47f9999a3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:51:10.858361 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cfcaed-7e7b-4cea-b4dd-de47f9999a3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:10.859703 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cfcaed-7e7b-4cea-b4dd-de47f9999a3d service neutron] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:10.878002 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 736/1461] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:51:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:51:13.087884 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec119d-c3a4-405a-b3c4-00c35f2fa490 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:13.088441 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec119d-c3a4-405a-b3c4-00c35f2fa490 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:13.088441 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec119d-c3a4-405a-b3c4-00c35f2fa490 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:13.089717 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 726/1462] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 14:51:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:51:13.094924 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff478b0-dfad-4afa-a68d-c938d121c749 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:13.095364 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff478b0-dfad-4afa-a68d-c938d121c749 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:13.095468 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff478b0-dfad-4afa-a68d-c938d121c749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:13.160147 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-0ff478b0-dfad-4afa-a68d-c938d121c749 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:51:13.161412 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-0ff478b0-dfad-4afa-a68d-c938d121c749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:51:13.199814 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:13.257049 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 737/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 14:51:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:51:13.542796 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ec119d-c3a4-405a-b3c4-00c35f2fa490 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:13.544353 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-17ec119d-c3a4-405a-b3c4-00c35f2fa490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:51:13.651455 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ec119d-c3a4-405a-b3c4-00c35f2fa490 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:13.692486 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:13.729434 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76c6c1d-c2fe-471b-84cf-4760a967ac19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c2b78646374cb79ded4b7b59ba49c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:13.730039 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76c6c1d-c2fe-471b-84cf-4760a967ac19 service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:13.730318 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76c6c1d-c2fe-471b-84cf-4760a967ac19 service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:13.730589 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76c6c1d-c2fe-471b-84cf-4760a967ac19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:13.732194 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-c76c6c1d-c2fe-471b-84cf-4760a967ac19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:51:13.841538 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76c6c1d-c2fe-471b-84cf-4760a967ac19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:13.842990 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76c6c1d-c2fe-471b-84cf-4760a967ac19 service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:13.860745 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 727/1464] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:51:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:51:16.063619 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b00677e-c5be-4a64-ba31-33d92ee006f4 None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:16.064171 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b00677e-c5be-4a64-ba31-33d92ee006f4 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:16.064171 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b00677e-c5be-4a64-ba31-33d92ee006f4 None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:16.065516 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 738/1465] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 14:51:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:51:16.071996 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c247ab0f-618d-4b1b-a4df-1b087437282e None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:16.072437 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c247ab0f-618d-4b1b-a4df-1b087437282e None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:16.072591 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c247ab0f-618d-4b1b-a4df-1b087437282e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:16.138636 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-c247ab0f-618d-4b1b-a4df-1b087437282e None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:51:16.139845 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-c247ab0f-618d-4b1b-a4df-1b087437282e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:51:16.158071 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:16.238483 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 728/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 14:51:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:51:16.524420 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b00677e-c5be-4a64-ba31-33d92ee006f4 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:16.525968 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-3b00677e-c5be-4a64-ba31-33d92ee006f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:51:16.629579 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b00677e-c5be-4a64-ba31-33d92ee006f4 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:16.695901 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:16.702965 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da868e4f-590d-488b-9765-2c15a7d6ec4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c2b78646374cb79ded4b7b59ba49c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:16.703571 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da868e4f-590d-488b-9765-2c15a7d6ec4b service neutron] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:16.703850 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da868e4f-590d-488b-9765-2c15a7d6ec4b service neutron] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:16.704150 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da868e4f-590d-488b-9765-2c15a7d6ec4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:16.705791 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-da868e4f-590d-488b-9765-2c15a7d6ec4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:51:16.815556 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da868e4f-590d-488b-9765-2c15a7d6ec4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:16.817207 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da868e4f-590d-488b-9765-2c15a7d6ec4b service neutron] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:16.835528 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 739/1467] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:51:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:51:19.003516 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4ade67-896d-45ee-b72d-bf8b0d7a7ca5 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:19.004074 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4ade67-896d-45ee-b72d-bf8b0d7a7ca5 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:19.004074 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4ade67-896d-45ee-b72d-bf8b0d7a7ca5 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:19.005422 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 729/1468] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 14:51:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:51:19.010644 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ce43a-8896-47e6-9ac1-7e803bfd7070 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:19.011109 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ce43a-8896-47e6-9ac1-7e803bfd7070 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:19.011218 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ce43a-8896-47e6-9ac1-7e803bfd7070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:19.077654 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-375ce43a-8896-47e6-9ac1-7e803bfd7070 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:51:19.078857 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-375ce43a-8896-47e6-9ac1-7e803bfd7070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:51:19.126459 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:19.174090 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 740/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 14:51:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:51:19.462643 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4ade67-896d-45ee-b72d-bf8b0d7a7ca5 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:19.464207 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-fa4ade67-896d-45ee-b72d-bf8b0d7a7ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:51:19.565553 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4ade67-896d-45ee-b72d-bf8b0d7a7ca5 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:19.614430 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:19.640916 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0265979b-2b30-4d12-99f2-9c7b968ac676 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c2b78646374cb79ded4b7b59ba49c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:19.641513 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0265979b-2b30-4d12-99f2-9c7b968ac676 service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:19.641794 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0265979b-2b30-4d12-99f2-9c7b968ac676 service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:19.642066 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0265979b-2b30-4d12-99f2-9c7b968ac676 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:19.643670 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-0265979b-2b30-4d12-99f2-9c7b968ac676 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:51:19.753100 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0265979b-2b30-4d12-99f2-9c7b968ac676 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:19.754458 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0265979b-2b30-4d12-99f2-9c7b968ac676 service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:19.772296 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 730/1470] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:51:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:51:29.172552 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=22 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:29.769824 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=66 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:39.720797 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5ae8e6-c490-497d-a702-ffc6be1e3207 None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:39.721348 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5ae8e6-c490-497d-a702-ffc6be1e3207 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:39.721454 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5ae8e6-c490-497d-a702-ffc6be1e3207 None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:39.722703 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 741/1471] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:51:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:51:39.728463 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91594ee3-9479-4977-a882-269265606bf1 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:39.728937 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91594ee3-9479-4977-a882-269265606bf1 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:39.729036 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91594ee3-9479-4977-a882-269265606bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:39.795648 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-91594ee3-9479-4977-a882-269265606bf1 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:51:39.796912 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-91594ee3-9479-4977-a882-269265606bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:51:39.893528 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 731/1472] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:51:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:51:40.194489 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0492b54-8545-40ad-a369-4d9c366f2099 None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:40.194800 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0492b54-8545-40ad-a369-4d9c366f2099 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:40.195075 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0492b54-8545-40ad-a369-4d9c366f2099 None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:40.196396 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 742/1473] 10.222.0.72 () {54 vars in 962 bytes} [Mon Sep 19 14:51:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:51:40.201239 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8631469d-1451-417f-b436-525944f4c7b2 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:40.201522 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8631469d-1451-417f-b436-525944f4c7b2 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:40.201795 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8631469d-1451-417f-b436-525944f4c7b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:40.276333 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-8631469d-1451-417f-b436-525944f4c7b2 None None] MFA Rules not processed for user `4d6d4ecf8f4849939d6510a6228b29dc`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:51:40.277544 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-8631469d-1451-417f-b436-525944f4c7b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:51:40.297755 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:40.353952 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 732/1474] 10.222.0.72 () {58 vars in 1059 bytes} [Mon Sep 19 14:51:40 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:51:40.361766 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0492b54-8545-40ad-a369-4d9c366f2099 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:40.363275 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-e0492b54-8545-40ad-a369-4d9c366f2099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:51:40.465409 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0492b54-8545-40ad-a369-4d9c366f2099 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:40.542353 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89725c6d-6d44-405d-9707-e73d395e14f7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d6d4ecf8f4849939d6510a6228b29dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:40.542961 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89725c6d-6d44-405d-9707-e73d395e14f7 service glance] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:40.543243 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89725c6d-6d44-405d-9707-e73d395e14f7 service glance] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:40.543517 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89725c6d-6d44-405d-9707-e73d395e14f7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:40.545157 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-89725c6d-6d44-405d-9707-e73d395e14f7 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:51:40.600529 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:40.655394 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89725c6d-6d44-405d-9707-e73d395e14f7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:40.656859 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89725c6d-6d44-405d-9707-e73d395e14f7 service glance] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:40.675196 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 743/1475] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:51:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:51:42.926056 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c4c68e-3697-45e9-b72d-8a45818b343a None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:42.926542 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c4c68e-3697-45e9-b72d-8a45818b343a None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:42.926743 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c4c68e-3697-45e9-b72d-8a45818b343a None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:42.928541 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 733/1476] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:51:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:51:42.933882 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525399ff-5647-4bdc-ac1c-0514126b2bd3 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:42.934323 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525399ff-5647-4bdc-ac1c-0514126b2bd3 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:42.934425 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525399ff-5647-4bdc-ac1c-0514126b2bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:43.000729 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-525399ff-5647-4bdc-ac1c-0514126b2bd3 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:51:43.001969 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-525399ff-5647-4bdc-ac1c-0514126b2bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:51:43.097521 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 744/1477] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:51:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:51:43.372805 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c4c68e-3697-45e9-b72d-8a45818b343a None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:43.374260 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-00c4c68e-3697-45e9-b72d-8a45818b343a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:51:43.500103 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c4c68e-3697-45e9-b72d-8a45818b343a None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:43.550322 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:43.596906 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00c4331-1f44-4a0b-9cd4-c30cb5d6937d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:43.597179 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c4331-1f44-4a0b-9cd4-c30cb5d6937d admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:43.597378 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c4331-1f44-4a0b-9cd4-c30cb5d6937d admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:43.597538 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c4331-1f44-4a0b-9cd4-c30cb5d6937d admin admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:43.598165 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00c4331-1f44-4a0b-9cd4-c30cb5d6937d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:43.600771 dv-cinder-756711-11-smb devstack@keystone.service[81451]: WARNING py.warnings [None req-b00c4331-1f44-4a0b-9cd4-c30cb5d6937d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 19 14:51:43.600771 dv-cinder-756711-11-smb devstack@keystone.service[81451]: warnings.warn(msg) Sep 19 14:51:43.600771 dv-cinder-756711-11-smb devstack@keystone.service[81451]: Sep 19 14:51:43.602106 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00c4331-1f44-4a0b-9cd4-c30cb5d6937d admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:43.623340 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 734/1478] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Sep 19 14:51:43 2022] GET /identity/v3/projects => generated 2553 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:51:45.778467 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13cd395-98b6-48ef-9824-12d1d184b6d1 None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:45.779033 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13cd395-98b6-48ef-9824-12d1d184b6d1 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:45.779033 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13cd395-98b6-48ef-9824-12d1d184b6d1 None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:45.780409 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 745/1479] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:51:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:51:45.785567 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c130dd-0b8f-4f01-b4e9-f97d53db6b82 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:45.786033 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c130dd-0b8f-4f01-b4e9-f97d53db6b82 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:45.786215 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c130dd-0b8f-4f01-b4e9-f97d53db6b82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:45.852519 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-d5c130dd-0b8f-4f01-b4e9-f97d53db6b82 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:51:45.853742 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-d5c130dd-0b8f-4f01-b4e9-f97d53db6b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:51:45.951042 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 735/1480] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:51:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:51:46.247476 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13cd395-98b6-48ef-9824-12d1d184b6d1 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:46.249149 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-d13cd395-98b6-48ef-9824-12d1d184b6d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:51:46.259909 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:46.393532 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13cd395-98b6-48ef-9824-12d1d184b6d1 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:46.473229 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:46.506569 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3976aebe-4056-429f-aa3a-47f11b28b9dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055439dc35e946f4a82535c684f9b60d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:46.507108 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3976aebe-4056-429f-aa3a-47f11b28b9dc service nova] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:46.507388 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3976aebe-4056-429f-aa3a-47f11b28b9dc service nova] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:46.507661 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3976aebe-4056-429f-aa3a-47f11b28b9dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:46.509294 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-3976aebe-4056-429f-aa3a-47f11b28b9dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:51:46.602420 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3976aebe-4056-429f-aa3a-47f11b28b9dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:46.604050 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3976aebe-4056-429f-aa3a-47f11b28b9dc service nova] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:46.621487 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 746/1481] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:51:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:51:48.940213 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f349ef41-0c40-4cab-9edb-8bde8c3bf5d8 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:48.940752 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f349ef41-0c40-4cab-9edb-8bde8c3bf5d8 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:48.941154 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f349ef41-0c40-4cab-9edb-8bde8c3bf5d8 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:48.942512 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 736/1482] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:51:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:51:48.947839 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9444832e-d09c-4c5f-83fb-8ae55db1eab4 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:48.948245 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9444832e-d09c-4c5f-83fb-8ae55db1eab4 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:48.948411 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9444832e-d09c-4c5f-83fb-8ae55db1eab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:49.013002 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-9444832e-d09c-4c5f-83fb-8ae55db1eab4 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:51:49.014187 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-9444832e-d09c-4c5f-83fb-8ae55db1eab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:51:49.060032 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:49.110823 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 747/1483] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:51:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:51:49.404083 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f349ef41-0c40-4cab-9edb-8bde8c3bf5d8 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:49.405691 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-f349ef41-0c40-4cab-9edb-8bde8c3bf5d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:51:49.429927 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:49.510457 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f349ef41-0c40-4cab-9edb-8bde8c3bf5d8 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:49.585362 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad725907-7071-4e44-94a8-f5b39e741419 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c2b78646374cb79ded4b7b59ba49c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:49.585959 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad725907-7071-4e44-94a8-f5b39e741419 service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:49.586232 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad725907-7071-4e44-94a8-f5b39e741419 service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:49.586500 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad725907-7071-4e44-94a8-f5b39e741419 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:49.588090 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-ad725907-7071-4e44-94a8-f5b39e741419 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:51:49.662061 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:49.697728 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad725907-7071-4e44-94a8-f5b39e741419 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:49.699196 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad725907-7071-4e44-94a8-f5b39e741419 service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:49.717864 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 737/1484] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:51:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:51:51.892572 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ff2fdf-a0f5-473d-afd7-9ec6054d3547 None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:51.893155 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ff2fdf-a0f5-473d-afd7-9ec6054d3547 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:51.893155 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ff2fdf-a0f5-473d-afd7-9ec6054d3547 None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:51.894438 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 748/1485] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:51:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:51:51.899938 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8352f5-787f-4952-953e-4547cadb34c3 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:51.900441 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8352f5-787f-4952-953e-4547cadb34c3 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:51.900542 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8352f5-787f-4952-953e-4547cadb34c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:51.967436 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-3d8352f5-787f-4952-953e-4547cadb34c3 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:51:51.968684 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-3d8352f5-787f-4952-953e-4547cadb34c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:51:52.065749 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 738/1486] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:51:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:51:52.353456 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ff2fdf-a0f5-473d-afd7-9ec6054d3547 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:52.355004 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-d3ff2fdf-a0f5-473d-afd7-9ec6054d3547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:51:52.457117 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ff2fdf-a0f5-473d-afd7-9ec6054d3547 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:52.529163 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:52.530628 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51883341-5a89-41d8-9cb0-41e950e6664d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c2b78646374cb79ded4b7b59ba49c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:52.531247 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51883341-5a89-41d8-9cb0-41e950e6664d service neutron] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:52.531759 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51883341-5a89-41d8-9cb0-41e950e6664d service neutron] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:52.532214 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51883341-5a89-41d8-9cb0-41e950e6664d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:52.534002 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-51883341-5a89-41d8-9cb0-41e950e6664d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:51:52.644428 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51883341-5a89-41d8-9cb0-41e950e6664d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:52.646308 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51883341-5a89-41d8-9cb0-41e950e6664d service neutron] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:52.663554 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 749/1487] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:51:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 14:51:54.904515 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d4522-54d7-4459-bfd0-903bc524fddf None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:54.905082 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d4522-54d7-4459-bfd0-903bc524fddf None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:54.905082 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d4522-54d7-4459-bfd0-903bc524fddf None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:54.906400 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 739/1488] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:51:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:51:54.912067 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae6615-f1b5-46c2-bef1-e1d1d58d7920 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:54.912551 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae6615-f1b5-46c2-bef1-e1d1d58d7920 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:54.912651 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae6615-f1b5-46c2-bef1-e1d1d58d7920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:54.978533 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-f6ae6615-f1b5-46c2-bef1-e1d1d58d7920 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:51:54.979724 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-f6ae6615-f1b5-46c2-bef1-e1d1d58d7920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:51:55.031334 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:55.074759 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 750/1489] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:51:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:51:55.367901 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674d4522-54d7-4459-bfd0-903bc524fddf None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:55.369477 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-674d4522-54d7-4459-bfd0-903bc524fddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:51:55.405708 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:55.473804 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674d4522-54d7-4459-bfd0-903bc524fddf None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:55.546698 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1d13d2-f484-47fe-bf01-2282f7c456cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c2b78646374cb79ded4b7b59ba49c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:55.547323 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d13d2-f484-47fe-bf01-2282f7c456cc service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:55.547599 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d13d2-f484-47fe-bf01-2282f7c456cc service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:55.547867 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d13d2-f484-47fe-bf01-2282f7c456cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:55.549495 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-3b1d13d2-f484-47fe-bf01-2282f7c456cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:51:55.749774 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:55.779509 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1d13d2-f484-47fe-bf01-2282f7c456cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:55.781006 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1d13d2-f484-47fe-bf01-2282f7c456cc service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:55.799982 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 740/1490] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:51:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:51:58.128029 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f58124-50c6-4f9d-939f-76819c18c7d2 None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:58.128600 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f58124-50c6-4f9d-939f-76819c18c7d2 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:58.128600 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f58124-50c6-4f9d-939f-76819c18c7d2 None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:58.130060 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 751/1491] 10.222.0.72 () {54 vars in 927 bytes} [Mon Sep 19 14:51:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:51:58.135261 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013bede9-fa5e-429e-8331-57ae46a96a65 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:58.135652 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013bede9-fa5e-429e-8331-57ae46a96a65 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:58.135808 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013bede9-fa5e-429e-8331-57ae46a96a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:58.200968 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-013bede9-fa5e-429e-8331-57ae46a96a65 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:51:58.202108 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-013bede9-fa5e-429e-8331-57ae46a96a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:51:58.297418 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 741/1492] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Sep 19 14:51:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:51:58.594042 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f58124-50c6-4f9d-939f-76819c18c7d2 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:58.595614 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-14f58124-50c6-4f9d-939f-76819c18c7d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:51:58.698553 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f58124-50c6-4f9d-939f-76819c18c7d2 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:58.771497 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759c2c2a-be6e-4acf-b461-670f956fde2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c2b78646374cb79ded4b7b59ba49c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:58.772090 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759c2c2a-be6e-4acf-b461-670f956fde2f service neutron] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:58.772387 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759c2c2a-be6e-4acf-b461-670f956fde2f service neutron] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:58.772657 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759c2c2a-be6e-4acf-b461-670f956fde2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:58.774246 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-759c2c2a-be6e-4acf-b461-670f956fde2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:51:58.782433 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:58.880974 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759c2c2a-be6e-4acf-b461-670f956fde2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:58.882300 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759c2c2a-be6e-4acf-b461-670f956fde2f service neutron] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:58.900882 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 752/1493] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:51:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:52:08.295889 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=82 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:52:08.898143 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=50 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:53:11.811138 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae4178a-cc08-4edb-a89c-5d980e7e5415 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:53:11.811694 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae4178a-cc08-4edb-a89c-5d980e7e5415 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:53:11.811694 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae4178a-cc08-4edb-a89c-5d980e7e5415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:53:11.887693 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-eae4178a-cc08-4edb-a89c-5d980e7e5415 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:53:11.889009 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-eae4178a-cc08-4edb-a89c-5d980e7e5415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:53:11.987401 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 742/1494] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:53:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:53:11.995338 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3389e62c-00b8-4c22-bfe3-b5d0becd8514 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:53:11.995813 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3389e62c-00b8-4c22-bfe3-b5d0becd8514 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:53:11.995922 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3389e62c-00b8-4c22-bfe3-b5d0becd8514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:53:12.074278 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-3389e62c-00b8-4c22-bfe3-b5d0becd8514 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:53:12.075390 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-3389e62c-00b8-4c22-bfe3-b5d0becd8514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:53:12.171422 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 753/1495] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:53:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:53:12.176817 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae4178a-cc08-4edb-a89c-5d980e7e5415 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:53:12.178059 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-eae4178a-cc08-4edb-a89c-5d980e7e5415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:53:12.189655 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae4178a-cc08-4edb-a89c-5d980e7e5415 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:53:12.252147 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:53:12.284577 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6d4de6-ebd2-4601-9048-68978d7017bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:53:12.285175 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6d4de6-ebd2-4601-9048-68978d7017bc admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:53:12.285451 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6d4de6-ebd2-4601-9048-68978d7017bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:53:12.285721 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6d4de6-ebd2-4601-9048-68978d7017bc admin admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:53:12.286390 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6d4de6-ebd2-4601-9048-68978d7017bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:53:12.286692 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6d4de6-ebd2-4601-9048-68978d7017bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:53:12.287698 dv-cinder-756711-11-smb devstack@keystone.service[81451]: WARNING py.warnings [None req-5e6d4de6-ebd2-4601-9048-68978d7017bc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 19 14:53:12.287698 dv-cinder-756711-11-smb devstack@keystone.service[81451]: warnings.warn(msg) Sep 19 14:53:12.287698 dv-cinder-756711-11-smb devstack@keystone.service[81451]: Sep 19 14:53:12.288597 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6d4de6-ebd2-4601-9048-68978d7017bc admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:53:12.300829 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 743/1496] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Sep 19 14:53:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:53:12.309070 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3389e62c-00b8-4c22-bfe3-b5d0becd8514 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:53:12.318642 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3389e62c-00b8-4c22-bfe3-b5d0becd8514 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:53:12.379548 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:53:12.412825 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ecafb8-0771-4e46-98bb-eee695abc9fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:53:12.413427 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ecafb8-0771-4e46-98bb-eee695abc9fd admin admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:53:12.413702 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ecafb8-0771-4e46-98bb-eee695abc9fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:53:12.413969 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ecafb8-0771-4e46-98bb-eee695abc9fd admin admin] PATH_INFO: `/v3/projects` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:53:12.414600 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ecafb8-0771-4e46-98bb-eee695abc9fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:53:12.416318 dv-cinder-756711-11-smb devstack@keystone.service[81452]: WARNING py.warnings [None req-67ecafb8-0771-4e46-98bb-eee695abc9fd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 19 14:53:12.416318 dv-cinder-756711-11-smb devstack@keystone.service[81452]: warnings.warn(msg) Sep 19 14:53:12.416318 dv-cinder-756711-11-smb devstack@keystone.service[81452]: Sep 19 14:53:12.417534 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ecafb8-0771-4e46-98bb-eee695abc9fd admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:53:12.473561 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 754/1497] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Sep 19 14:53:12 2022] POST /identity/v3/projects => generated 377 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:53:12.477809 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6d4de6-ebd2-4601-9048-68978d7017bc admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:53:12.479356 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-5e6d4de6-ebd2-4601-9048-68978d7017bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:53:12.511374 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6d4de6-ebd2-4601-9048-68978d7017bc admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:53:12.604654 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d998d180-5b7f-4461-b3f0-3fde4a0ea39b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:53:12.605257 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d998d180-5b7f-4461-b3f0-3fde4a0ea39b admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:53:12.605536 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d998d180-5b7f-4461-b3f0-3fde4a0ea39b admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:53:12.605806 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d998d180-5b7f-4461-b3f0-3fde4a0ea39b admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:53:12.606435 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d998d180-5b7f-4461-b3f0-3fde4a0ea39b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:53:12.607439 dv-cinder-756711-11-smb devstack@keystone.service[81451]: WARNING py.warnings [None req-d998d180-5b7f-4461-b3f0-3fde4a0ea39b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 19 14:53:12.607439 dv-cinder-756711-11-smb devstack@keystone.service[81451]: warnings.warn(msg) Sep 19 14:53:12.607439 dv-cinder-756711-11-smb devstack@keystone.service[81451]: Sep 19 14:53:12.608678 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d998d180-5b7f-4461-b3f0-3fde4a0ea39b admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:53:12.650476 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 744/1498] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Sep 19 14:53:12 2022] POST /identity/v3/users => generated 289 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:53:12.654586 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ecafb8-0771-4e46-98bb-eee695abc9fd admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:53:12.656111 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-67ecafb8-0771-4e46-98bb-eee695abc9fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:53:12.718622 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ecafb8-0771-4e46-98bb-eee695abc9fd admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:53:12.802889 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:53:12.814597 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8025deaf-8eca-406f-932e-0717c4e222ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:53:12.815295 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8025deaf-8eca-406f-932e-0717c4e222ba admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:53:12.815572 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8025deaf-8eca-406f-932e-0717c4e222ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:53:12.815847 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8025deaf-8eca-406f-932e-0717c4e222ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:53:12.816766 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8025deaf-8eca-406f-932e-0717c4e222ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:53:12.817771 dv-cinder-756711-11-smb devstack@keystone.service[81452]: WARNING py.warnings [None req-8025deaf-8eca-406f-932e-0717c4e222ba admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 19 14:53:12.817771 dv-cinder-756711-11-smb devstack@keystone.service[81452]: warnings.warn(msg) Sep 19 14:53:12.817771 dv-cinder-756711-11-smb devstack@keystone.service[81452]: Sep 19 14:53:12.818696 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8025deaf-8eca-406f-932e-0717c4e222ba admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:53:12.831717 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 755/1499] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:53:12 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:53:12.835755 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d998d180-5b7f-4461-b3f0-3fde4a0ea39b admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:53:12.837347 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-d998d180-5b7f-4461-b3f0-3fde4a0ea39b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:53:12.849016 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d998d180-5b7f-4461-b3f0-3fde4a0ea39b admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:53:12.873708 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:53:12.944620 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfd10ee-7b04-48c6-9946-10e5fbb9e862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:53:12.945236 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd10ee-7b04-48c6-9946-10e5fbb9e862 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:53:12.945506 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd10ee-7b04-48c6-9946-10e5fbb9e862 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:53:12.945774 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd10ee-7b04-48c6-9946-10e5fbb9e862 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:53:12.946406 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfd10ee-7b04-48c6-9946-10e5fbb9e862 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:53:12.947416 dv-cinder-756711-11-smb devstack@keystone.service[81451]: WARNING py.warnings [None req-abfd10ee-7b04-48c6-9946-10e5fbb9e862 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 19 14:53:12.947416 dv-cinder-756711-11-smb devstack@keystone.service[81451]: warnings.warn(msg) Sep 19 14:53:12.947416 dv-cinder-756711-11-smb devstack@keystone.service[81451]: Sep 19 14:53:12.948290 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfd10ee-7b04-48c6-9946-10e5fbb9e862 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:53:12.960900 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 745/1500] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:53:12 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:53:12.965101 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8025deaf-8eca-406f-932e-0717c4e222ba admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:53:12.966650 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-8025deaf-8eca-406f-932e-0717c4e222ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:53:12.999995 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8025deaf-8eca-406f-932e-0717c4e222ba admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:53:13.092913 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f5d6d9-3cf5-46f7-ab6f-8dacf3b03f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:53:13.093557 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f5d6d9-3cf5-46f7-ab6f-8dacf3b03f12 admin admin] REQUEST_METHOD: `PUT` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:53:13.093831 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f5d6d9-3cf5-46f7-ab6f-8dacf3b03f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:53:13.094098 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f5d6d9-3cf5-46f7-ab6f-8dacf3b03f12 admin admin] PATH_INFO: `/v3/projects/da7b4082ebfa42258189edc05abc4616/users/a059faa69d5844a9a3c5cd281f7eecf9/roles/efa0e5b3413748dc828a89b12d67df79` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:53:13.116708 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f5d6d9-3cf5-46f7-ab6f-8dacf3b03f12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da7b4082ebfa42258189edc05abc4616, user_id=a059faa69d5844a9a3c5cd281f7eecf9, role_id=efa0e5b3413748dc828a89b12d67df79)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:53:13.117760 dv-cinder-756711-11-smb devstack@keystone.service[81452]: WARNING py.warnings [None req-82f5d6d9-3cf5-46f7-ab6f-8dacf3b03f12 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 19 14:53:13.117760 dv-cinder-756711-11-smb devstack@keystone.service[81452]: warnings.warn(msg) Sep 19 14:53:13.117760 dv-cinder-756711-11-smb devstack@keystone.service[81452]: Sep 19 14:53:13.120272 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f5d6d9-3cf5-46f7-ab6f-8dacf3b03f12 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:53:13.145540 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 756/1501] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 14:53:12 2022] PUT /identity/v3/projects/da7b4082ebfa42258189edc05abc4616/users/a059faa69d5844a9a3c5cd281f7eecf9/roles/efa0e5b3413748dc828a89b12d67df79 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:53:13.157972 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d01c14-262f-4a0d-ab94-18b078e14563 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:53:13.158265 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d01c14-262f-4a0d-ab94-18b078e14563 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:53:13.158546 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d01c14-262f-4a0d-ab94-18b078e14563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:53:13.220394 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-83d01c14-262f-4a0d-ab94-18b078e14563 None None] MFA Rules not processed for user `a059faa69d5844a9a3c5cd281f7eecf9`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:53:13.221890 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-83d01c14-262f-4a0d-ab94-18b078e14563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:53:13.297989 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 746/1502] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:53:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:53:13.311981 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a0990-7bdb-4db6-b438-9c8a559442b2 None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:53:13.312269 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a0990-7bdb-4db6-b438-9c8a559442b2 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:53:13.312603 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a0990-7bdb-4db6-b438-9c8a559442b2 None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:53:13.313950 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 757/1503] 10.222.0.72 () {54 vars in 962 bytes} [Mon Sep 19 14:53:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:53:13.319634 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bfbad9-bd81-4201-b2f1-d507ff187133 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:53:13.319956 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bfbad9-bd81-4201-b2f1-d507ff187133 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:53:13.320235 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bfbad9-bd81-4201-b2f1-d507ff187133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:53:13.352647 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:53:13.398362 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-38bfbad9-bd81-4201-b2f1-d507ff187133 None None] MFA Rules not processed for user `139dc7a4f1dc48fe8faea848bd1ac0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:53:13.399545 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-38bfbad9-bd81-4201-b2f1-d507ff187133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:53:13.474451 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 747/1504] 10.222.0.72 () {58 vars in 1059 bytes} [Mon Sep 19 14:53:13 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:53:13.482409 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655a0990-7bdb-4db6-b438-9c8a559442b2 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:53:13.483744 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-655a0990-7bdb-4db6-b438-9c8a559442b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:53:13.534160 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:53:13.590220 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655a0990-7bdb-4db6-b438-9c8a559442b2 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:53:13.666923 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a06c76-319a-4f94-9a58-328a75b127f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139dc7a4f1dc48fe8faea848bd1ac0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:53:13.667540 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a06c76-319a-4f94-9a58-328a75b127f9 service cinder] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:53:13.667823 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a06c76-319a-4f94-9a58-328a75b127f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:53:13.668098 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a06c76-319a-4f94-9a58-328a75b127f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:53:13.669759 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-95a06c76-319a-4f94-9a58-328a75b127f9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:53:13.770495 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a06c76-319a-4f94-9a58-328a75b127f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:53:13.771874 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a06c76-319a-4f94-9a58-328a75b127f9 service cinder] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:53:13.775361 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:53:13.790749 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 758/1505] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:53:13 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:53:13.836690 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f0d286-088f-4bce-87a4-946fe0dd5019 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:53:13.837122 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f0d286-088f-4bce-87a4-946fe0dd5019 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:53:13.837232 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f0d286-088f-4bce-87a4-946fe0dd5019 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:53:13.838506 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 748/1506] 10.222.0.72 () {52 vars in 830 bytes} [Mon Sep 19 14:53:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:53:13.842078 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a06c76-319a-4f94-9a58-328a75b127f9 service cinder] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:53:13.843298 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-95a06c76-319a-4f94-9a58-328a75b127f9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:53:13.945375 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a06c76-319a-4f94-9a58-328a75b127f9 service cinder] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:53:14.037245 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d540c4-c055-44ee-ba65-e77ca724747e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:53:14.037884 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d540c4-c055-44ee-ba65-e77ca724747e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:53:14.038046 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d540c4-c055-44ee-ba65-e77ca724747e admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:53:14.038318 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d540c4-c055-44ee-ba65-e77ca724747e admin admin] PATH_INFO: `/v3/users/a059faa69d5844a9a3c5cd281f7eecf9` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:53:14.051831 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d540c4-c055-44ee-ba65-e77ca724747e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a059faa69d5844a9a3c5cd281f7eecf9)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:53:14.052861 dv-cinder-756711-11-smb devstack@keystone.service[81452]: WARNING py.warnings [None req-f7d540c4-c055-44ee-ba65-e77ca724747e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 19 14:53:14.052861 dv-cinder-756711-11-smb devstack@keystone.service[81452]: warnings.warn(msg) Sep 19 14:53:14.052861 dv-cinder-756711-11-smb devstack@keystone.service[81452]: Sep 19 14:53:14.054072 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d540c4-c055-44ee-ba65-e77ca724747e admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:53:14.063618 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:53:14.119938 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-f7d540c4-c055-44ee-ba65-e77ca724747e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a059faa69d5844a9a3c5cd281f7eecf9'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:53:14.144754 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-f7d540c4-c055-44ee-ba65-e77ca724747e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a059faa69d5844a9a3c5cd281f7eecf9'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:53:14.159562 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-f7d540c4-c055-44ee-ba65-e77ca724747e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a059faa69d5844a9a3c5cd281f7eecf9'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:53:14.160042 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-f7d540c4-c055-44ee-ba65-e77ca724747e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a059faa69d5844a9a3c5cd281f7eecf9'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:53:14.169707 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-f7d540c4-c055-44ee-ba65-e77ca724747e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a059faa69d5844a9a3c5cd281f7eecf9'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:53:14.176156 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 759/1507] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Sep 19 14:53:13 2022] DELETE /identity/v3/users/a059faa69d5844a9a3c5cd281f7eecf9 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:53:14.180581 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0766522-8763-49f2-9d28-99fc38c71597 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:53:14.180871 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0766522-8763-49f2-9d28-99fc38c71597 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:53:14.181166 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0766522-8763-49f2-9d28-99fc38c71597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:53:14.237646 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-d0766522-8763-49f2-9d28-99fc38c71597 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:53:14.238859 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-d0766522-8763-49f2-9d28-99fc38c71597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:53:14.312881 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:53:14.326177 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 749/1508] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:53:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:53:14.336312 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d540c4-c055-44ee-ba65-e77ca724747e admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:53:14.337623 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-f7d540c4-c055-44ee-ba65-e77ca724747e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:53:14.437594 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d540c4-c055-44ee-ba65-e77ca724747e admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:53:14.494177 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:53:14.514063 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96084cc-e8c2-46a2-a5a2-41894c0c2403 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c2b78646374cb79ded4b7b59ba49c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:53:14.514663 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96084cc-e8c2-46a2-a5a2-41894c0c2403 service neutron] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:53:14.514938 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96084cc-e8c2-46a2-a5a2-41894c0c2403 service neutron] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:53:14.515204 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96084cc-e8c2-46a2-a5a2-41894c0c2403 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:53:14.516851 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-a96084cc-e8c2-46a2-a5a2-41894c0c2403 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:53:14.625025 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96084cc-e8c2-46a2-a5a2-41894c0c2403 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:53:14.626380 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96084cc-e8c2-46a2-a5a2-41894c0c2403 service neutron] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:53:14.645218 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 760/1509] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:53:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:53:14.998618 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0766522-8763-49f2-9d28-99fc38c71597 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:53:14.999946 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-d0766522-8763-49f2-9d28-99fc38c71597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:53:15.012660 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0766522-8763-49f2-9d28-99fc38c71597 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:53:15.116461 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee0b089-3fcf-4946-9127-d855a9f22984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:53:15.117089 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee0b089-3fcf-4946-9127-d855a9f22984 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:53:15.117366 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee0b089-3fcf-4946-9127-d855a9f22984 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:53:15.117635 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee0b089-3fcf-4946-9127-d855a9f22984 admin admin] PATH_INFO: `/v3/projects/da7b4082ebfa42258189edc05abc4616` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:53:15.127543 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee0b089-3fcf-4946-9127-d855a9f22984 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da7b4082ebfa42258189edc05abc4616)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:53:15.128533 dv-cinder-756711-11-smb devstack@keystone.service[81451]: WARNING py.warnings [None req-1ee0b089-3fcf-4946-9127-d855a9f22984 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 19 14:53:15.128533 dv-cinder-756711-11-smb devstack@keystone.service[81451]: warnings.warn(msg) Sep 19 14:53:15.128533 dv-cinder-756711-11-smb devstack@keystone.service[81451]: Sep 19 14:53:15.129721 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee0b089-3fcf-4946-9127-d855a9f22984 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:53:15.187873 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-1ee0b089-3fcf-4946-9127-d855a9f22984 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da7b4082ebfa42258189edc05abc4616', 'request_id': 'req-1ee0b089-3fcf-4946-9127-d855a9f22984'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:53:15.197705 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-1ee0b089-3fcf-4946-9127-d855a9f22984 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da7b4082ebfa42258189edc05abc4616', 'request_id': 'req-1ee0b089-3fcf-4946-9127-d855a9f22984'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:53:15.203751 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-1ee0b089-3fcf-4946-9127-d855a9f22984 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da7b4082ebfa42258189edc05abc4616', 'request_id': 'req-1ee0b089-3fcf-4946-9127-d855a9f22984'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:53:15.233192 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-1ee0b089-3fcf-4946-9127-d855a9f22984 admin admin] The token cache is being invalidate because project da7b4082ebfa42258189edc05abc4616 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 14:53:15.233478 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-1ee0b089-3fcf-4946-9127-d855a9f22984 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:53:15.233905 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-1ee0b089-3fcf-4946-9127-d855a9f22984 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:53:15.235277 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 750/1510] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Sep 19 14:53:14 2022] DELETE /identity/v3/projects/da7b4082ebfa42258189edc05abc4616 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:53:24.643019 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=62 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:53:25.231136 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:54:55.071947 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c8cf8e-c9da-4152-b317-7e14f5e14ce5 None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:54:55.072587 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c8cf8e-c9da-4152-b317-7e14f5e14ce5 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:54:55.072923 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c8cf8e-c9da-4152-b317-7e14f5e14ce5 None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:54:55.075409 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 761/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 14:54:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:54:55.081209 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca42caf5-e0ff-498a-bb16-7b6fbe6fb2fa None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:54:55.081667 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca42caf5-e0ff-498a-bb16-7b6fbe6fb2fa None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:54:55.081783 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca42caf5-e0ff-498a-bb16-7b6fbe6fb2fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:54:55.164460 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-ca42caf5-e0ff-498a-bb16-7b6fbe6fb2fa None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:54:55.165461 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-ca42caf5-e0ff-498a-bb16-7b6fbe6fb2fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:54:55.272673 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 751/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 14:54:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:54:55.452802 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c8cf8e-c9da-4152-b317-7e14f5e14ce5 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:54:55.455118 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-40c8cf8e-c9da-4152-b317-7e14f5e14ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:54:55.582589 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c8cf8e-c9da-4152-b317-7e14f5e14ce5 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:54:55.589007 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd79718a-a4e4-4ba9-a027-2977c6a3ce66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055439dc35e946f4a82535c684f9b60d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:54:55.589663 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd79718a-a4e4-4ba9-a027-2977c6a3ce66 service nova] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:54:55.590052 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd79718a-a4e4-4ba9-a027-2977c6a3ce66 service nova] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:54:55.590260 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd79718a-a4e4-4ba9-a027-2977c6a3ce66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:54:55.600883 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd79718a-a4e4-4ba9-a027-2977c6a3ce66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:54:55.603205 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd79718a-a4e4-4ba9-a027-2977c6a3ce66 service nova] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:54:55.614941 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 762/1513] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:54:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:54:56.806447 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aed81c-79c0-46ae-8800-0991b1fea0ac None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:54:56.807021 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aed81c-79c0-46ae-8800-0991b1fea0ac None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:54:56.807021 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aed81c-79c0-46ae-8800-0991b1fea0ac None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:54:56.808437 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 752/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 14:54:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:54:56.815389 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f800e-57b9-41ea-8e94-601f604b8623 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:54:56.816046 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f800e-57b9-41ea-8e94-601f604b8623 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:54:56.816046 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f800e-57b9-41ea-8e94-601f604b8623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:54:56.837283 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-d95f800e-57b9-41ea-8e94-601f604b8623 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:54:56.838431 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-d95f800e-57b9-41ea-8e94-601f604b8623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:54:56.846705 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 763/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 14:54:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:54:57.002387 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aed81c-79c0-46ae-8800-0991b1fea0ac None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:54:57.016955 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aed81c-79c0-46ae-8800-0991b1fea0ac None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:54:57.024453 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c24af1c-9e1b-4df3-952a-f8352ad7fc1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055439dc35e946f4a82535c684f9b60d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:54:57.025164 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c24af1c-9e1b-4df3-952a-f8352ad7fc1d service nova] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:54:57.025651 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c24af1c-9e1b-4df3-952a-f8352ad7fc1d service nova] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:54:57.025965 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c24af1c-9e1b-4df3-952a-f8352ad7fc1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:54:57.034818 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c24af1c-9e1b-4df3-952a-f8352ad7fc1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:54:57.036433 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c24af1c-9e1b-4df3-952a-f8352ad7fc1d service nova] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:54:57.046434 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 753/1516] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:54:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:54:57.246647 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b668b14c-9198-4ba3-baa9-32454117abd1 None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:54:57.246929 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b668b14c-9198-4ba3-baa9-32454117abd1 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:54:57.247205 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b668b14c-9198-4ba3-baa9-32454117abd1 None None] PATH_INFO: `/v3` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:54:57.248552 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 764/1517] 10.222.0.85 () {54 vars in 925 bytes} [Mon Sep 19 14:54:57 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:54:57.272441 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d76bc97-436a-4ed2-95af-b65a0e4c7371 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:54:57.272728 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d76bc97-436a-4ed2-95af-b65a0e4c7371 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:54:57.273002 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d76bc97-436a-4ed2-95af-b65a0e4c7371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:54:57.333718 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-3d76bc97-436a-4ed2-95af-b65a0e4c7371 None None] MFA Rules not processed for user `51e7a0148db8462b8ba24bac6dd15298`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:54:57.334841 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-3d76bc97-436a-4ed2-95af-b65a0e4c7371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:54:57.351962 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:54:57.406952 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 754/1518] 10.222.0.85 () {58 vars in 1015 bytes} [Mon Sep 19 14:54:57 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 14:55:01.073711 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e539d39a-f3c1-4394-b5ba-f35ae9df6227 None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:01.074152 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e539d39a-f3c1-4394-b5ba-f35ae9df6227 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:01.074289 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e539d39a-f3c1-4394-b5ba-f35ae9df6227 None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:01.075606 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 765/1519] 10.222.0.72 () {54 vars in 961 bytes} [Mon Sep 19 14:55:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:55:01.081127 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1947d8e-91c7-4a18-a0df-f1f60e8bc583 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:01.081532 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1947d8e-91c7-4a18-a0df-f1f60e8bc583 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:01.081687 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1947d8e-91c7-4a18-a0df-f1f60e8bc583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:01.101543 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-f1947d8e-91c7-4a18-a0df-f1f60e8bc583 None None] MFA Rules not processed for user `51e7a0148db8462b8ba24bac6dd15298`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:55:01.102739 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-f1947d8e-91c7-4a18-a0df-f1f60e8bc583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:01.111440 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 755/1520] 10.222.0.72 () {58 vars in 1058 bytes} [Mon Sep 19 14:55:01 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:55:01.118793 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e539d39a-f3c1-4394-b5ba-f35ae9df6227 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:01.133025 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e539d39a-f3c1-4394-b5ba-f35ae9df6227 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:01.138624 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5a8eff-7d4b-4dd4-b104-8b19d1e87e56 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e7a0148db8462b8ba24bac6dd15298', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:01.139214 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5a8eff-7d4b-4dd4-b104-8b19d1e87e56 service placement] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:01.139487 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5a8eff-7d4b-4dd4-b104-8b19d1e87e56 service placement] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:01.139759 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5a8eff-7d4b-4dd4-b104-8b19d1e87e56 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:01.149117 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5a8eff-7d4b-4dd4-b104-8b19d1e87e56 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:01.150682 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5a8eff-7d4b-4dd4-b104-8b19d1e87e56 service placement] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:01.160751 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 766/1521] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:55:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:55:08.547933 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad186e-c6ee-4d25-9d56-de87793d2d2a None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:08.548543 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad186e-c6ee-4d25-9d56-de87793d2d2a None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:08.548543 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad186e-c6ee-4d25-9d56-de87793d2d2a None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:08.551653 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 756/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 14:55:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:55:08.558192 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f18e3c-9a87-489d-b728-b578959501d7 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:08.558695 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f18e3c-9a87-489d-b728-b578959501d7 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:08.558817 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f18e3c-9a87-489d-b728-b578959501d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:08.579178 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-c5f18e3c-9a87-489d-b728-b578959501d7 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:55:08.580939 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-c5f18e3c-9a87-489d-b728-b578959501d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:08.588974 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 767/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 14:55:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:55:08.744090 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aad186e-c6ee-4d25-9d56-de87793d2d2a None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:08.759603 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aad186e-c6ee-4d25-9d56-de87793d2d2a None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:08.765092 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2708fd-740c-49b4-95e8-1e09f4b9c475 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055439dc35e946f4a82535c684f9b60d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:08.765685 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2708fd-740c-49b4-95e8-1e09f4b9c475 service nova] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:08.765968 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2708fd-740c-49b4-95e8-1e09f4b9c475 service nova] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:08.766243 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2708fd-740c-49b4-95e8-1e09f4b9c475 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:08.774980 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2708fd-740c-49b4-95e8-1e09f4b9c475 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:08.776588 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2708fd-740c-49b4-95e8-1e09f4b9c475 service nova] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:08.786291 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 757/1524] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:55:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:55:09.872130 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f186a5-5754-4b9e-9a72-cd8b16ace6b3 None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:09.872673 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f186a5-5754-4b9e-9a72-cd8b16ace6b3 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:09.872673 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f186a5-5754-4b9e-9a72-cd8b16ace6b3 None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:09.873958 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 768/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 14:55:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:55:09.880275 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509f136e-ee57-4a3d-a4d6-b60c3e872381 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:09.880748 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509f136e-ee57-4a3d-a4d6-b60c3e872381 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:09.880843 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509f136e-ee57-4a3d-a4d6-b60c3e872381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:09.902087 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-509f136e-ee57-4a3d-a4d6-b60c3e872381 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:55:09.903290 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-509f136e-ee57-4a3d-a4d6-b60c3e872381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:09.912173 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 758/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 14:55:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:55:10.064813 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f186a5-5754-4b9e-9a72-cd8b16ace6b3 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:10.079362 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f186a5-5754-4b9e-9a72-cd8b16ace6b3 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:10.085405 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b988e2-3215-4b3d-a94a-3de9cdfc673b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055439dc35e946f4a82535c684f9b60d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:10.085991 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b988e2-3215-4b3d-a94a-3de9cdfc673b service nova] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:10.086270 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b988e2-3215-4b3d-a94a-3de9cdfc673b service nova] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:10.086541 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b988e2-3215-4b3d-a94a-3de9cdfc673b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:10.094600 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b988e2-3215-4b3d-a94a-3de9cdfc673b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:10.096759 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b988e2-3215-4b3d-a94a-3de9cdfc673b service nova] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:10.107184 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 769/1527] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:55:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:55:14.424748 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a55c79-8f7d-4c04-91a9-aa837cca2ab3 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:14.425347 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a55c79-8f7d-4c04-91a9-aa837cca2ab3 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:14.425347 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a55c79-8f7d-4c04-91a9-aa837cca2ab3 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:14.426635 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 759/1528] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 14:55:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:55:14.431815 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7655c9db-3411-43ec-950d-c3da399eb884 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:14.432238 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7655c9db-3411-43ec-950d-c3da399eb884 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:14.432383 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7655c9db-3411-43ec-950d-c3da399eb884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:14.451790 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-7655c9db-3411-43ec-950d-c3da399eb884 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:55:14.453006 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-7655c9db-3411-43ec-950d-c3da399eb884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:14.461177 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 770/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 14:55:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:55:14.746395 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a55c79-8f7d-4c04-91a9-aa837cca2ab3 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:14.748145 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-72a55c79-8f7d-4c04-91a9-aa837cca2ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:14.826071 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a55c79-8f7d-4c04-91a9-aa837cca2ab3 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:14.829700 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f894e6-494f-424c-9ae6-06409052056b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c2b78646374cb79ded4b7b59ba49c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:14.830303 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f894e6-494f-424c-9ae6-06409052056b service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:14.830608 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f894e6-494f-424c-9ae6-06409052056b service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:14.830888 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f894e6-494f-424c-9ae6-06409052056b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:14.839792 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f894e6-494f-424c-9ae6-06409052056b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:14.841392 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f894e6-494f-424c-9ae6-06409052056b service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:14.851364 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 760/1530] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:55:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:55:17.014678 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b80744-997f-4acd-983f-2d9f9f08462d None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:17.015292 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b80744-997f-4acd-983f-2d9f9f08462d None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:17.015292 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b80744-997f-4acd-983f-2d9f9f08462d None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:17.016582 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 771/1531] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 14:55:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:55:17.022324 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a570ac5c-7453-4822-8f3b-3f24c555eb3f None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:17.022753 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a570ac5c-7453-4822-8f3b-3f24c555eb3f None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:17.022883 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a570ac5c-7453-4822-8f3b-3f24c555eb3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:17.043107 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-a570ac5c-7453-4822-8f3b-3f24c555eb3f None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:55:17.044406 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-a570ac5c-7453-4822-8f3b-3f24c555eb3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:17.052749 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 761/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 14:55:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:55:17.344493 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b80744-997f-4acd-983f-2d9f9f08462d None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:17.356053 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b80744-997f-4acd-983f-2d9f9f08462d None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:17.359653 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13688bb1-3e2c-47c6-8545-cf32f90a7761 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c2b78646374cb79ded4b7b59ba49c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:17.360235 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13688bb1-3e2c-47c6-8545-cf32f90a7761 service neutron] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:17.360541 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13688bb1-3e2c-47c6-8545-cf32f90a7761 service neutron] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:17.360811 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13688bb1-3e2c-47c6-8545-cf32f90a7761 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:17.369662 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13688bb1-3e2c-47c6-8545-cf32f90a7761 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:17.371075 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13688bb1-3e2c-47c6-8545-cf32f90a7761 service neutron] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:17.381115 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 772/1533] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:55:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:55:21.227504 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac1a5f-e446-4a25-9e2a-d8f7d16f046f None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:21.228042 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac1a5f-e446-4a25-9e2a-d8f7d16f046f None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:21.228042 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac1a5f-e446-4a25-9e2a-d8f7d16f046f None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:21.229444 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 762/1534] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 14:55:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:55:21.234647 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc72bb46-005e-47b9-9564-44c788372efd None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:21.235074 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc72bb46-005e-47b9-9564-44c788372efd None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:21.235200 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc72bb46-005e-47b9-9564-44c788372efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:21.255030 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-cc72bb46-005e-47b9-9564-44c788372efd None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:55:21.256221 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-cc72bb46-005e-47b9-9564-44c788372efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:21.264164 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 773/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 14:55:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:55:21.584929 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ac1a5f-e446-4a25-9e2a-d8f7d16f046f None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:21.586637 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-34ac1a5f-e446-4a25-9e2a-d8f7d16f046f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:21.652804 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:55:21.666785 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ac1a5f-e446-4a25-9e2a-d8f7d16f046f None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:21.670415 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5273f4c8-5aaa-4e50-b470-a38177a36ab3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139dc7a4f1dc48fe8faea848bd1ac0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:21.671012 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5273f4c8-5aaa-4e50-b470-a38177a36ab3 service cinder] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:21.671294 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5273f4c8-5aaa-4e50-b470-a38177a36ab3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:21.671568 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5273f4c8-5aaa-4e50-b470-a38177a36ab3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:21.680778 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5273f4c8-5aaa-4e50-b470-a38177a36ab3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:21.682201 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5273f4c8-5aaa-4e50-b470-a38177a36ab3 service cinder] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:21.691706 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 763/1536] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:55:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:55:23.823827 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3c1b37-9c14-49e1-9bd4-e2837578640f None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:23.824442 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3c1b37-9c14-49e1-9bd4-e2837578640f None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:23.824442 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3c1b37-9c14-49e1-9bd4-e2837578640f None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:23.825645 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 774/1537] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 14:55:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:55:23.831338 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4e9ecf-b61c-4160-b5d8-2760154ff726 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:23.831766 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4e9ecf-b61c-4160-b5d8-2760154ff726 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:23.831922 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4e9ecf-b61c-4160-b5d8-2760154ff726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:23.851861 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-bf4e9ecf-b61c-4160-b5d8-2760154ff726 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:55:23.853092 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-bf4e9ecf-b61c-4160-b5d8-2760154ff726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:23.860875 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 764/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 14:55:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:55:24.166149 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3c1b37-9c14-49e1-9bd4-e2837578640f None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:24.167851 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-4a3c1b37-9c14-49e1-9bd4-e2837578640f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:24.180896 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3c1b37-9c14-49e1-9bd4-e2837578640f None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:24.184513 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa8cc89-0216-4742-8edb-5b577f946697 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139dc7a4f1dc48fe8faea848bd1ac0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:24.185102 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa8cc89-0216-4742-8edb-5b577f946697 service cinder] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:24.185384 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa8cc89-0216-4742-8edb-5b577f946697 service cinder] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:24.185704 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa8cc89-0216-4742-8edb-5b577f946697 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:24.195331 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa8cc89-0216-4742-8edb-5b577f946697 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:24.196769 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa8cc89-0216-4742-8edb-5b577f946697 service cinder] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:24.206563 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 775/1539] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:55:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:55:33.847079 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=11 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:55:34.201939 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=89 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:55.098788 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ded53c3-a578-4784-abbd-281989a1bd3e None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:55.098788 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ded53c3-a578-4784-abbd-281989a1bd3e None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:55.098788 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ded53c3-a578-4784-abbd-281989a1bd3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:55.120739 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-6ded53c3-a578-4784-abbd-281989a1bd3e None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:56:55.121953 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-6ded53c3-a578-4784-abbd-281989a1bd3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:55.136418 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 765/1540] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:56:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:56:55.146447 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c96b761-bf8d-4378-9354-ce55142fdb47 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:55.147331 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c96b761-bf8d-4378-9354-ce55142fdb47 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:55.147331 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c96b761-bf8d-4378-9354-ce55142fdb47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:55.168679 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ede2c31-eb89-4272-842c-d0f8a29b8659 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:55.168882 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ede2c31-eb89-4272-842c-d0f8a29b8659 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:55.169150 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ede2c31-eb89-4272-842c-d0f8a29b8659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:55.181355 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-5c96b761-bf8d-4378-9354-ce55142fdb47 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:56:55.182813 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-5c96b761-bf8d-4378-9354-ce55142fdb47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:55.201801 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 776/1541] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:56:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:56:55.203925 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780c8b98-71c8-4114-9233-0a9674f9120c None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:55.204556 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780c8b98-71c8-4114-9233-0a9674f9120c None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:55.205129 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780c8b98-71c8-4114-9233-0a9674f9120c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:55.205419 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-9ede2c31-eb89-4272-842c-d0f8a29b8659 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:56:55.206912 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-9ede2c31-eb89-4272-842c-d0f8a29b8659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:55.231284 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 766/1542] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:56:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:56:55.232927 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10113141-59c7-4ad8-9954-09174ba1e2ee None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:55.233458 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10113141-59c7-4ad8-9954-09174ba1e2ee None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:55.233960 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10113141-59c7-4ad8-9954-09174ba1e2ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:55.234188 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-780c8b98-71c8-4114-9233-0a9674f9120c None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:56:55.240358 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-780c8b98-71c8-4114-9233-0a9674f9120c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:55.252249 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 777/1543] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:56:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:56:55.253448 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780c8b98-71c8-4114-9233-0a9674f9120c None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:55.263383 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780c8b98-71c8-4114-9233-0a9674f9120c None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:55.273584 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-10113141-59c7-4ad8-9954-09174ba1e2ee None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:56:55.275834 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-10113141-59c7-4ad8-9954-09174ba1e2ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:55.276680 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaf0014-de05-4543-92f6-cc6171932222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:55.278380 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaf0014-de05-4543-92f6-cc6171932222 admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:55.278882 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaf0014-de05-4543-92f6-cc6171932222 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:55.280310 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaf0014-de05-4543-92f6-cc6171932222 admin admin] PATH_INFO: `/v3/domains` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:55.281209 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaf0014-de05-4543-92f6-cc6171932222 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:56:55.282120 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaf0014-de05-4543-92f6-cc6171932222 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:55.283813 dv-cinder-756711-11-smb devstack@keystone.service[81452]: WARNING py.warnings [None req-deaf0014-de05-4543-92f6-cc6171932222 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 19 14:56:55.283813 dv-cinder-756711-11-smb devstack@keystone.service[81452]: warnings.warn(msg) Sep 19 14:56:55.283813 dv-cinder-756711-11-smb devstack@keystone.service[81452]: Sep 19 14:56:55.285660 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaf0014-de05-4543-92f6-cc6171932222 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:55.293648 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 767/1544] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:56:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:56:55.295342 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f88750f-1154-4677-84b9-7926a46363c3 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:55.295834 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f88750f-1154-4677-84b9-7926a46363c3 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:55.296317 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f88750f-1154-4677-84b9-7926a46363c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:55.307219 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 778/1545] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Sep 19 14:56:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:56:55.309990 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc204f-a8f7-414e-ba90-97f65465d147 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:55.312025 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc204f-a8f7-414e-ba90-97f65465d147 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:55.314280 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc204f-a8f7-414e-ba90-97f65465d147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:55.327144 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-2f88750f-1154-4677-84b9-7926a46363c3 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:56:55.328965 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-2f88750f-1154-4677-84b9-7926a46363c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:55.338115 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 768/1546] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:56:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:56:55.338668 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-cdcc204f-a8f7-414e-ba90-97f65465d147 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:56:55.339907 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a35903-e15b-443b-8d23-95078095e396 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:55.340064 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-cdcc204f-a8f7-414e-ba90-97f65465d147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:55.340544 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a35903-e15b-443b-8d23-95078095e396 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:55.341075 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a35903-e15b-443b-8d23-95078095e396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:55.349984 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 779/1547] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:56:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:56:55.352451 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81893711-3d28-4f6c-9eff-87c067c2ab7c None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:55.352745 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81893711-3d28-4f6c-9eff-87c067c2ab7c None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:55.353023 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81893711-3d28-4f6c-9eff-87c067c2ab7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:55.363245 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-a2a35903-e15b-443b-8d23-95078095e396 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:56:55.364448 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-a2a35903-e15b-443b-8d23-95078095e396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:55.372361 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 769/1548] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:56:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:56:55.372817 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-81893711-3d28-4f6c-9eff-87c067c2ab7c None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:56:55.373541 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d19e7a9-6f60-4077-a092-59fc6a18a314 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:55.373824 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d19e7a9-6f60-4077-a092-59fc6a18a314 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:55.374002 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-81893711-3d28-4f6c-9eff-87c067c2ab7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:55.374135 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d19e7a9-6f60-4077-a092-59fc6a18a314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:55.382406 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 780/1549] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:56:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:56:55.383162 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81893711-3d28-4f6c-9eff-87c067c2ab7c None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:55.392799 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81893711-3d28-4f6c-9eff-87c067c2ab7c None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:55.394318 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-4d19e7a9-6f60-4077-a092-59fc6a18a314 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:56:55.395497 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-4d19e7a9-6f60-4077-a092-59fc6a18a314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:55.397636 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db808e2c-2ff5-4a36-96b8-ddf39b0f4574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:55.398242 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db808e2c-2ff5-4a36-96b8-ddf39b0f4574 admin admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:55.398521 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db808e2c-2ff5-4a36-96b8-ddf39b0f4574 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:55.398793 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db808e2c-2ff5-4a36-96b8-ddf39b0f4574 admin admin] PATH_INFO: `/v3/projects` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:55.399417 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db808e2c-2ff5-4a36-96b8-ddf39b0f4574 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:55.401382 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db808e2c-2ff5-4a36-96b8-ddf39b0f4574 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:55.403202 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 770/1550] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:56:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:56:55.404442 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8ebc1f-8527-46a7-a5cb-0c2cc5a37061 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:55.404834 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8ebc1f-8527-46a7-a5cb-0c2cc5a37061 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:55.405045 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8ebc1f-8527-46a7-a5cb-0c2cc5a37061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:55.424231 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-9d8ebc1f-8527-46a7-a5cb-0c2cc5a37061 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:56:55.425357 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-9d8ebc1f-8527-46a7-a5cb-0c2cc5a37061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:55.434295 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 771/1551] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:56:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:56:55.435530 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16713243-eaba-4180-a074-1d092ebca784 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:55.435849 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16713243-eaba-4180-a074-1d092ebca784 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:55.436128 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16713243-eaba-4180-a074-1d092ebca784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:55.447978 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 781/1552] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Sep 19 14:56:55 2022] POST /identity/v3/projects => generated 393 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:56:55.449252 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38997fc6-d62d-4410-b02b-142248458692 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:55.449536 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38997fc6-d62d-4410-b02b-142248458692 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:55.449810 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38997fc6-d62d-4410-b02b-142248458692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:55.457920 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-16713243-eaba-4180-a074-1d092ebca784 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:56:55.459130 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-16713243-eaba-4180-a074-1d092ebca784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:55.471435 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-38997fc6-d62d-4410-b02b-142248458692 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:56:55.472645 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-38997fc6-d62d-4410-b02b-142248458692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:55.519507 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 772/1553] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:56:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:56:55.521205 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16713243-eaba-4180-a074-1d092ebca784 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:55.532744 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16713243-eaba-4180-a074-1d092ebca784 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:55.533550 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 782/1554] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:56:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:56:55.534388 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38997fc6-d62d-4410-b02b-142248458692 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:55.540463 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c3ca19-efd4-4a37-b3a5-3ff3c7b34e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:55.541099 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c3ca19-efd4-4a37-b3a5-3ff3c7b34e5e admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:55.541388 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c3ca19-efd4-4a37-b3a5-3ff3c7b34e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:55.541972 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c3ca19-efd4-4a37-b3a5-3ff3c7b34e5e admin admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:55.542658 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c3ca19-efd4-4a37-b3a5-3ff3c7b34e5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:56:55.542964 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c3ca19-efd4-4a37-b3a5-3ff3c7b34e5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:55.544594 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c3ca19-efd4-4a37-b3a5-3ff3c7b34e5e admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:55.545562 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38997fc6-d62d-4410-b02b-142248458692 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:55.550917 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f0c033-d3eb-4999-8b3e-83905e59715b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:55.551507 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f0c033-d3eb-4999-8b3e-83905e59715b admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:55.551786 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f0c033-d3eb-4999-8b3e-83905e59715b admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:55.552051 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f0c033-d3eb-4999-8b3e-83905e59715b admin admin] PATH_INFO: `/v3/domains` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:55.552724 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f0c033-d3eb-4999-8b3e-83905e59715b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:56:55.553025 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f0c033-d3eb-4999-8b3e-83905e59715b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:55.554703 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f0c033-d3eb-4999-8b3e-83905e59715b admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:55.557203 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 773/1555] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Sep 19 14:56:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:56:55.558469 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e09337-9844-4128-b28a-2f79afb83ffe None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:55.559208 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e09337-9844-4128-b28a-2f79afb83ffe None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:55.559208 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e09337-9844-4128-b28a-2f79afb83ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:55.574096 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 783/1556] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Sep 19 14:56:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:56:55.574992 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f0c033-d3eb-4999-8b3e-83905e59715b admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:55.584903 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f0c033-d3eb-4999-8b3e-83905e59715b admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:55.587266 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-39e09337-9844-4128-b28a-2f79afb83ffe None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:56:55.588502 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-39e09337-9844-4128-b28a-2f79afb83ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:55.589506 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa8c078-be01-482b-9381-692c21b9b81d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:55.590089 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa8c078-be01-482b-9381-692c21b9b81d admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:55.590367 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa8c078-be01-482b-9381-692c21b9b81d admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:55.590637 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa8c078-be01-482b-9381-692c21b9b81d admin admin] PATH_INFO: `/v3/domains` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:55.591263 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa8c078-be01-482b-9381-692c21b9b81d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:56:55.591564 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa8c078-be01-482b-9381-692c21b9b81d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:55.593170 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa8c078-be01-482b-9381-692c21b9b81d admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:55.598205 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 774/1557] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:56:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:56:55.599458 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36efaf0a-570d-47a5-812f-73bbf821c157 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:55.599746 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36efaf0a-570d-47a5-812f-73bbf821c157 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:55.600017 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36efaf0a-570d-47a5-812f-73bbf821c157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:55.614635 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 784/1558] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Sep 19 14:56:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:56:55.614635 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa8c078-be01-482b-9381-692c21b9b81d admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:55.620067 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa8c078-be01-482b-9381-692c21b9b81d admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:55.620674 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-36efaf0a-570d-47a5-812f-73bbf821c157 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:56:55.621872 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-36efaf0a-570d-47a5-812f-73bbf821c157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:55.624809 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e116278b-6736-48a6-8b61-b716b26d6d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:55.625392 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e116278b-6736-48a6-8b61-b716b26d6d5b admin admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:55.625668 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e116278b-6736-48a6-8b61-b716b26d6d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:55.625970 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e116278b-6736-48a6-8b61-b716b26d6d5b admin admin] PATH_INFO: `/v3/users` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:55.626583 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e116278b-6736-48a6-8b61-b716b26d6d5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:55.627569 dv-cinder-756711-11-smb devstack@keystone.service[81452]: WARNING py.warnings [None req-e116278b-6736-48a6-8b61-b716b26d6d5b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 19 14:56:55.627569 dv-cinder-756711-11-smb devstack@keystone.service[81452]: warnings.warn(msg) Sep 19 14:56:55.627569 dv-cinder-756711-11-smb devstack@keystone.service[81452]: Sep 19 14:56:55.628790 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e116278b-6736-48a6-8b61-b716b26d6d5b admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:55.629930 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 775/1559] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:56:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:56:55.630545 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36efaf0a-570d-47a5-812f-73bbf821c157 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:55.639834 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36efaf0a-570d-47a5-812f-73bbf821c157 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:55.644688 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ded460-a4f4-446e-b089-4f22628ad52d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:55.645351 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ded460-a4f4-446e-b089-4f22628ad52d admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:55.645666 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ded460-a4f4-446e-b089-4f22628ad52d admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:55.645953 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ded460-a4f4-446e-b089-4f22628ad52d admin admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:55.646536 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ded460-a4f4-446e-b089-4f22628ad52d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:56:55.646826 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ded460-a4f4-446e-b089-4f22628ad52d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:55.648554 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ded460-a4f4-446e-b089-4f22628ad52d admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:55.653012 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 785/1560] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Sep 19 14:56:55 2022] POST /identity/v3/users => generated 297 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:56:55.654341 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea7cb1e-6d6d-4df8-896b-5297e4471629 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:55.654646 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea7cb1e-6d6d-4df8-896b-5297e4471629 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:55.654915 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea7cb1e-6d6d-4df8-896b-5297e4471629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:55.662027 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 776/1561] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Sep 19 14:56:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:56:55.662831 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ded460-a4f4-446e-b089-4f22628ad52d admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:55.674175 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ded460-a4f4-446e-b089-4f22628ad52d admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:55.676666 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-9ea7cb1e-6d6d-4df8-896b-5297e4471629 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:56:55.677898 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-9ea7cb1e-6d6d-4df8-896b-5297e4471629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:55.678903 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7474a2fe-53e7-4f98-bc2e-2c52cd9d8daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:55.679523 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7474a2fe-53e7-4f98-bc2e-2c52cd9d8daa admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:55.679791 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7474a2fe-53e7-4f98-bc2e-2c52cd9d8daa admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:55.680043 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7474a2fe-53e7-4f98-bc2e-2c52cd9d8daa admin admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:55.680697 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7474a2fe-53e7-4f98-bc2e-2c52cd9d8daa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:55.681849 dv-cinder-756711-11-smb devstack@keystone.service[81451]: WARNING py.warnings [None req-7474a2fe-53e7-4f98-bc2e-2c52cd9d8daa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 19 14:56:55.681849 dv-cinder-756711-11-smb devstack@keystone.service[81451]: warnings.warn(msg) Sep 19 14:56:55.681849 dv-cinder-756711-11-smb devstack@keystone.service[81451]: Sep 19 14:56:55.683147 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7474a2fe-53e7-4f98-bc2e-2c52cd9d8daa admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:55.687406 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 786/1562] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:56:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:56:55.688474 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea7cb1e-6d6d-4df8-896b-5297e4471629 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:55.699376 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea7cb1e-6d6d-4df8-896b-5297e4471629 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:55.704491 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b40184-52d5-4281-aabc-2c45e94875c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:55.705114 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b40184-52d5-4281-aabc-2c45e94875c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:55.705398 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b40184-52d5-4281-aabc-2c45e94875c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:55.705670 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b40184-52d5-4281-aabc-2c45e94875c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:55.706301 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b40184-52d5-4281-aabc-2c45e94875c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:55.708203 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b40184-52d5-4281-aabc-2c45e94875c8 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:55.711783 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 777/1563] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Sep 19 14:56:55 2022] POST /identity/v3/projects => generated 361 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:56:55.712736 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7474a2fe-53e7-4f98-bc2e-2c52cd9d8daa admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:55.740457 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 787/1564] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Sep 19 14:56:55 2022] POST /identity/v3/projects => generated 365 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:56:55.740457 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b40184-52d5-4281-aabc-2c45e94875c8 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:55.759512 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:55.768563 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:55.780735 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7474a2fe-53e7-4f98-bc2e-2c52cd9d8daa admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:55.806439 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b40184-52d5-4281-aabc-2c45e94875c8 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:55.811210 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0456281e-2156-4b27-8760-40be9f98fb41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:55.811827 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0456281e-2156-4b27-8760-40be9f98fb41 admin admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:55.812111 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0456281e-2156-4b27-8760-40be9f98fb41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:55.812417 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0456281e-2156-4b27-8760-40be9f98fb41 admin admin] PATH_INFO: `/v3/projects` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:55.813050 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0456281e-2156-4b27-8760-40be9f98fb41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:55.815427 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0456281e-2156-4b27-8760-40be9f98fb41 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:55.838631 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d68b04-ebe8-4e78-9973-faceb6dd3d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:55.839253 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d68b04-ebe8-4e78-9973-faceb6dd3d6b admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:55.839536 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d68b04-ebe8-4e78-9973-faceb6dd3d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:55.839814 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d68b04-ebe8-4e78-9973-faceb6dd3d6b admin admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:55.840493 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d68b04-ebe8-4e78-9973-faceb6dd3d6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:56:55.840800 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d68b04-ebe8-4e78-9973-faceb6dd3d6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:55.842492 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d68b04-ebe8-4e78-9973-faceb6dd3d6b admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:55.842597 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 788/1565] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Sep 19 14:56:55 2022] POST /identity/v3/projects => generated 377 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:56:55.843397 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0456281e-2156-4b27-8760-40be9f98fb41 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:55.855237 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 778/1566] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Sep 19 14:56:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:56:55.856005 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d68b04-ebe8-4e78-9973-faceb6dd3d6b admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:55.866630 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d68b04-ebe8-4e78-9973-faceb6dd3d6b admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:55.926951 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1f98ec-7f2f-4414-bbff-fe022636dbf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:55.927494 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f98ec-7f2f-4414-bbff-fe022636dbf3 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:55.927622 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0456281e-2156-4b27-8760-40be9f98fb41 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:55.927779 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f98ec-7f2f-4414-bbff-fe022636dbf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:55.928059 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f98ec-7f2f-4414-bbff-fe022636dbf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:55.928732 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1f98ec-7f2f-4414-bbff-fe022636dbf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:55.930334 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1f98ec-7f2f-4414-bbff-fe022636dbf3 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:55.932606 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d36eac-b006-47cc-8dc9-7566af6aa026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:55.933240 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d36eac-b006-47cc-8dc9-7566af6aa026 admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:55.933546 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d36eac-b006-47cc-8dc9-7566af6aa026 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:55.933820 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d36eac-b006-47cc-8dc9-7566af6aa026 admin admin] PATH_INFO: `/v3/domains` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:55.934486 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d36eac-b006-47cc-8dc9-7566af6aa026 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:56:55.934793 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d36eac-b006-47cc-8dc9-7566af6aa026 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:55.936405 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d36eac-b006-47cc-8dc9-7566af6aa026 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:55.943722 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 779/1567] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:56:55 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:56:55.943722 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1f98ec-7f2f-4414-bbff-fe022636dbf3 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:55.949579 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 789/1568] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Sep 19 14:56:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:56:55.950945 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d36eac-b006-47cc-8dc9-7566af6aa026 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:55.953398 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1f98ec-7f2f-4414-bbff-fe022636dbf3 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:55.959049 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc75a798-2f25-478a-a958-2ebbc2dfcd9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:55.959650 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc75a798-2f25-478a-a958-2ebbc2dfcd9d admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:55.959931 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc75a798-2f25-478a-a958-2ebbc2dfcd9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:55.960205 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc75a798-2f25-478a-a958-2ebbc2dfcd9d admin admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:55.960876 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc75a798-2f25-478a-a958-2ebbc2dfcd9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:55.961958 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d36eac-b006-47cc-8dc9-7566af6aa026 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:55.962783 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc75a798-2f25-478a-a958-2ebbc2dfcd9d admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:55.966542 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f63f6d4-2627-4bb1-a2a6-6c5319c0e190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:55.967137 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f63f6d4-2627-4bb1-a2a6-6c5319c0e190 admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:55.967413 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f63f6d4-2627-4bb1-a2a6-6c5319c0e190 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:55.967683 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f63f6d4-2627-4bb1-a2a6-6c5319c0e190 admin admin] PATH_INFO: `/v3/domains` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:55.968315 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f63f6d4-2627-4bb1-a2a6-6c5319c0e190 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:56:55.968642 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f63f6d4-2627-4bb1-a2a6-6c5319c0e190 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:55.970918 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f63f6d4-2627-4bb1-a2a6-6c5319c0e190 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:55.982851 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 790/1569] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Sep 19 14:56:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:56:55.983947 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f63f6d4-2627-4bb1-a2a6-6c5319c0e190 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:55.994075 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f63f6d4-2627-4bb1-a2a6-6c5319c0e190 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:55.997106 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 780/1570] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Sep 19 14:56:55 2022] POST /identity/v3/projects => generated 385 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:56:55.997962 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc75a798-2f25-478a-a958-2ebbc2dfcd9d admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:56.001931 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cf7542-29e8-4747-92a0-a338b26050d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:56.002648 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cf7542-29e8-4747-92a0-a338b26050d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:56.002936 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cf7542-29e8-4747-92a0-a338b26050d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:56.003216 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cf7542-29e8-4747-92a0-a338b26050d6 admin admin] PATH_INFO: `/v3/users` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:56.003880 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cf7542-29e8-4747-92a0-a338b26050d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:56.005925 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cf7542-29e8-4747-92a0-a338b26050d6 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:56.033128 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 791/1571] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Sep 19 14:56:55 2022] POST /identity/v3/users => generated 281 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:56:56.033128 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cf7542-29e8-4747-92a0-a338b26050d6 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:56.041102 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cf7542-29e8-4747-92a0-a338b26050d6 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:56.066194 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc75a798-2f25-478a-a958-2ebbc2dfcd9d admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:56.071310 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00cd1b7-2a2e-46b1-992e-d3b7e59c8c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:56.071917 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00cd1b7-2a2e-46b1-992e-d3b7e59c8c5b admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:56.072201 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00cd1b7-2a2e-46b1-992e-d3b7e59c8c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:56.072517 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00cd1b7-2a2e-46b1-992e-d3b7e59c8c5b admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:56.073145 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00cd1b7-2a2e-46b1-992e-d3b7e59c8c5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:56.075070 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00cd1b7-2a2e-46b1-992e-d3b7e59c8c5b admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:56.091453 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:56.098261 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 781/1572] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Sep 19 14:56:55 2022] POST /identity/v3/users => generated 283 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:56:56.099216 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00cd1b7-2a2e-46b1-992e-d3b7e59c8c5b admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:56.103438 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9f67cd-3ae1-4505-8767-f74b28cd66dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:56.104047 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9f67cd-3ae1-4505-8767-f74b28cd66dc admin admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:56.104407 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9f67cd-3ae1-4505-8767-f74b28cd66dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:56.104616 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9f67cd-3ae1-4505-8767-f74b28cd66dc admin admin] PATH_INFO: `/v3/users` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:56.105245 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9f67cd-3ae1-4505-8767-f74b28cd66dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:56.107163 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9f67cd-3ae1-4505-8767-f74b28cd66dc admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:56.109011 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00cd1b7-2a2e-46b1-992e-d3b7e59c8c5b admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:56.113673 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e11690-51c3-4eb3-94bb-7b91dd5d23d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:56.114260 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e11690-51c3-4eb3-94bb-7b91dd5d23d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:56.114538 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e11690-51c3-4eb3-94bb-7b91dd5d23d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:56.114816 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e11690-51c3-4eb3-94bb-7b91dd5d23d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:56.115432 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e11690-51c3-4eb3-94bb-7b91dd5d23d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:56.117360 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e11690-51c3-4eb3-94bb-7b91dd5d23d7 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:56.118469 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:56.128970 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 792/1573] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Sep 19 14:56:56 2022] POST /identity/v3/users => generated 289 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:56:56.129930 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9f67cd-3ae1-4505-8767-f74b28cd66dc admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:56.139767 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9f67cd-3ae1-4505-8767-f74b28cd66dc admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:56.145397 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bbc20b-6a94-4db7-8826-61cef31535d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:56.145991 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bbc20b-6a94-4db7-8826-61cef31535d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:56.146271 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bbc20b-6a94-4db7-8826-61cef31535d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:56.146544 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bbc20b-6a94-4db7-8826-61cef31535d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:56.147184 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bbc20b-6a94-4db7-8826-61cef31535d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:56.148798 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bbc20b-6a94-4db7-8826-61cef31535d7 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:56.150345 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 782/1574] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Sep 19 14:56:56 2022] POST /identity/v3/projects => generated 369 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:56:56.151242 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e11690-51c3-4eb3-94bb-7b91dd5d23d7 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:56.162847 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 793/1575] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:56:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:56:56.163743 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bbc20b-6a94-4db7-8826-61cef31535d7 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:56.173651 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bbc20b-6a94-4db7-8826-61cef31535d7 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:56.213989 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e11690-51c3-4eb3-94bb-7b91dd5d23d7 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:56.218647 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501dfd94-3556-4c57-9c70-f254b9a60954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:56.219255 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501dfd94-3556-4c57-9c70-f254b9a60954 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:56.220202 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501dfd94-3556-4c57-9c70-f254b9a60954 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:56.220528 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501dfd94-3556-4c57-9c70-f254b9a60954 admin admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:56.221156 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501dfd94-3556-4c57-9c70-f254b9a60954 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:56.223062 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501dfd94-3556-4c57-9c70-f254b9a60954 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:56.230226 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074fbe0c-850d-48c9-ae22-afd24902fef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:56.230832 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074fbe0c-850d-48c9-ae22-afd24902fef1 admin admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:56.231112 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074fbe0c-850d-48c9-ae22-afd24902fef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:56.231386 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074fbe0c-850d-48c9-ae22-afd24902fef1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:56.232005 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074fbe0c-850d-48c9-ae22-afd24902fef1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:56.233923 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074fbe0c-850d-48c9-ae22-afd24902fef1 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:56.250048 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 783/1576] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Sep 19 14:56:56 2022] POST /identity/v3/projects => generated 369 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:56:56.251612 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501dfd94-3556-4c57-9c70-f254b9a60954 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:56.267418 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 794/1577] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Sep 19 14:56:56 2022] POST /identity/v3/projects => generated 377 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:56:56.268689 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074fbe0c-850d-48c9-ae22-afd24902fef1 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:56.315169 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501dfd94-3556-4c57-9c70-f254b9a60954 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:56.332126 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074fbe0c-850d-48c9-ae22-afd24902fef1 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:56.337108 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e358a8be-e879-41fd-a2ef-bc94fa36b80b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:56.337716 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e358a8be-e879-41fd-a2ef-bc94fa36b80b admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:56.337993 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e358a8be-e879-41fd-a2ef-bc94fa36b80b admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:56.338261 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e358a8be-e879-41fd-a2ef-bc94fa36b80b admin admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:56.338895 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e358a8be-e879-41fd-a2ef-bc94fa36b80b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:56.340537 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e358a8be-e879-41fd-a2ef-bc94fa36b80b admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:56.350226 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 795/1578] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:56:56 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:56:56.351331 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e358a8be-e879-41fd-a2ef-bc94fa36b80b admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:56.361288 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e358a8be-e879-41fd-a2ef-bc94fa36b80b admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:56.365828 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a7e915-6022-469c-89b4-1046d9e922bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:56.366400 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a7e915-6022-469c-89b4-1046d9e922bf admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:56.366676 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a7e915-6022-469c-89b4-1046d9e922bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:56.366942 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a7e915-6022-469c-89b4-1046d9e922bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:56.367558 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a7e915-6022-469c-89b4-1046d9e922bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:56.369218 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a7e915-6022-469c-89b4-1046d9e922bf admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:56.374149 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854ac03b-f818-44c6-a8e7-64b43cc001e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:56.374748 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854ac03b-f818-44c6-a8e7-64b43cc001e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:56.375044 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854ac03b-f818-44c6-a8e7-64b43cc001e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:56.375316 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854ac03b-f818-44c6-a8e7-64b43cc001e3 admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:56.376591 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854ac03b-f818-44c6-a8e7-64b43cc001e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:56.378557 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854ac03b-f818-44c6-a8e7-64b43cc001e3 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:56.379750 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 796/1579] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:56:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:56:56.380587 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a7e915-6022-469c-89b4-1046d9e922bf admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:56.393138 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a7e915-6022-469c-89b4-1046d9e922bf admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:56.395817 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:56.398393 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4600674-a164-4ed9-af47-7c4019e3fb55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:56.398974 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4600674-a164-4ed9-af47-7c4019e3fb55 admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:56.399250 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4600674-a164-4ed9-af47-7c4019e3fb55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:56.399572 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4600674-a164-4ed9-af47-7c4019e3fb55 admin admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:56.400191 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4600674-a164-4ed9-af47-7c4019e3fb55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:56.401894 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4600674-a164-4ed9-af47-7c4019e3fb55 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:56.405812 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 784/1580] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Sep 19 14:56:56 2022] POST /identity/v3/users => generated 293 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:56:56.406469 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854ac03b-f818-44c6-a8e7-64b43cc001e3 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:56.412480 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 797/1581] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:56:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:56:56.413255 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4600674-a164-4ed9-af47-7c4019e3fb55 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:56.418819 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854ac03b-f818-44c6-a8e7-64b43cc001e3 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:56.422707 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4600674-a164-4ed9-af47-7c4019e3fb55 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:56.423843 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8779ea-b37e-4e97-b2fb-f80b413c5a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:56.424482 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8779ea-b37e-4e97-b2fb-f80b413c5a8e admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:56.424766 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8779ea-b37e-4e97-b2fb-f80b413c5a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:56.425041 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8779ea-b37e-4e97-b2fb-f80b413c5a8e admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:56.425669 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8779ea-b37e-4e97-b2fb-f80b413c5a8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:56.427349 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e44798-34a3-481e-a91d-3e7be6cc8575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:56.427658 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8779ea-b37e-4e97-b2fb-f80b413c5a8e admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:56.427983 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e44798-34a3-481e-a91d-3e7be6cc8575 admin admin] REQUEST_METHOD: `PUT` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:56.428260 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e44798-34a3-481e-a91d-3e7be6cc8575 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:56.428564 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e44798-34a3-481e-a91d-3e7be6cc8575 admin admin] PATH_INFO: `/v3/projects/624b56d7e2a646179bdf35f82a23b32e/users/56875d0b48a04325a01d0d999ad186ba/roles/efa0e5b3413748dc828a89b12d67df79` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:56.444577 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e44798-34a3-481e-a91d-3e7be6cc8575 admin admin] RBAC: Authorizing `identity:create_grant(project_id=624b56d7e2a646179bdf35f82a23b32e, user_id=56875d0b48a04325a01d0d999ad186ba, role_id=efa0e5b3413748dc828a89b12d67df79)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:56.447220 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e44798-34a3-481e-a91d-3e7be6cc8575 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:56.451331 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 785/1582] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Sep 19 14:56:56 2022] POST /identity/v3/users => generated 285 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:56:56.452435 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8779ea-b37e-4e97-b2fb-f80b413c5a8e admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:56.462987 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8779ea-b37e-4e97-b2fb-f80b413c5a8e admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:56.464660 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 798/1583] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 14:56:56 2022] PUT /identity/v3/projects/624b56d7e2a646179bdf35f82a23b32e/users/56875d0b48a04325a01d0d999ad186ba/roles/efa0e5b3413748dc828a89b12d67df79 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:56:56.465229 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e44798-34a3-481e-a91d-3e7be6cc8575 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:56.486790 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:56.523123 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f224f49b-3b1c-4654-86bb-42eec4540a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:56.523738 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f224f49b-3b1c-4654-86bb-42eec4540a9e admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:56.524017 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f224f49b-3b1c-4654-86bb-42eec4540a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:56.524294 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f224f49b-3b1c-4654-86bb-42eec4540a9e admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:56.524949 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f224f49b-3b1c-4654-86bb-42eec4540a9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:56.526864 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f224f49b-3b1c-4654-86bb-42eec4540a9e admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:56.537715 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e44798-34a3-481e-a91d-3e7be6cc8575 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:56.542871 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21310b4c-e838-4d6d-8c4c-6e7891de09ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:56.543440 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21310b4c-e838-4d6d-8c4c-6e7891de09ba admin admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:56.543726 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21310b4c-e838-4d6d-8c4c-6e7891de09ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:56.544008 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21310b4c-e838-4d6d-8c4c-6e7891de09ba admin admin] PATH_INFO: `/v3/users` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:56.544680 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21310b4c-e838-4d6d-8c4c-6e7891de09ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:56.546610 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21310b4c-e838-4d6d-8c4c-6e7891de09ba admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:56.551733 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 786/1584] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Sep 19 14:56:56 2022] POST /identity/v3/users => generated 285 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:56:56.551733 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f224f49b-3b1c-4654-86bb-42eec4540a9e admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:56.559408 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f224f49b-3b1c-4654-86bb-42eec4540a9e admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:56.565197 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aa95d0-252d-48ea-b52a-178d65dcbbf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:56.565799 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aa95d0-252d-48ea-b52a-178d65dcbbf5 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:56.566074 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aa95d0-252d-48ea-b52a-178d65dcbbf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:56.566342 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aa95d0-252d-48ea-b52a-178d65dcbbf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:56.566968 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aa95d0-252d-48ea-b52a-178d65dcbbf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:56.568953 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aa95d0-252d-48ea-b52a-178d65dcbbf5 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:56.569366 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 799/1585] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Sep 19 14:56:56 2022] POST /identity/v3/users => generated 289 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:56:56.570110 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21310b4c-e838-4d6d-8c4c-6e7891de09ba admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:56.580454 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21310b4c-e838-4d6d-8c4c-6e7891de09ba admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:56.580700 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 787/1586] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:56:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:56:56.581512 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aa95d0-252d-48ea-b52a-178d65dcbbf5 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:56.587592 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d56b3e-a69f-43a5-adac-8efbafea7291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:56.588199 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d56b3e-a69f-43a5-adac-8efbafea7291 admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:56.588519 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d56b3e-a69f-43a5-adac-8efbafea7291 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:56.588808 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d56b3e-a69f-43a5-adac-8efbafea7291 admin admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:56.589435 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d56b3e-a69f-43a5-adac-8efbafea7291 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:56.591038 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d56b3e-a69f-43a5-adac-8efbafea7291 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:56.591371 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aa95d0-252d-48ea-b52a-178d65dcbbf5 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:56.596632 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26321ddb-daa0-4e10-b039-1e23c32213ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:56.597331 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26321ddb-daa0-4e10-b039-1e23c32213ae admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:56.597642 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26321ddb-daa0-4e10-b039-1e23c32213ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:56.597937 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26321ddb-daa0-4e10-b039-1e23c32213ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:56.598560 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26321ddb-daa0-4e10-b039-1e23c32213ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:56.600121 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26321ddb-daa0-4e10-b039-1e23c32213ae admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:56.602604 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 800/1587] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:56:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:56:56.603588 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d56b3e-a69f-43a5-adac-8efbafea7291 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:56.610357 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 788/1588] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:56:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:56:56.611049 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26321ddb-daa0-4e10-b039-1e23c32213ae admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:56.614761 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d56b3e-a69f-43a5-adac-8efbafea7291 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:56.620192 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7412a12a-024e-4c41-849d-6f7c195bb12a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:56.620376 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26321ddb-daa0-4e10-b039-1e23c32213ae admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:56.621007 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7412a12a-024e-4c41-849d-6f7c195bb12a admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:56.621389 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7412a12a-024e-4c41-849d-6f7c195bb12a admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:56.621779 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7412a12a-024e-4c41-849d-6f7c195bb12a admin admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:56.622513 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7412a12a-024e-4c41-849d-6f7c195bb12a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:56.624386 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7412a12a-024e-4c41-849d-6f7c195bb12a admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:56.624798 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e99484-2516-4359-a9c8-43816b946d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:56.625358 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e99484-2516-4359-a9c8-43816b946d53 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:56.625692 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e99484-2516-4359-a9c8-43816b946d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:56.626584 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e99484-2516-4359-a9c8-43816b946d53 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:56.627305 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e99484-2516-4359-a9c8-43816b946d53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:56.628878 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e99484-2516-4359-a9c8-43816b946d53 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:56.636984 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 801/1589] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:56:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:56:56.638264 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b8b2e9-6c2d-40f9-8189-fb5dd063a989 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:56.638498 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 789/1590] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:56:56 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:56:56.638942 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b8b2e9-6c2d-40f9-8189-fb5dd063a989 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:56.639287 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b8b2e9-6c2d-40f9-8189-fb5dd063a989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:56.641960 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e99484-2516-4359-a9c8-43816b946d53 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:56.651828 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e99484-2516-4359-a9c8-43816b946d53 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:56.656684 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c37f68e-b1d7-4e40-8472-98f6a888be01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:56.657329 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c37f68e-b1d7-4e40-8472-98f6a888be01 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:56.657607 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c37f68e-b1d7-4e40-8472-98f6a888be01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:56.657959 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c37f68e-b1d7-4e40-8472-98f6a888be01 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:56.658622 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c37f68e-b1d7-4e40-8472-98f6a888be01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:56.658974 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-51b8b2e9-6c2d-40f9-8189-fb5dd063a989 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:56:56.660172 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-51b8b2e9-6c2d-40f9-8189-fb5dd063a989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:56.660296 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c37f68e-b1d7-4e40-8472-98f6a888be01 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:56.668383 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 802/1591] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:56:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:56:56.669504 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b8b2e9-6c2d-40f9-8189-fb5dd063a989 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:56.670703 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 790/1592] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:56:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:56:56.671344 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c37f68e-b1d7-4e40-8472-98f6a888be01 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:56.680435 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b8b2e9-6c2d-40f9-8189-fb5dd063a989 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:56.682112 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c37f68e-b1d7-4e40-8472-98f6a888be01 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:56.685292 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005c097f-439f-4ee8-8cc8-e8b1bb1cc922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:56.685878 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c097f-439f-4ee8-8cc8-e8b1bb1cc922 admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:56.686162 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c097f-439f-4ee8-8cc8-e8b1bb1cc922 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:56.686441 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c097f-439f-4ee8-8cc8-e8b1bb1cc922 admin admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:56.687079 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005c097f-439f-4ee8-8cc8-e8b1bb1cc922 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:56.687684 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb7f40c-95b6-4f49-b8c3-2f1f234a94c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:56.688951 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb7f40c-95b6-4f49-b8c3-2f1f234a94c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:56.689249 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb7f40c-95b6-4f49-b8c3-2f1f234a94c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:56.689359 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005c097f-439f-4ee8-8cc8-e8b1bb1cc922 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:56.689524 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb7f40c-95b6-4f49-b8c3-2f1f234a94c9 admin admin] PATH_INFO: `/v3/projects/bed79617045f40769c36c10bb7f0340d/users/2b48fed7cdb5454181609512f3686c03/roles/efa0e5b3413748dc828a89b12d67df79` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:56.699802 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 803/1593] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:56:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:56:56.700715 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005c097f-439f-4ee8-8cc8-e8b1bb1cc922 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:56.704829 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb7f40c-95b6-4f49-b8c3-2f1f234a94c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bed79617045f40769c36c10bb7f0340d, user_id=2b48fed7cdb5454181609512f3686c03, role_id=efa0e5b3413748dc828a89b12d67df79)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:56.705869 dv-cinder-756711-11-smb devstack@keystone.service[81451]: WARNING py.warnings [None req-6cb7f40c-95b6-4f49-b8c3-2f1f234a94c9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 19 14:56:56.705869 dv-cinder-756711-11-smb devstack@keystone.service[81451]: warnings.warn(msg) Sep 19 14:56:56.705869 dv-cinder-756711-11-smb devstack@keystone.service[81451]: Sep 19 14:56:56.707830 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb7f40c-95b6-4f49-b8c3-2f1f234a94c9 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:56.711852 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005c097f-439f-4ee8-8cc8-e8b1bb1cc922 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:56.717289 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba4b2ba-0bd4-4416-b3b6-05603da795d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:56.717852 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba4b2ba-0bd4-4416-b3b6-05603da795d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:56.718134 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba4b2ba-0bd4-4416-b3b6-05603da795d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:56.718406 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba4b2ba-0bd4-4416-b3b6-05603da795d7 admin admin] PATH_INFO: `/v3/projects/8793dca3e0cc42e18890406667917389/users/fb8cdc93f39941b9941b49f50086b9c9/roles/efa0e5b3413748dc828a89b12d67df79` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:56.720810 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 791/1594] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 14:56:56 2022] PUT /identity/v3/projects/bed79617045f40769c36c10bb7f0340d/users/2b48fed7cdb5454181609512f3686c03/roles/efa0e5b3413748dc828a89b12d67df79 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:56:56.721600 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb7f40c-95b6-4f49-b8c3-2f1f234a94c9 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:56.733640 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba4b2ba-0bd4-4416-b3b6-05603da795d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8793dca3e0cc42e18890406667917389, user_id=fb8cdc93f39941b9941b49f50086b9c9, role_id=efa0e5b3413748dc828a89b12d67df79)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:56.736875 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba4b2ba-0bd4-4416-b3b6-05603da795d7 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:56.751390 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 804/1595] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 14:56:56 2022] PUT /identity/v3/projects/8793dca3e0cc42e18890406667917389/users/fb8cdc93f39941b9941b49f50086b9c9/roles/efa0e5b3413748dc828a89b12d67df79 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:56:56.752229 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba4b2ba-0bd4-4416-b3b6-05603da795d7 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:56.800697 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb7f40c-95b6-4f49-b8c3-2f1f234a94c9 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:56.805303 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:56.817443 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba4b2ba-0bd4-4416-b3b6-05603da795d7 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:56.822355 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45da466-27e3-44ee-a0e4-23e3b2600c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:56.823015 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45da466-27e3-44ee-a0e4-23e3b2600c42 admin admin] REQUEST_METHOD: `PUT` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:56.823301 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45da466-27e3-44ee-a0e4-23e3b2600c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:56.823576 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45da466-27e3-44ee-a0e4-23e3b2600c42 admin admin] PATH_INFO: `/v3/projects/0cc13ff8f3da418bb4b298d74f33064a/users/37c6063c794f4bab8f3850b5b8daa47c/roles/efa0e5b3413748dc828a89b12d67df79` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:56.837928 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45da466-27e3-44ee-a0e4-23e3b2600c42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cc13ff8f3da418bb4b298d74f33064a, user_id=37c6063c794f4bab8f3850b5b8daa47c, role_id=efa0e5b3413748dc828a89b12d67df79)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:56.840623 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45da466-27e3-44ee-a0e4-23e3b2600c42 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:56.855257 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 805/1596] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 14:56:56 2022] PUT /identity/v3/projects/0cc13ff8f3da418bb4b298d74f33064a/users/37c6063c794f4bab8f3850b5b8daa47c/roles/efa0e5b3413748dc828a89b12d67df79 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:56:56.855945 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45da466-27e3-44ee-a0e4-23e3b2600c42 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:56.862217 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda40ecf-6918-48f7-a9cf-6764ded8dfdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:56.863026 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda40ecf-6918-48f7-a9cf-6764ded8dfdc admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:56.863313 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda40ecf-6918-48f7-a9cf-6764ded8dfdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:56.863587 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda40ecf-6918-48f7-a9cf-6764ded8dfdc admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:56.864240 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda40ecf-6918-48f7-a9cf-6764ded8dfdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:56.866060 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda40ecf-6918-48f7-a9cf-6764ded8dfdc admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:56.876958 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 792/1597] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:56:56 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:56:56.877684 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda40ecf-6918-48f7-a9cf-6764ded8dfdc admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:56.892411 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda40ecf-6918-48f7-a9cf-6764ded8dfdc admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:56.898296 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:56.932135 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45da466-27e3-44ee-a0e4-23e3b2600c42 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:56.937431 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4a9d99-9b8f-414a-98b9-e897a8bed5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:56.938034 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4a9d99-9b8f-414a-98b9-e897a8bed5c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:56.938411 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4a9d99-9b8f-414a-98b9-e897a8bed5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:56.938711 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4a9d99-9b8f-414a-98b9-e897a8bed5c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:56.939432 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4a9d99-9b8f-414a-98b9-e897a8bed5c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:56.941053 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4a9d99-9b8f-414a-98b9-e897a8bed5c6 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:56.956204 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 806/1598] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:56:56 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:56:56.956204 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4a9d99-9b8f-414a-98b9-e897a8bed5c6 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:56.956525 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8425632-81c0-4093-b15c-83ae1f73fc1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:56.956525 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8425632-81c0-4093-b15c-83ae1f73fc1b admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:56.956525 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8425632-81c0-4093-b15c-83ae1f73fc1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:56.956525 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8425632-81c0-4093-b15c-83ae1f73fc1b admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:56.956852 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8425632-81c0-4093-b15c-83ae1f73fc1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:56.958039 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8425632-81c0-4093-b15c-83ae1f73fc1b admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:56.969072 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 793/1599] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:56:56 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:56:56.970489 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8425632-81c0-4093-b15c-83ae1f73fc1b admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:56.980053 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8425632-81c0-4093-b15c-83ae1f73fc1b admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:56.984888 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ad6f67-4d37-4484-a6f9-69bcb3e19b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:56.985558 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad6f67-4d37-4484-a6f9-69bcb3e19b99 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:56.985997 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad6f67-4d37-4484-a6f9-69bcb3e19b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:56.986276 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad6f67-4d37-4484-a6f9-69bcb3e19b99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:56.986912 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ad6f67-4d37-4484-a6f9-69bcb3e19b99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:56.988659 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ad6f67-4d37-4484-a6f9-69bcb3e19b99 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:56.999112 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 794/1600] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:56:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:56:57.001183 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79ad20c-06d4-4911-80b4-4dbd4af68596 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:57.001478 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79ad20c-06d4-4911-80b4-4dbd4af68596 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:57.001753 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79ad20c-06d4-4911-80b4-4dbd4af68596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:57.013378 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4a9d99-9b8f-414a-98b9-e897a8bed5c6 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:57.017714 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ed965d-36f9-4b22-8dea-a7d4c68487cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c2b78646374cb79ded4b7b59ba49c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:57.018318 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ed965d-36f9-4b22-8dea-a7d4c68487cd service neutron] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:57.018598 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ed965d-36f9-4b22-8dea-a7d4c68487cd service neutron] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:57.018890 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ed965d-36f9-4b22-8dea-a7d4c68487cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:57.028709 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ed965d-36f9-4b22-8dea-a7d4c68487cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:57.029151 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-c79ad20c-06d4-4911-80b4-4dbd4af68596 None None] MFA Rules not processed for user `2b48fed7cdb5454181609512f3686c03`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:56:57.030137 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ed965d-36f9-4b22-8dea-a7d4c68487cd service neutron] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:57.030552 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-c79ad20c-06d4-4911-80b4-4dbd4af68596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:57.040256 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 807/1601] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:56:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:56:57.041487 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77393e0-2ea1-4afa-ba4d-3d110644d5f3 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:57.041794 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77393e0-2ea1-4afa-ba4d-3d110644d5f3 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:57.042139 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77393e0-2ea1-4afa-ba4d-3d110644d5f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:57.071495 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-b77393e0-2ea1-4afa-ba4d-3d110644d5f3 None None] MFA Rules not processed for user `fb8cdc93f39941b9941b49f50086b9c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:56:57.072794 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-b77393e0-2ea1-4afa-ba4d-3d110644d5f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:57.104715 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 795/1602] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:56:56 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:56:57.105977 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb9af22-e27d-4b58-b65b-0a71bb6d3c55 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:57.106263 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb9af22-e27d-4b58-b65b-0a71bb6d3c55 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:57.106537 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb9af22-e27d-4b58-b65b-0a71bb6d3c55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:57.130884 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-3cb9af22-e27d-4b58-b65b-0a71bb6d3c55 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:56:57.132159 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-3cb9af22-e27d-4b58-b65b-0a71bb6d3c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:57.143455 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 796/1603] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:56:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:56:57.144459 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb9af22-e27d-4b58-b65b-0a71bb6d3c55 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:57.156270 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb9af22-e27d-4b58-b65b-0a71bb6d3c55 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:57.157552 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 808/1604] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:56:57 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:56:57.158354 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77393e0-2ea1-4afa-ba4d-3d110644d5f3 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:57.165458 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28c192b-6d1e-4620-a796-a02a3f2d0aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:57.166160 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28c192b-6d1e-4620-a796-a02a3f2d0aa2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:57.166415 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28c192b-6d1e-4620-a796-a02a3f2d0aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:57.166688 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28c192b-6d1e-4620-a796-a02a3f2d0aa2 admin admin] PATH_INFO: `/v3/projects/9bd8640abe3e4e35a4dabd365051929d/users/1a2826168b6c411bb0a6165645ce8219/roles/efa0e5b3413748dc828a89b12d67df79` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:57.170467 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77393e0-2ea1-4afa-ba4d-3d110644d5f3 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:57.178318 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9db6288-a516-4b3f-8196-f512f524c71c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:57.178957 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:57.180319 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9db6288-a516-4b3f-8196-f512f524c71c admin admin] REQUEST_METHOD: `PUT` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:57.180733 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9db6288-a516-4b3f-8196-f512f524c71c admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:57.181071 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9db6288-a516-4b3f-8196-f512f524c71c admin admin] PATH_INFO: `/v3/projects/530e96755e0344a3841dd8c4688f9158/users/b4871720165e426cb9e330590de173cc/roles/efa0e5b3413748dc828a89b12d67df79` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:57.185610 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28c192b-6d1e-4620-a796-a02a3f2d0aa2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bd8640abe3e4e35a4dabd365051929d, user_id=1a2826168b6c411bb0a6165645ce8219, role_id=efa0e5b3413748dc828a89b12d67df79)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:57.188821 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28c192b-6d1e-4620-a796-a02a3f2d0aa2 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:57.205135 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9db6288-a516-4b3f-8196-f512f524c71c admin admin] RBAC: Authorizing `identity:create_grant(project_id=530e96755e0344a3841dd8c4688f9158, user_id=b4871720165e426cb9e330590de173cc, role_id=efa0e5b3413748dc828a89b12d67df79)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:57.216358 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 797/1605] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 14:56:57 2022] PUT /identity/v3/projects/9bd8640abe3e4e35a4dabd365051929d/users/1a2826168b6c411bb0a6165645ce8219/roles/efa0e5b3413748dc828a89b12d67df79 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:56:57.216358 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28c192b-6d1e-4620-a796-a02a3f2d0aa2 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:57.216703 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9db6288-a516-4b3f-8196-f512f524c71c admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:57.228392 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 809/1606] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 14:56:57 2022] PUT /identity/v3/projects/530e96755e0344a3841dd8c4688f9158/users/b4871720165e426cb9e330590de173cc/roles/efa0e5b3413748dc828a89b12d67df79 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:56:57.228392 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9db6288-a516-4b3f-8196-f512f524c71c admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:57.281347 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:57.308468 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28c192b-6d1e-4620-a796-a02a3f2d0aa2 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:57.314732 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5fe572-db26-44dc-9b88-c8d79ee66159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:57.314918 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9db6288-a516-4b3f-8196-f512f524c71c admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:57.315408 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5fe572-db26-44dc-9b88-c8d79ee66159 admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:57.315689 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5fe572-db26-44dc-9b88-c8d79ee66159 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:57.315966 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5fe572-db26-44dc-9b88-c8d79ee66159 admin admin] PATH_INFO: `/v3/projects/d72f295bfa8445a39ba5ed2cb023d221/users/82b2a9118bb4464a9082435c7000e18f/roles/efa0e5b3413748dc828a89b12d67df79` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:57.320931 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d4819f-55ce-4da7-8990-501d90c2cd81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:57.321731 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d4819f-55ce-4da7-8990-501d90c2cd81 admin admin] REQUEST_METHOD: `PUT` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:57.322016 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d4819f-55ce-4da7-8990-501d90c2cd81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:57.322348 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d4819f-55ce-4da7-8990-501d90c2cd81 admin admin] PATH_INFO: `/v3/projects/5e4775dd038348b3aad7b520cc51b194/users/c3773acf65044281ae7837258aefd5ad/roles/efa0e5b3413748dc828a89b12d67df79` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:57.334841 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5fe572-db26-44dc-9b88-c8d79ee66159 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d72f295bfa8445a39ba5ed2cb023d221, user_id=82b2a9118bb4464a9082435c7000e18f, role_id=efa0e5b3413748dc828a89b12d67df79)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:57.338183 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5fe572-db26-44dc-9b88-c8d79ee66159 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:57.339978 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d4819f-55ce-4da7-8990-501d90c2cd81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e4775dd038348b3aad7b520cc51b194, user_id=c3773acf65044281ae7837258aefd5ad, role_id=efa0e5b3413748dc828a89b12d67df79)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:57.344169 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d4819f-55ce-4da7-8990-501d90c2cd81 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:57.354642 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 798/1607] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 14:56:57 2022] PUT /identity/v3/projects/d72f295bfa8445a39ba5ed2cb023d221/users/82b2a9118bb4464a9082435c7000e18f/roles/efa0e5b3413748dc828a89b12d67df79 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:56:57.355220 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5fe572-db26-44dc-9b88-c8d79ee66159 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:57.366298 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 810/1608] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 14:56:57 2022] PUT /identity/v3/projects/5e4775dd038348b3aad7b520cc51b194/users/c3773acf65044281ae7837258aefd5ad/roles/efa0e5b3413748dc828a89b12d67df79 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:56:57.367725 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d4819f-55ce-4da7-8990-501d90c2cd81 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:57.438034 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d4819f-55ce-4da7-8990-501d90c2cd81 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:57.442802 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58e0891-0611-4413-951d-45d0added67e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c2b78646374cb79ded4b7b59ba49c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:57.443671 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e0891-0611-4413-951d-45d0added67e service neutron] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:57.443949 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e0891-0611-4413-951d-45d0added67e service neutron] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:57.444216 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e0891-0611-4413-951d-45d0added67e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:57.456303 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5fe572-db26-44dc-9b88-c8d79ee66159 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:57.524196 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58e0891-0611-4413-951d-45d0added67e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:57.525664 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58e0891-0611-4413-951d-45d0added67e service neutron] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:57.535981 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38824b4a-7208-4fb8-8fe2-fb4354237337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:57.536904 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38824b4a-7208-4fb8-8fe2-fb4354237337 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:57.537047 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 811/1609] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:56:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:56:57.537231 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38824b4a-7208-4fb8-8fe2-fb4354237337 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:57.537628 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38824b4a-7208-4fb8-8fe2-fb4354237337 admin admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:57.538426 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38824b4a-7208-4fb8-8fe2-fb4354237337 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:57.540754 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38824b4a-7208-4fb8-8fe2-fb4354237337 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:57.548407 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58e0891-0611-4413-951d-45d0added67e service neutron] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:57.559653 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58e0891-0611-4413-951d-45d0added67e service neutron] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:57.566254 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f064a0e-95c0-4280-bd98-f6a154272bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:57.567204 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f064a0e-95c0-4280-bd98-f6a154272bb6 admin admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:57.567518 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f064a0e-95c0-4280-bd98-f6a154272bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:57.567787 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f064a0e-95c0-4280-bd98-f6a154272bb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:57.569234 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f064a0e-95c0-4280-bd98-f6a154272bb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:57.571495 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f064a0e-95c0-4280-bd98-f6a154272bb6 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:57.579880 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 799/1610] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Sep 19 14:56:57 2022] POST /identity/v3/projects => generated 365 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:56:57.581453 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a843284b-53ad-4921-a148-9b23629ad1bb None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:57.588799 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a843284b-53ad-4921-a148-9b23629ad1bb None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:57.588799 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a843284b-53ad-4921-a148-9b23629ad1bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:57.591481 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:57.608216 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 812/1611] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Sep 19 14:56:57 2022] POST /identity/v3/projects => generated 363 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:56:57.609481 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59553c9e-2893-44c2-a6d8-da54538aa803 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:57.609767 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59553c9e-2893-44c2-a6d8-da54538aa803 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:57.610625 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59553c9e-2893-44c2-a6d8-da54538aa803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:57.631405 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-a843284b-53ad-4921-a148-9b23629ad1bb None None] MFA Rules not processed for user `1a2826168b6c411bb0a6165645ce8219`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:56:57.633877 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-a843284b-53ad-4921-a148-9b23629ad1bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:57.651366 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-59553c9e-2893-44c2-a6d8-da54538aa803 None None] MFA Rules not processed for user `b4871720165e426cb9e330590de173cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:56:57.653351 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-59553c9e-2893-44c2-a6d8-da54538aa803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:57.699318 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:57.746678 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 813/1612] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:56:57 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:56:57.748083 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d30c008-fd19-4d19-aa16-0f3a54bde301 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:57.748461 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d30c008-fd19-4d19-aa16-0f3a54bde301 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:57.748777 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d30c008-fd19-4d19-aa16-0f3a54bde301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:57.756544 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 800/1613] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:56:57 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:56:57.760806 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2edf5ac-6fd3-4732-8e08-e17d22dca7f8 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:57.761607 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2edf5ac-6fd3-4732-8e08-e17d22dca7f8 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:57.761889 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2edf5ac-6fd3-4732-8e08-e17d22dca7f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:57.790310 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-8d30c008-fd19-4d19-aa16-0f3a54bde301 None None] MFA Rules not processed for user `82b2a9118bb4464a9082435c7000e18f`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:56:57.792645 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-8d30c008-fd19-4d19-aa16-0f3a54bde301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:57.817898 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-f2edf5ac-6fd3-4732-8e08-e17d22dca7f8 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:56:57.822384 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-f2edf5ac-6fd3-4732-8e08-e17d22dca7f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:57.972663 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 814/1614] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:56:57 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:56:57.979332 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d30c008-fd19-4d19-aa16-0f3a54bde301 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:57.995774 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 801/1615] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:56:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:56:57.996841 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2edf5ac-6fd3-4732-8e08-e17d22dca7f8 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:58.023026 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2edf5ac-6fd3-4732-8e08-e17d22dca7f8 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:58.032649 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301bf6ce-418c-4af0-b187-a0319713b7a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:58.033609 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301bf6ce-418c-4af0-b187-a0319713b7a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:58.033829 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301bf6ce-418c-4af0-b187-a0319713b7a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:58.034108 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301bf6ce-418c-4af0-b187-a0319713b7a3 admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:58.034753 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301bf6ce-418c-4af0-b187-a0319713b7a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:58.041648 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301bf6ce-418c-4af0-b187-a0319713b7a3 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:58.073888 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d30c008-fd19-4d19-aa16-0f3a54bde301 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:58.080743 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 802/1616] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Sep 19 14:56:57 2022] POST /identity/v3/users => generated 288 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:56:58.081885 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301bf6ce-418c-4af0-b187-a0319713b7a3 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:58.091655 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade34a2f-e479-415f-9171-a97fbeebbfd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:58.092966 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade34a2f-e479-415f-9171-a97fbeebbfd7 admin admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:58.096138 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade34a2f-e479-415f-9171-a97fbeebbfd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:58.096678 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade34a2f-e479-415f-9171-a97fbeebbfd7 admin admin] PATH_INFO: `/v3/users` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:58.099387 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade34a2f-e479-415f-9171-a97fbeebbfd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:58.106115 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade34a2f-e479-415f-9171-a97fbeebbfd7 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:58.112272 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301bf6ce-418c-4af0-b187-a0319713b7a3 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:58.126220 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dcaec7-9d39-4c3e-a797-bfc5940fa816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:58.127065 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dcaec7-9d39-4c3e-a797-bfc5940fa816 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:58.127349 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dcaec7-9d39-4c3e-a797-bfc5940fa816 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:58.127625 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dcaec7-9d39-4c3e-a797-bfc5940fa816 admin admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:58.131860 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dcaec7-9d39-4c3e-a797-bfc5940fa816 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:58.137646 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dcaec7-9d39-4c3e-a797-bfc5940fa816 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:58.154769 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 815/1617] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Sep 19 14:56:57 2022] POST /identity/v3/users => generated 289 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:56:58.160298 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1d3283-8a19-4996-bf50-9507cd6f0755 None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:58.160934 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1d3283-8a19-4996-bf50-9507cd6f0755 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:58.160934 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1d3283-8a19-4996-bf50-9507cd6f0755 None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:58.164314 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 816/1618] 10.222.0.72 () {54 vars in 965 bytes} [Mon Sep 19 14:56:58 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:56:58.165928 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608f5c9-d205-4a86-9ae4-49458fc8c79c None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:58.166263 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608f5c9-d205-4a86-9ae4-49458fc8c79c None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:58.166543 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608f5c9-d205-4a86-9ae4-49458fc8c79c None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:58.173474 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 817/1619] 10.222.0.72 () {54 vars in 965 bytes} [Mon Sep 19 14:56:58 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:56:58.173784 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1608f5c9-d205-4a86-9ae4-49458fc8c79c None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:58.206371 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 803/1620] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Sep 19 14:56:58 2022] POST /identity/v3/projects => generated 369 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:56:58.206371 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dcaec7-9d39-4c3e-a797-bfc5940fa816 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:58.208991 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1608f5c9-d205-4a86-9ae4-49458fc8c79c None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:58.307646 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dcaec7-9d39-4c3e-a797-bfc5940fa816 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:58.312911 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba845fc-1cc7-4f64-aad4-1794c470af1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c2b78646374cb79ded4b7b59ba49c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:58.313581 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba845fc-1cc7-4f64-aad4-1794c470af1c service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:58.313947 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba845fc-1cc7-4f64-aad4-1794c470af1c service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:58.314173 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba845fc-1cc7-4f64-aad4-1794c470af1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:58.316788 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:58.328285 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:58.338342 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d944f89-9b35-4d2b-a80b-efd79b2b0b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:58.339284 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d944f89-9b35-4d2b-a80b-efd79b2b0b13 admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:58.340491 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d944f89-9b35-4d2b-a80b-efd79b2b0b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:58.341359 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d944f89-9b35-4d2b-a80b-efd79b2b0b13 admin admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:58.342556 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d944f89-9b35-4d2b-a80b-efd79b2b0b13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:58.349428 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d944f89-9b35-4d2b-a80b-efd79b2b0b13 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:58.377376 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 818/1621] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:56:58 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:56:58.378781 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d944f89-9b35-4d2b-a80b-efd79b2b0b13 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:58.403536 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d944f89-9b35-4d2b-a80b-efd79b2b0b13 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:58.411219 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5ef083-cae6-4a04-bbf4-f1ca129c0eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:58.411899 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5ef083-cae6-4a04-bbf4-f1ca129c0eea admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:58.412894 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5ef083-cae6-4a04-bbf4-f1ca129c0eea admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:58.412894 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5ef083-cae6-4a04-bbf4-f1ca129c0eea admin admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:58.414319 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5ef083-cae6-4a04-bbf4-f1ca129c0eea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:58.417138 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5ef083-cae6-4a04-bbf4-f1ca129c0eea admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:58.436592 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 819/1622] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:56:58 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:56:58.438386 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601cee54-559e-4c32-b0ca-029fddd488db None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:58.438699 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601cee54-559e-4c32-b0ca-029fddd488db None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:58.438981 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601cee54-559e-4c32-b0ca-029fddd488db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:58.472597 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba845fc-1cc7-4f64-aad4-1794c470af1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:58.474080 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba845fc-1cc7-4f64-aad4-1794c470af1c service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:58.491873 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-601cee54-559e-4c32-b0ca-029fddd488db None None] MFA Rules not processed for user `055439dc35e946f4a82535c684f9b60d`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:56:58.494029 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-601cee54-559e-4c32-b0ca-029fddd488db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:58.499739 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 804/1623] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:56:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:56:58.501732 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5c7bac-c5bc-44eb-ae3d-036bf6ce2f8a None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:58.502004 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5c7bac-c5bc-44eb-ae3d-036bf6ce2f8a None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:58.502403 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5c7bac-c5bc-44eb-ae3d-036bf6ce2f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:58.552296 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-6c5c7bac-c5bc-44eb-ae3d-036bf6ce2f8a None None] MFA Rules not processed for user `055439dc35e946f4a82535c684f9b60d`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:56:58.555190 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-6c5c7bac-c5bc-44eb-ae3d-036bf6ce2f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:58.652158 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 820/1624] 10.222.0.72 () {58 vars in 1062 bytes} [Mon Sep 19 14:56:58 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:56:58.654770 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601cee54-559e-4c32-b0ca-029fddd488db None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:58.682085 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601cee54-559e-4c32-b0ca-029fddd488db None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:58.690922 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f256f951-40c5-4c65-b4f6-869e9781deef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:58.691952 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f256f951-40c5-4c65-b4f6-869e9781deef admin admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:58.692375 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f256f951-40c5-4c65-b4f6-869e9781deef admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:58.692855 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f256f951-40c5-4c65-b4f6-869e9781deef admin admin] PATH_INFO: `/v3/users` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:58.693906 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f256f951-40c5-4c65-b4f6-869e9781deef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:58.697452 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f256f951-40c5-4c65-b4f6-869e9781deef admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:58.759872 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 821/1625] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Sep 19 14:56:58 2022] POST /identity/v3/users => generated 291 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:56:58.760081 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 805/1626] 10.222.0.72 () {58 vars in 1062 bytes} [Mon Sep 19 14:56:58 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:56:58.760183 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f256f951-40c5-4c65-b4f6-869e9781deef admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:58.762315 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5c7bac-c5bc-44eb-ae3d-036bf6ce2f8a None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:58.780003 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f256f951-40c5-4c65-b4f6-869e9781deef admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:58.788209 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49ca16b-9272-4a8d-ba92-72c4398a7c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:58.789030 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ca16b-9272-4a8d-ba92-72c4398a7c3a admin admin] REQUEST_METHOD: `PUT` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:58.789380 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ca16b-9272-4a8d-ba92-72c4398a7c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:58.789773 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ca16b-9272-4a8d-ba92-72c4398a7c3a admin admin] PATH_INFO: `/v3/projects/93217f5b2c5a459fa5fe2925baa87a2b/users/a440d6e0c088459da9853416fa14a655/roles/ddb643577b2e4e478100ec370decfaeb` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:58.789912 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5c7bac-c5bc-44eb-ae3d-036bf6ce2f8a None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:58.803789 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3094fb5b-e708-4ddd-8ae8-f4877dfa6686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:58.804504 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3094fb5b-e708-4ddd-8ae8-f4877dfa6686 admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:58.804782 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3094fb5b-e708-4ddd-8ae8-f4877dfa6686 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:58.805050 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3094fb5b-e708-4ddd-8ae8-f4877dfa6686 admin admin] PATH_INFO: `/v3/projects/1054c8a9b2cc44e0b11808f376e133ea/users/43eb83ecc1e64399b8fbd413ea0581ec/roles/ddb643577b2e4e478100ec370decfaeb` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:58.811017 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49ca16b-9272-4a8d-ba92-72c4398a7c3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=93217f5b2c5a459fa5fe2925baa87a2b, user_id=a440d6e0c088459da9853416fa14a655, role_id=ddb643577b2e4e478100ec370decfaeb)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:58.816840 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49ca16b-9272-4a8d-ba92-72c4398a7c3a admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:58.836458 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3094fb5b-e708-4ddd-8ae8-f4877dfa6686 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1054c8a9b2cc44e0b11808f376e133ea, user_id=43eb83ecc1e64399b8fbd413ea0581ec, role_id=ddb643577b2e4e478100ec370decfaeb)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:58.840410 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 822/1627] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 14:56:58 2022] PUT /identity/v3/projects/93217f5b2c5a459fa5fe2925baa87a2b/users/a440d6e0c088459da9853416fa14a655/roles/ddb643577b2e4e478100ec370decfaeb => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:56:58.842036 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49ca16b-9272-4a8d-ba92-72c4398a7c3a admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:58.844409 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3094fb5b-e708-4ddd-8ae8-f4877dfa6686 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:58.880758 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 806/1628] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 14:56:58 2022] PUT /identity/v3/projects/1054c8a9b2cc44e0b11808f376e133ea/users/43eb83ecc1e64399b8fbd413ea0581ec/roles/ddb643577b2e4e478100ec370decfaeb => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:56:58.881710 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3094fb5b-e708-4ddd-8ae8-f4877dfa6686 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:59.011199 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3094fb5b-e708-4ddd-8ae8-f4877dfa6686 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:59.017908 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49ca16b-9272-4a8d-ba92-72c4398a7c3a admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:59.020225 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdecec18-db09-4980-aa23-0d8c9c6f6106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:59.021007 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdecec18-db09-4980-aa23-0d8c9c6f6106 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:59.021847 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdecec18-db09-4980-aa23-0d8c9c6f6106 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:59.022126 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdecec18-db09-4980-aa23-0d8c9c6f6106 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:59.023026 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdecec18-db09-4980-aa23-0d8c9c6f6106 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:59.028717 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdecec18-db09-4980-aa23-0d8c9c6f6106 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:59.031981 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:59.051737 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 807/1629] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:56:58 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:56:59.051737 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdecec18-db09-4980-aa23-0d8c9c6f6106 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:59.071417 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:59.183578 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7a935e-eb31-4cdc-b04e-a70b060ff23c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055439dc35e946f4a82535c684f9b60d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:59.186443 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7a935e-eb31-4cdc-b04e-a70b060ff23c service nova] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:59.186815 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7a935e-eb31-4cdc-b04e-a70b060ff23c service nova] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:59.187099 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7a935e-eb31-4cdc-b04e-a70b060ff23c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:59.217527 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdecec18-db09-4980-aa23-0d8c9c6f6106 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:59.237553 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe03c6c1-0f05-44aa-b347-ea87865557f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055439dc35e946f4a82535c684f9b60d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:59.238240 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe03c6c1-0f05-44aa-b347-ea87865557f8 service nova] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:59.238520 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe03c6c1-0f05-44aa-b347-ea87865557f8 service nova] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:59.238795 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe03c6c1-0f05-44aa-b347-ea87865557f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:59.303575 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7a935e-eb31-4cdc-b04e-a70b060ff23c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:59.306574 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7a935e-eb31-4cdc-b04e-a70b060ff23c service nova] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:59.320051 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 823/1630] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:56:58 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:56:59.321165 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7a935e-eb31-4cdc-b04e-a70b060ff23c service nova] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:59.331858 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7a935e-eb31-4cdc-b04e-a70b060ff23c service nova] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:59.337456 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fdfb35-b850-4cca-a072-434f7238720e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:59.338173 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fdfb35-b850-4cca-a072-434f7238720e admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:59.338874 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fdfb35-b850-4cca-a072-434f7238720e admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:59.339262 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fdfb35-b850-4cca-a072-434f7238720e admin admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:59.339996 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fdfb35-b850-4cca-a072-434f7238720e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:59.342372 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fdfb35-b850-4cca-a072-434f7238720e admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:59.358085 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 824/1631] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:56:59 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:56:59.364118 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fdfb35-b850-4cca-a072-434f7238720e admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:59.380368 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fdfb35-b850-4cca-a072-434f7238720e admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:59.390226 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8e0554-cabb-4f90-9ad3-06494853be80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:59.394259 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e0554-cabb-4f90-9ad3-06494853be80 admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:59.394824 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e0554-cabb-4f90-9ad3-06494853be80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:59.395164 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e0554-cabb-4f90-9ad3-06494853be80 admin admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:59.397012 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8e0554-cabb-4f90-9ad3-06494853be80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:59.399842 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8e0554-cabb-4f90-9ad3-06494853be80 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:59.404848 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe03c6c1-0f05-44aa-b347-ea87865557f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:59.408825 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe03c6c1-0f05-44aa-b347-ea87865557f8 service nova] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:59.418758 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 825/1632] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:56:59 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:56:59.421770 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8e0554-cabb-4f90-9ad3-06494853be80 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:59.439520 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 808/1633] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:56:59 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:56:59.440619 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe03c6c1-0f05-44aa-b347-ea87865557f8 service nova] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:59.450321 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8e0554-cabb-4f90-9ad3-06494853be80 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:59.479324 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18441df6-45b4-4cac-a780-1e0ac08ce914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:59.481474 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18441df6-45b4-4cac-a780-1e0ac08ce914 admin admin] REQUEST_METHOD: `PUT` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:59.483625 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18441df6-45b4-4cac-a780-1e0ac08ce914 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:59.484678 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18441df6-45b4-4cac-a780-1e0ac08ce914 admin admin] PATH_INFO: `/v3/projects/ed4e913500c64c3f9eaa7c381dc13030/users/96736c6419394013b37d4ed06088e59b/roles/ddb643577b2e4e478100ec370decfaeb` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:59.485073 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe03c6c1-0f05-44aa-b347-ea87865557f8 service nova] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:59.502454 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34973a9-60e8-47a3-b362-353479f0e70b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:59.504863 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34973a9-60e8-47a3-b362-353479f0e70b admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:59.506195 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34973a9-60e8-47a3-b362-353479f0e70b admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:59.506643 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34973a9-60e8-47a3-b362-353479f0e70b admin admin] PATH_INFO: `/v3/projects/93217f5b2c5a459fa5fe2925baa87a2b/users/a440d6e0c088459da9853416fa14a655/roles/ddb643577b2e4e478100ec370decfaeb` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:59.527691 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34973a9-60e8-47a3-b362-353479f0e70b admin admin] RBAC: Authorizing `identity:create_grant(project_id=93217f5b2c5a459fa5fe2925baa87a2b, user_id=a440d6e0c088459da9853416fa14a655, role_id=ddb643577b2e4e478100ec370decfaeb)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:59.536541 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34973a9-60e8-47a3-b362-353479f0e70b admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:59.537024 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18441df6-45b4-4cac-a780-1e0ac08ce914 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed4e913500c64c3f9eaa7c381dc13030, user_id=96736c6419394013b37d4ed06088e59b, role_id=ddb643577b2e4e478100ec370decfaeb)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:59.559020 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18441df6-45b4-4cac-a780-1e0ac08ce914 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:59.575711 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 809/1634] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 14:56:59 2022] PUT /identity/v3/projects/93217f5b2c5a459fa5fe2925baa87a2b/users/a440d6e0c088459da9853416fa14a655/roles/ddb643577b2e4e478100ec370decfaeb => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:56:59.577966 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 826/1635] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 14:56:59 2022] PUT /identity/v3/projects/ed4e913500c64c3f9eaa7c381dc13030/users/96736c6419394013b37d4ed06088e59b/roles/ddb643577b2e4e478100ec370decfaeb => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:56:59.582711 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34973a9-60e8-47a3-b362-353479f0e70b admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:59.586991 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18441df6-45b4-4cac-a780-1e0ac08ce914 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:59.788545 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18441df6-45b4-4cac-a780-1e0ac08ce914 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:59.800693 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34973a9-60e8-47a3-b362-353479f0e70b admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:59.803863 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ca1c68-96d2-48b4-8c8a-8fb28fef2d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:59.805369 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ca1c68-96d2-48b4-8c8a-8fb28fef2d4f admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:59.806019 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ca1c68-96d2-48b4-8c8a-8fb28fef2d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:59.807845 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ca1c68-96d2-48b4-8c8a-8fb28fef2d4f admin admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:59.809129 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ca1c68-96d2-48b4-8c8a-8fb28fef2d4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:59.817302 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ca1c68-96d2-48b4-8c8a-8fb28fef2d4f admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:59.818261 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14955e79-0488-4527-80f3-536fffc0a7ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:59.819145 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14955e79-0488-4527-80f3-536fffc0a7ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:59.822276 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14955e79-0488-4527-80f3-536fffc0a7ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:59.822772 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14955e79-0488-4527-80f3-536fffc0a7ef admin admin] PATH_INFO: `/v3/projects/1054c8a9b2cc44e0b11808f376e133ea/users/43eb83ecc1e64399b8fbd413ea0581ec/roles/ddb643577b2e4e478100ec370decfaeb` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:59.833708 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14955e79-0488-4527-80f3-536fffc0a7ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=1054c8a9b2cc44e0b11808f376e133ea, user_id=43eb83ecc1e64399b8fbd413ea0581ec, role_id=ddb643577b2e4e478100ec370decfaeb)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:59.837630 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14955e79-0488-4527-80f3-536fffc0a7ef admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:59.841163 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:59.858954 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 827/1636] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:56:59 2022] GET /identity/v3/roles => generated 1420 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:56:59.863002 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eaa173-5270-4f06-a3e1-898d06987146 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:59.865043 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eaa173-5270-4f06-a3e1-898d06987146 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:59.867134 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eaa173-5270-4f06-a3e1-898d06987146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:59.887722 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 810/1637] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 14:56:59 2022] PUT /identity/v3/projects/1054c8a9b2cc44e0b11808f376e133ea/users/43eb83ecc1e64399b8fbd413ea0581ec/roles/ddb643577b2e4e478100ec370decfaeb => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:56:59.890264 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14955e79-0488-4527-80f3-536fffc0a7ef admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:00.032657 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-c7eaa173-5270-4f06-a3e1-898d06987146 None None] MFA Rules not processed for user `a440d6e0c088459da9853416fa14a655`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:00.032657 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-c7eaa173-5270-4f06-a3e1-898d06987146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:00.033200 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:00.112411 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14955e79-0488-4527-80f3-536fffc0a7ef admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:00.124481 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc42d54-0f2f-46b3-88c8-fd9d30caf5b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:00.126928 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc42d54-0f2f-46b3-88c8-fd9d30caf5b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:00.127332 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc42d54-0f2f-46b3-88c8-fd9d30caf5b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:00.128442 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc42d54-0f2f-46b3-88c8-fd9d30caf5b5 admin admin] PATH_INFO: `/v3/projects/ed4e913500c64c3f9eaa7c381dc13030/users/96736c6419394013b37d4ed06088e59b/roles/ddb643577b2e4e478100ec370decfaeb` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:00.132363 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc42d54-0f2f-46b3-88c8-fd9d30caf5b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed4e913500c64c3f9eaa7c381dc13030, user_id=96736c6419394013b37d4ed06088e59b, role_id=ddb643577b2e4e478100ec370decfaeb)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:00.139480 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc42d54-0f2f-46b3-88c8-fd9d30caf5b5 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:00.167184 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 811/1638] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 14:56:59 2022] PUT /identity/v3/projects/ed4e913500c64c3f9eaa7c381dc13030/users/96736c6419394013b37d4ed06088e59b/roles/ddb643577b2e4e478100ec370decfaeb => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:00.168772 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a64409f-9854-4aa0-83b3-73cd799ebded None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:00.169168 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a64409f-9854-4aa0-83b3-73cd799ebded None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:00.169567 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a64409f-9854-4aa0-83b3-73cd799ebded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:00.194369 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 828/1639] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:56:59 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:00.194369 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0f6e7f-a2cc-4119-95b8-a39bfeb94d08 None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:00.194369 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0f6e7f-a2cc-4119-95b8-a39bfeb94d08 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:00.202636 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0f6e7f-a2cc-4119-95b8-a39bfeb94d08 None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:00.213064 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 829/1640] 10.222.0.72 () {54 vars in 912 bytes} [Mon Sep 19 14:57:00 2022] GET /identity => generated 270 bytes in 22 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:57:00.216093 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240dbdab-a90d-4152-8111-f114c1eb5a7c None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:00.216664 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240dbdab-a90d-4152-8111-f114c1eb5a7c None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:00.217153 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240dbdab-a90d-4152-8111-f114c1eb5a7c None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:00.219570 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 830/1641] 10.222.0.72 () {54 vars in 912 bytes} [Mon Sep 19 14:57:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:57:00.222592 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed3bdd4-e371-4cb9-b538-2ec3f37746e1 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:00.223753 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed3bdd4-e371-4cb9-b538-2ec3f37746e1 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:00.224506 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed3bdd4-e371-4cb9-b538-2ec3f37746e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:00.268772 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-5a64409f-9854-4aa0-83b3-73cd799ebded None None] MFA Rules not processed for user `43eb83ecc1e64399b8fbd413ea0581ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:00.270612 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-5a64409f-9854-4aa0-83b3-73cd799ebded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:00.283396 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-fed3bdd4-e371-4cb9-b538-2ec3f37746e1 None None] MFA Rules not processed for user `96736c6419394013b37d4ed06088e59b`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:00.285095 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-fed3bdd4-e371-4cb9-b538-2ec3f37746e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:00.401487 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 831/1642] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:57:00 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:00.401487 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed3bdd4-e371-4cb9-b538-2ec3f37746e1 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:00.439678 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 812/1643] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:57:00 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:00.441292 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03506d39-4f87-442e-a2ed-48bf8c8511ef None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:00.441759 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03506d39-4f87-442e-a2ed-48bf8c8511ef None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:00.442043 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03506d39-4f87-442e-a2ed-48bf8c8511ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:00.482254 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-03506d39-4f87-442e-a2ed-48bf8c8511ef None None] MFA Rules not processed for user `055439dc35e946f4a82535c684f9b60d`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:00.486020 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-03506d39-4f87-442e-a2ed-48bf8c8511ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:00.523821 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed3bdd4-e371-4cb9-b538-2ec3f37746e1 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:00.544517 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db95243-f32f-4cb9-af52-382051d323e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139dc7a4f1dc48fe8faea848bd1ac0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:00.545153 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db95243-f32f-4cb9-af52-382051d323e1 service cinder] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:00.545442 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db95243-f32f-4cb9-af52-382051d323e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:00.545716 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db95243-f32f-4cb9-af52-382051d323e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:00.596961 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 813/1644] 10.222.0.72 () {58 vars in 1009 bytes} [Mon Sep 19 14:57:00 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:00.598587 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea7aab2-5f6d-46b2-b7bb-8e92cb36ef08 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:00.599095 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea7aab2-5f6d-46b2-b7bb-8e92cb36ef08 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:00.599427 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea7aab2-5f6d-46b2-b7bb-8e92cb36ef08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:00.619620 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:00.626520 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-8ea7aab2-5f6d-46b2-b7bb-8e92cb36ef08 None None] MFA Rules not processed for user `055439dc35e946f4a82535c684f9b60d`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:00.628716 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-8ea7aab2-5f6d-46b2-b7bb-8e92cb36ef08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:00.640704 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 814/1645] 10.222.0.72 () {58 vars in 1009 bytes} [Mon Sep 19 14:57:00 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:00.641975 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea7aab2-5f6d-46b2-b7bb-8e92cb36ef08 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:00.658270 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea7aab2-5f6d-46b2-b7bb-8e92cb36ef08 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:00.666245 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec60f6bf-8e83-4870-9f5d-0f98744c111d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139dc7a4f1dc48fe8faea848bd1ac0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:00.666970 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec60f6bf-8e83-4870-9f5d-0f98744c111d service cinder] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:00.667342 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec60f6bf-8e83-4870-9f5d-0f98744c111d service cinder] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:00.667678 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec60f6bf-8e83-4870-9f5d-0f98744c111d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:00.682712 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec60f6bf-8e83-4870-9f5d-0f98744c111d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:00.684457 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec60f6bf-8e83-4870-9f5d-0f98744c111d service cinder] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:00.707132 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db95243-f32f-4cb9-af52-382051d323e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:00.708733 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db95243-f32f-4cb9-af52-382051d323e1 service cinder] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:00.716875 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 815/1646] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:57:00 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:57:00.731593 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 832/1647] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:57:00 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:57:00.789913 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec60f6bf-8e83-4870-9f5d-0f98744c111d service cinder] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:00.802354 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec60f6bf-8e83-4870-9f5d-0f98744c111d service cinder] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:00.806597 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b635a75-b433-47fa-92d2-7569e40c0c4e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139dc7a4f1dc48fe8faea848bd1ac0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:00.807378 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b635a75-b433-47fa-92d2-7569e40c0c4e service cinder] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:00.807759 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b635a75-b433-47fa-92d2-7569e40c0c4e service cinder] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:00.808131 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b635a75-b433-47fa-92d2-7569e40c0c4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:00.826052 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db95243-f32f-4cb9-af52-382051d323e1 service cinder] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:00.836787 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b635a75-b433-47fa-92d2-7569e40c0c4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:00.838405 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b635a75-b433-47fa-92d2-7569e40c0c4e service cinder] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:00.839325 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db95243-f32f-4cb9-af52-382051d323e1 service cinder] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:00.848466 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43b3f80-1019-44ed-ac4b-fda60e434315 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139dc7a4f1dc48fe8faea848bd1ac0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:00.849397 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43b3f80-1019-44ed-ac4b-fda60e434315 service cinder] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:00.850195 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43b3f80-1019-44ed-ac4b-fda60e434315 service cinder] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:00.850630 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43b3f80-1019-44ed-ac4b-fda60e434315 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:00.867351 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 816/1648] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:57:00 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:57:00.889790 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43b3f80-1019-44ed-ac4b-fda60e434315 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:00.891269 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43b3f80-1019-44ed-ac4b-fda60e434315 service cinder] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:00.932611 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 833/1649] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:57:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 14:57:00.986665 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b635a75-b433-47fa-92d2-7569e40c0c4e service cinder] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:00.999626 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:01.004307 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b635a75-b433-47fa-92d2-7569e40c0c4e service cinder] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:01.011815 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e6b98a-2f8c-4e1d-94e7-cba7afd17a4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139dc7a4f1dc48fe8faea848bd1ac0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:01.012761 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e6b98a-2f8c-4e1d-94e7-cba7afd17a4f service cinder] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:01.013556 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e6b98a-2f8c-4e1d-94e7-cba7afd17a4f service cinder] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:01.014009 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e6b98a-2f8c-4e1d-94e7-cba7afd17a4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:01.040417 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e6b98a-2f8c-4e1d-94e7-cba7afd17a4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:01.042434 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e6b98a-2f8c-4e1d-94e7-cba7afd17a4f service cinder] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:01.064073 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 817/1650] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:57:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:57:02.150181 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43b3f80-1019-44ed-ac4b-fda60e434315 service cinder] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:02.167307 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43b3f80-1019-44ed-ac4b-fda60e434315 service cinder] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:02.183667 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6bb5be-b5dc-4aaf-ae4f-c20cff39d5f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139dc7a4f1dc48fe8faea848bd1ac0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:02.184747 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6bb5be-b5dc-4aaf-ae4f-c20cff39d5f2 service cinder] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:02.185025 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6bb5be-b5dc-4aaf-ae4f-c20cff39d5f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:02.185295 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6bb5be-b5dc-4aaf-ae4f-c20cff39d5f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:02.391361 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6bb5be-b5dc-4aaf-ae4f-c20cff39d5f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:02.395015 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6bb5be-b5dc-4aaf-ae4f-c20cff39d5f2 service cinder] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:02.432369 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 834/1651] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:57:02 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:57:02.644198 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e6b98a-2f8c-4e1d-94e7-cba7afd17a4f service cinder] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:02.654755 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e6b98a-2f8c-4e1d-94e7-cba7afd17a4f service cinder] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:02.671424 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bf02ec-5aa8-4ec3-8ddd-d75b0650c424 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139dc7a4f1dc48fe8faea848bd1ac0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:02.674406 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bf02ec-5aa8-4ec3-8ddd-d75b0650c424 service cinder] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:02.674890 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bf02ec-5aa8-4ec3-8ddd-d75b0650c424 service cinder] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:02.675999 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bf02ec-5aa8-4ec3-8ddd-d75b0650c424 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:02.835401 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bf02ec-5aa8-4ec3-8ddd-d75b0650c424 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:02.836921 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bf02ec-5aa8-4ec3-8ddd-d75b0650c424 service cinder] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:02.848540 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 818/1652] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:57:02 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:57:05.223281 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6bb5be-b5dc-4aaf-ae4f-c20cff39d5f2 service cinder] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:05.322365 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bf02ec-5aa8-4ec3-8ddd-d75b0650c424 service cinder] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:05.430236 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6bb5be-b5dc-4aaf-ae4f-c20cff39d5f2 service cinder] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:05.448549 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b384136-c3ce-4c43-841d-ac2dfffded9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:05.449208 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b384136-c3ce-4c43-841d-ac2dfffded9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:05.449669 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b384136-c3ce-4c43-841d-ac2dfffded9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:05.449948 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b384136-c3ce-4c43-841d-ac2dfffded9c admin admin] PATH_INFO: `/v3/users/2b48fed7cdb5454181609512f3686c03` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:05.451368 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b384136-c3ce-4c43-841d-ac2dfffded9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b48fed7cdb5454181609512f3686c03)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:05.453346 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b384136-c3ce-4c43-841d-ac2dfffded9c admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:05.519381 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bf02ec-5aa8-4ec3-8ddd-d75b0650c424 service cinder] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:05.528976 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9c7c81-f5b5-41bf-851c-9a125ec74080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:05.530305 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9c7c81-f5b5-41bf-851c-9a125ec74080 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:05.530784 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9c7c81-f5b5-41bf-851c-9a125ec74080 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:05.531244 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9c7c81-f5b5-41bf-851c-9a125ec74080 admin admin] PATH_INFO: `/v3/users/82b2a9118bb4464a9082435c7000e18f` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:05.532721 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9c7c81-f5b5-41bf-851c-9a125ec74080 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82b2a9118bb4464a9082435c7000e18f)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:05.534183 dv-cinder-756711-11-smb devstack@keystone.service[81451]: WARNING py.warnings [None req-7f9c7c81-f5b5-41bf-851c-9a125ec74080 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 19 14:57:05.534183 dv-cinder-756711-11-smb devstack@keystone.service[81451]: warnings.warn(msg) Sep 19 14:57:05.534183 dv-cinder-756711-11-smb devstack@keystone.service[81451]: Sep 19 14:57:05.535821 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9c7c81-f5b5-41bf-851c-9a125ec74080 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:05.555023 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-5b384136-c3ce-4c43-841d-ac2dfffded9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b48fed7cdb5454181609512f3686c03'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:05.556638 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:05.583473 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-5b384136-c3ce-4c43-841d-ac2dfffded9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b48fed7cdb5454181609512f3686c03'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:05.601491 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-5b384136-c3ce-4c43-841d-ac2dfffded9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b48fed7cdb5454181609512f3686c03'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:05.603265 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-5b384136-c3ce-4c43-841d-ac2dfffded9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b48fed7cdb5454181609512f3686c03'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:05.617645 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-5b384136-c3ce-4c43-841d-ac2dfffded9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b48fed7cdb5454181609512f3686c03'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:05.630947 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 835/1653] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Sep 19 14:57:05 2022] DELETE /identity/v3/users/2b48fed7cdb5454181609512f3686c03 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:05.632553 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8a3ec2-4479-4240-8fa2-6b879c502923 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:05.632942 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8a3ec2-4479-4240-8fa2-6b879c502923 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:05.633624 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8a3ec2-4479-4240-8fa2-6b879c502923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:05.653880 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-7f9c7c81-f5b5-41bf-851c-9a125ec74080 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82b2a9118bb4464a9082435c7000e18f'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:05.682227 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-8a8a3ec2-4479-4240-8fa2-6b879c502923 None None] MFA Rules not processed for user `56875d0b48a04325a01d0d999ad186ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:05.683705 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-8a8a3ec2-4479-4240-8fa2-6b879c502923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:05.691081 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-7f9c7c81-f5b5-41bf-851c-9a125ec74080 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82b2a9118bb4464a9082435c7000e18f'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:05.704078 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-7f9c7c81-f5b5-41bf-851c-9a125ec74080 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82b2a9118bb4464a9082435c7000e18f'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:05.715330 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-7f9c7c81-f5b5-41bf-851c-9a125ec74080 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82b2a9118bb4464a9082435c7000e18f'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:05.716265 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-7f9c7c81-f5b5-41bf-851c-9a125ec74080 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82b2a9118bb4464a9082435c7000e18f'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:05.726309 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 819/1654] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Sep 19 14:57:05 2022] DELETE /identity/v3/users/82b2a9118bb4464a9082435c7000e18f => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:05.741356 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106f7a2c-1c98-48ff-844e-0ace2768a2a8 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:05.741728 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106f7a2c-1c98-48ff-844e-0ace2768a2a8 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:05.742014 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106f7a2c-1c98-48ff-844e-0ace2768a2a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:05.781543 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-106f7a2c-1c98-48ff-844e-0ace2768a2a8 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:05.787912 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-106f7a2c-1c98-48ff-844e-0ace2768a2a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:05.795084 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:05.845194 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 836/1655] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:57:05 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:05.846986 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963dfe56-9f6c-45bf-8dbf-aefe9dc631a8 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:05.858743 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963dfe56-9f6c-45bf-8dbf-aefe9dc631a8 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:05.859437 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963dfe56-9f6c-45bf-8dbf-aefe9dc631a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:05.885045 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 820/1656] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:57:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:05.886995 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec5ea8f-bfd4-439d-a1d8-398cb4e6cfd8 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:05.887387 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec5ea8f-bfd4-439d-a1d8-398cb4e6cfd8 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:05.887759 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec5ea8f-bfd4-439d-a1d8-398cb4e6cfd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:05.914270 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-963dfe56-9f6c-45bf-8dbf-aefe9dc631a8 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:05.916640 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-963dfe56-9f6c-45bf-8dbf-aefe9dc631a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:05.919693 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-5ec5ea8f-bfd4-439d-a1d8-398cb4e6cfd8 None None] MFA Rules not processed for user `56875d0b48a04325a01d0d999ad186ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:05.921277 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-5ec5ea8f-bfd4-439d-a1d8-398cb4e6cfd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:05.931898 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 837/1657] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:57:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:05.933549 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963dfe56-9f6c-45bf-8dbf-aefe9dc631a8 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:05.943987 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-963dfe56-9f6c-45bf-8dbf-aefe9dc631a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:06.013994 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 821/1658] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:57:05 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:06.015600 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec5ea8f-bfd4-439d-a1d8-398cb4e6cfd8 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:06.018222 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-5ec5ea8f-bfd4-439d-a1d8-398cb4e6cfd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:06.042533 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963dfe56-9f6c-45bf-8dbf-aefe9dc631a8 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:06.047297 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564c87dd-912b-4f18-bb20-89051903a73e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c2b78646374cb79ded4b7b59ba49c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:06.047939 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564c87dd-912b-4f18-bb20-89051903a73e service neutron] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:06.048222 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564c87dd-912b-4f18-bb20-89051903a73e service neutron] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:06.048530 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564c87dd-912b-4f18-bb20-89051903a73e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:06.050170 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec5ea8f-bfd4-439d-a1d8-398cb4e6cfd8 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:06.053964 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de66b67b-3876-42f5-81f6-6f3132be83bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c2b78646374cb79ded4b7b59ba49c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:06.054583 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de66b67b-3876-42f5-81f6-6f3132be83bc service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:06.054863 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de66b67b-3876-42f5-81f6-6f3132be83bc service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:06.055135 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de66b67b-3876-42f5-81f6-6f3132be83bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:06.074126 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564c87dd-912b-4f18-bb20-89051903a73e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:06.075585 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564c87dd-912b-4f18-bb20-89051903a73e service neutron] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:06.076270 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de66b67b-3876-42f5-81f6-6f3132be83bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:06.077735 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de66b67b-3876-42f5-81f6-6f3132be83bc service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:06.104466 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 838/1659] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:57:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:57:06.105642 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564c87dd-912b-4f18-bb20-89051903a73e service neutron] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:06.108477 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-564c87dd-912b-4f18-bb20-89051903a73e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:06.116379 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 822/1660] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:57:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:57:06.268054 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:06.321580 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564c87dd-912b-4f18-bb20-89051903a73e service neutron] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:06.344614 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30f6f16-ac94-4aa9-a427-163b8f2b9d57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055439dc35e946f4a82535c684f9b60d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:06.344614 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30f6f16-ac94-4aa9-a427-163b8f2b9d57 service nova] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:06.346685 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30f6f16-ac94-4aa9-a427-163b8f2b9d57 service nova] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:06.359034 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30f6f16-ac94-4aa9-a427-163b8f2b9d57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:06.397694 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30f6f16-ac94-4aa9-a427-163b8f2b9d57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:06.404859 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30f6f16-ac94-4aa9-a427-163b8f2b9d57 service nova] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:06.433736 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 839/1661] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:57:06 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:57:06.903245 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de66b67b-3876-42f5-81f6-6f3132be83bc service neutron] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:06.910011 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-de66b67b-3876-42f5-81f6-6f3132be83bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:06.931115 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de66b67b-3876-42f5-81f6-6f3132be83bc service neutron] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:06.946498 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe821115-4df4-4df5-b329-90b84e5db599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:06.959869 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe821115-4df4-4df5-b329-90b84e5db599 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:06.964396 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe821115-4df4-4df5-b329-90b84e5db599 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:06.964748 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe821115-4df4-4df5-b329-90b84e5db599 admin admin] PATH_INFO: `/v3/users/fb8cdc93f39941b9941b49f50086b9c9` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:06.966870 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe821115-4df4-4df5-b329-90b84e5db599 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb8cdc93f39941b9941b49f50086b9c9)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:06.973377 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe821115-4df4-4df5-b329-90b84e5db599 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:07.102137 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-fe821115-4df4-4df5-b329-90b84e5db599 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb8cdc93f39941b9941b49f50086b9c9'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:07.131336 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-fe821115-4df4-4df5-b329-90b84e5db599 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb8cdc93f39941b9941b49f50086b9c9'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:07.155259 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-fe821115-4df4-4df5-b329-90b84e5db599 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb8cdc93f39941b9941b49f50086b9c9'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:07.165785 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20755d4f-7fdc-4a92-b8b6-494a3ee732e0 None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:07.166066 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20755d4f-7fdc-4a92-b8b6-494a3ee732e0 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:07.166488 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20755d4f-7fdc-4a92-b8b6-494a3ee732e0 None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:07.168282 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 840/1662] 10.222.0.72 () {54 vars in 912 bytes} [Mon Sep 19 14:57:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 14:57:07.171659 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-fe821115-4df4-4df5-b329-90b84e5db599 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb8cdc93f39941b9941b49f50086b9c9'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:07.173539 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-fe821115-4df4-4df5-b329-90b84e5db599 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb8cdc93f39941b9941b49f50086b9c9'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:07.182820 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919291f0-f440-4c1b-93a6-bfd96457feae None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:07.183121 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919291f0-f440-4c1b-93a6-bfd96457feae None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:07.183368 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919291f0-f440-4c1b-93a6-bfd96457feae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:07.194471 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 823/1663] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Sep 19 14:57:06 2022] DELETE /identity/v3/users/fb8cdc93f39941b9941b49f50086b9c9 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:07.200414 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb045a-c265-4e39-b938-a3038a13dc4c None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:07.200713 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb045a-c265-4e39-b938-a3038a13dc4c None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:07.200948 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb045a-c265-4e39-b938-a3038a13dc4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:07.272222 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-6dcb045a-c265-4e39-b938-a3038a13dc4c None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:07.277038 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-6dcb045a-c265-4e39-b938-a3038a13dc4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:07.277349 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-919291f0-f440-4c1b-93a6-bfd96457feae None None] MFA Rules not processed for user `f4c2b78646374cb79ded4b7b59ba49c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:07.278553 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-919291f0-f440-4c1b-93a6-bfd96457feae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:07.311828 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:07.410051 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 841/1664] 10.222.0.72 () {58 vars in 1009 bytes} [Mon Sep 19 14:57:07 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 14:57:07.411184 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919291f0-f440-4c1b-93a6-bfd96457feae None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:07.416620 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-919291f0-f440-4c1b-93a6-bfd96457feae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:07.456567 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 824/1665] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:57:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:07.469605 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcb045a-c265-4e39-b938-a3038a13dc4c None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:07.472272 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-6dcb045a-c265-4e39-b938-a3038a13dc4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:07.549170 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcb045a-c265-4e39-b938-a3038a13dc4c None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:07.578217 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af35dd9b-8049-4f42-b6e4-e08f3b4893a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:07.578918 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af35dd9b-8049-4f42-b6e4-e08f3b4893a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:07.579204 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af35dd9b-8049-4f42-b6e4-e08f3b4893a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:07.579479 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af35dd9b-8049-4f42-b6e4-e08f3b4893a1 admin admin] PATH_INFO: `/v3/users/b4871720165e426cb9e330590de173cc` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:07.582407 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af35dd9b-8049-4f42-b6e4-e08f3b4893a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4871720165e426cb9e330590de173cc)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:07.584381 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af35dd9b-8049-4f42-b6e4-e08f3b4893a1 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:07.595810 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919291f0-f440-4c1b-93a6-bfd96457feae None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:07.608046 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3530b7c1-0dd9-4db0-b27a-50f188c9ae8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:07.608046 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3530b7c1-0dd9-4db0-b27a-50f188c9ae8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:07.608046 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3530b7c1-0dd9-4db0-b27a-50f188c9ae8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:07.609214 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3530b7c1-0dd9-4db0-b27a-50f188c9ae8a admin admin] PATH_INFO: `/v3/projects/d72f295bfa8445a39ba5ed2cb023d221` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:07.613020 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3530b7c1-0dd9-4db0-b27a-50f188c9ae8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d72f295bfa8445a39ba5ed2cb023d221)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:07.614095 dv-cinder-756711-11-smb devstack@keystone.service[81452]: WARNING py.warnings [None req-3530b7c1-0dd9-4db0-b27a-50f188c9ae8a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 19 14:57:07.614095 dv-cinder-756711-11-smb devstack@keystone.service[81452]: warnings.warn(msg) Sep 19 14:57:07.614095 dv-cinder-756711-11-smb devstack@keystone.service[81452]: Sep 19 14:57:07.618215 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3530b7c1-0dd9-4db0-b27a-50f188c9ae8a admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:07.740658 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-af35dd9b-8049-4f42-b6e4-e08f3b4893a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4871720165e426cb9e330590de173cc'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:07.771975 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-af35dd9b-8049-4f42-b6e4-e08f3b4893a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4871720165e426cb9e330590de173cc'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:07.782861 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-af35dd9b-8049-4f42-b6e4-e08f3b4893a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4871720165e426cb9e330590de173cc'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:07.802429 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-3530b7c1-0dd9-4db0-b27a-50f188c9ae8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd72f295bfa8445a39ba5ed2cb023d221', 'request_id': 'req-3530b7c1-0dd9-4db0-b27a-50f188c9ae8a'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:07.806493 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-af35dd9b-8049-4f42-b6e4-e08f3b4893a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4871720165e426cb9e330590de173cc'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:07.807443 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-af35dd9b-8049-4f42-b6e4-e08f3b4893a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4871720165e426cb9e330590de173cc'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:07.821432 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-3530b7c1-0dd9-4db0-b27a-50f188c9ae8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd72f295bfa8445a39ba5ed2cb023d221', 'request_id': 'req-3530b7c1-0dd9-4db0-b27a-50f188c9ae8a'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:07.825300 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 825/1666] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Sep 19 14:57:07 2022] DELETE /identity/v3/users/b4871720165e426cb9e330590de173cc => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:07.829628 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af35dd9b-8049-4f42-b6e4-e08f3b4893a1 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:07.833898 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-af35dd9b-8049-4f42-b6e4-e08f3b4893a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:07.857093 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-3530b7c1-0dd9-4db0-b27a-50f188c9ae8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd72f295bfa8445a39ba5ed2cb023d221', 'request_id': 'req-3530b7c1-0dd9-4db0-b27a-50f188c9ae8a'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:07.897395 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-3530b7c1-0dd9-4db0-b27a-50f188c9ae8a admin admin] The token cache is being invalidate because project d72f295bfa8445a39ba5ed2cb023d221 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 14:57:07.897841 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-3530b7c1-0dd9-4db0-b27a-50f188c9ae8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:07.899107 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-3530b7c1-0dd9-4db0-b27a-50f188c9ae8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:07.909596 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 842/1667] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Sep 19 14:57:07 2022] DELETE /identity/v3/projects/d72f295bfa8445a39ba5ed2cb023d221 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:07.909596 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3530b7c1-0dd9-4db0-b27a-50f188c9ae8a admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:07.912067 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-3530b7c1-0dd9-4db0-b27a-50f188c9ae8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:07.923247 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:07.967398 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af35dd9b-8049-4f42-b6e4-e08f3b4893a1 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:07.984067 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1400e5a-370b-424c-9dc2-fee91593a7b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c2b78646374cb79ded4b7b59ba49c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:07.985050 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1400e5a-370b-424c-9dc2-fee91593a7b8 service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:07.985472 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1400e5a-370b-424c-9dc2-fee91593a7b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:07.985898 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1400e5a-370b-424c-9dc2-fee91593a7b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:07.989704 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-d1400e5a-370b-424c-9dc2-fee91593a7b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:08.046563 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3530b7c1-0dd9-4db0-b27a-50f188c9ae8a admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:08.054877 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ec4842-e580-4c81-8f4a-70430e75b788 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c2b78646374cb79ded4b7b59ba49c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:08.055604 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ec4842-e580-4c81-8f4a-70430e75b788 service neutron] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:08.055989 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ec4842-e580-4c81-8f4a-70430e75b788 service neutron] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:08.056386 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ec4842-e580-4c81-8f4a-70430e75b788 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:08.069668 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-47ec4842-e580-4c81-8f4a-70430e75b788 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:08.086216 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ec4842-e580-4c81-8f4a-70430e75b788 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:08.087754 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ec4842-e580-4c81-8f4a-70430e75b788 service neutron] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:08.100183 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:08.104928 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 843/1668] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:57:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:57:08.105745 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ec4842-e580-4c81-8f4a-70430e75b788 service neutron] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:08.111670 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-47ec4842-e580-4c81-8f4a-70430e75b788 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:08.159463 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1400e5a-370b-424c-9dc2-fee91593a7b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:08.160960 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1400e5a-370b-424c-9dc2-fee91593a7b8 service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:08.184972 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 826/1669] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:57:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:57:08.186187 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f461b16-355c-4fad-9930-988a779b53c1 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:08.186470 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f461b16-355c-4fad-9930-988a779b53c1 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:08.186798 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f461b16-355c-4fad-9930-988a779b53c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:08.226566 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-5f461b16-355c-4fad-9930-988a779b53c1 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:08.227644 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-5f461b16-355c-4fad-9930-988a779b53c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:08.246299 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 827/1670] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:57:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:08.251001 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e37538-ea6f-4be0-b963-b888f3ae51e1 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:08.251405 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e37538-ea6f-4be0-b963-b888f3ae51e1 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:08.251694 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e37538-ea6f-4be0-b963-b888f3ae51e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:08.286195 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ec4842-e580-4c81-8f4a-70430e75b788 service neutron] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:08.297914 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85c5e6a-ee73-46af-948f-bcf106743bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:08.299407 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c5e6a-ee73-46af-948f-bcf106743bd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:08.300537 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c5e6a-ee73-46af-948f-bcf106743bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:08.301026 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c5e6a-ee73-46af-948f-bcf106743bd6 admin admin] PATH_INFO: `/v3/users/1a2826168b6c411bb0a6165645ce8219` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:08.301518 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-d9e37538-ea6f-4be0-b963-b888f3ae51e1 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:08.302770 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-d9e37538-ea6f-4be0-b963-b888f3ae51e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:08.303556 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85c5e6a-ee73-46af-948f-bcf106743bd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a2826168b6c411bb0a6165645ce8219)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:08.306650 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85c5e6a-ee73-46af-948f-bcf106743bd6 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:08.313519 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 828/1671] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:57:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:08.320812 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e37538-ea6f-4be0-b963-b888f3ae51e1 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:08.333643 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-d9e37538-ea6f-4be0-b963-b888f3ae51e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:08.361608 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e37538-ea6f-4be0-b963-b888f3ae51e1 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:08.374434 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a70a00-d508-4108-8339-28ef8ebe1bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:08.375174 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a70a00-d508-4108-8339-28ef8ebe1bd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:08.375548 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a70a00-d508-4108-8339-28ef8ebe1bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:08.375944 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a70a00-d508-4108-8339-28ef8ebe1bd7 admin admin] PATH_INFO: `/v3/projects/bed79617045f40769c36c10bb7f0340d` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:08.377369 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a70a00-d508-4108-8339-28ef8ebe1bd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bed79617045f40769c36c10bb7f0340d)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:08.379397 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a70a00-d508-4108-8339-28ef8ebe1bd7 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:08.445327 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-f85c5e6a-ee73-46af-948f-bcf106743bd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a2826168b6c411bb0a6165645ce8219'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:08.456969 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-d7a70a00-d508-4108-8339-28ef8ebe1bd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bed79617045f40769c36c10bb7f0340d', 'request_id': 'req-d7a70a00-d508-4108-8339-28ef8ebe1bd7'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:08.471754 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-d7a70a00-d508-4108-8339-28ef8ebe1bd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bed79617045f40769c36c10bb7f0340d', 'request_id': 'req-d7a70a00-d508-4108-8339-28ef8ebe1bd7'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:08.485957 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-f85c5e6a-ee73-46af-948f-bcf106743bd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a2826168b6c411bb0a6165645ce8219'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:08.492304 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-d7a70a00-d508-4108-8339-28ef8ebe1bd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bed79617045f40769c36c10bb7f0340d', 'request_id': 'req-d7a70a00-d508-4108-8339-28ef8ebe1bd7'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:08.508018 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-f85c5e6a-ee73-46af-948f-bcf106743bd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a2826168b6c411bb0a6165645ce8219'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:08.512979 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-f85c5e6a-ee73-46af-948f-bcf106743bd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a2826168b6c411bb0a6165645ce8219'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:08.514907 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-d7a70a00-d508-4108-8339-28ef8ebe1bd7 admin admin] The token cache is being invalidate because project bed79617045f40769c36c10bb7f0340d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 14:57:08.515362 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-d7a70a00-d508-4108-8339-28ef8ebe1bd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:08.516925 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-d7a70a00-d508-4108-8339-28ef8ebe1bd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:08.519397 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 829/1672] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Sep 19 14:57:08 2022] DELETE /identity/v3/projects/bed79617045f40769c36c10bb7f0340d => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:08.521443 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9ed092-46b2-4037-8a4b-f291049d230f None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:08.521994 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9ed092-46b2-4037-8a4b-f291049d230f None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:08.522637 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9ed092-46b2-4037-8a4b-f291049d230f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:08.547162 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-f85c5e6a-ee73-46af-948f-bcf106743bd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a2826168b6c411bb0a6165645ce8219'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:08.570570 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 844/1673] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Sep 19 14:57:08 2022] DELETE /identity/v3/users/1a2826168b6c411bb0a6165645ce8219 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:08.570570 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85c5e6a-ee73-46af-948f-bcf106743bd6 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:08.570831 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-f85c5e6a-ee73-46af-948f-bcf106743bd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:08.595633 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-1b9ed092-46b2-4037-8a4b-f291049d230f None None] MFA Rules not processed for user `37c6063c794f4bab8f3850b5b8daa47c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:08.597004 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-1b9ed092-46b2-4037-8a4b-f291049d230f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:08.625585 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:08.713160 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85c5e6a-ee73-46af-948f-bcf106743bd6 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:08.724154 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e30331e-5648-470e-8e6c-68a6c73760d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c2b78646374cb79ded4b7b59ba49c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:08.724977 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e30331e-5648-470e-8e6c-68a6c73760d9 service neutron] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:08.725255 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e30331e-5648-470e-8e6c-68a6c73760d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:08.727484 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e30331e-5648-470e-8e6c-68a6c73760d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:08.732582 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-4e30331e-5648-470e-8e6c-68a6c73760d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:08.810203 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 830/1674] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:57:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:08.814018 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631591f0-68f2-401e-96b1-f7dbae7c0979 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:08.814379 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631591f0-68f2-401e-96b1-f7dbae7c0979 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:08.816584 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631591f0-68f2-401e-96b1-f7dbae7c0979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:08.882350 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-631591f0-68f2-401e-96b1-f7dbae7c0979 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:08.883739 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-631591f0-68f2-401e-96b1-f7dbae7c0979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:08.928906 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e30331e-5648-470e-8e6c-68a6c73760d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:08.930622 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e30331e-5648-470e-8e6c-68a6c73760d9 service neutron] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:08.966241 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:08.967632 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 845/1675] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:57:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:57:08.970262 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e30331e-5648-470e-8e6c-68a6c73760d9 service neutron] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:08.976806 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-4e30331e-5648-470e-8e6c-68a6c73760d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:09.005331 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e30331e-5648-470e-8e6c-68a6c73760d9 service neutron] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:09.021980 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da17f9f-89d6-4cc0-8fcc-48b6201ecdf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:09.022639 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da17f9f-89d6-4cc0-8fcc-48b6201ecdf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:09.023630 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da17f9f-89d6-4cc0-8fcc-48b6201ecdf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:09.023936 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da17f9f-89d6-4cc0-8fcc-48b6201ecdf8 admin admin] PATH_INFO: `/v3/users/43eb83ecc1e64399b8fbd413ea0581ec` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:09.025866 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da17f9f-89d6-4cc0-8fcc-48b6201ecdf8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43eb83ecc1e64399b8fbd413ea0581ec)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:09.030437 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da17f9f-89d6-4cc0-8fcc-48b6201ecdf8 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:09.062351 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 831/1676] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:57:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:09.064288 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fb009e-d14a-4281-89e1-2c870dadd1fa None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:09.064625 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fb009e-d14a-4281-89e1-2c870dadd1fa None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:09.064902 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fb009e-d14a-4281-89e1-2c870dadd1fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:09.109912 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-04fb009e-d14a-4281-89e1-2c870dadd1fa None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:09.112848 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-04fb009e-d14a-4281-89e1-2c870dadd1fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:09.124490 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 832/1677] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:57:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:09.127034 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f69ce8-c048-4fd5-9d8c-f93c620e8d11 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:09.127679 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f69ce8-c048-4fd5-9d8c-f93c620e8d11 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:09.128173 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f69ce8-c048-4fd5-9d8c-f93c620e8d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:09.149018 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-4da17f9f-89d6-4cc0-8fcc-48b6201ecdf8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43eb83ecc1e64399b8fbd413ea0581ec'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:09.169630 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-43f69ce8-c048-4fd5-9d8c-f93c620e8d11 None None] MFA Rules not processed for user `37c6063c794f4bab8f3850b5b8daa47c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:09.176648 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-43f69ce8-c048-4fd5-9d8c-f93c620e8d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:09.181762 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-4da17f9f-89d6-4cc0-8fcc-48b6201ecdf8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43eb83ecc1e64399b8fbd413ea0581ec'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:09.208633 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-4da17f9f-89d6-4cc0-8fcc-48b6201ecdf8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43eb83ecc1e64399b8fbd413ea0581ec'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:09.209622 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 833/1678] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:57:09 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:09.210367 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-4da17f9f-89d6-4cc0-8fcc-48b6201ecdf8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43eb83ecc1e64399b8fbd413ea0581ec'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:09.210764 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f69ce8-c048-4fd5-9d8c-f93c620e8d11 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:09.224232 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-4da17f9f-89d6-4cc0-8fcc-48b6201ecdf8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43eb83ecc1e64399b8fbd413ea0581ec'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:09.234938 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f69ce8-c048-4fd5-9d8c-f93c620e8d11 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:09.240279 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 846/1679] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Sep 19 14:57:08 2022] DELETE /identity/v3/users/43eb83ecc1e64399b8fbd413ea0581ec => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:09.241581 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da17f9f-89d6-4cc0-8fcc-48b6201ecdf8 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:09.245710 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-4da17f9f-89d6-4cc0-8fcc-48b6201ecdf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:09.398791 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:09.399411 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6714064e-1609-4d68-ae91-23869f229ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:09.400184 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6714064e-1609-4d68-ae91-23869f229ddb admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:09.400460 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6714064e-1609-4d68-ae91-23869f229ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:09.400798 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6714064e-1609-4d68-ae91-23869f229ddb admin admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:09.401565 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6714064e-1609-4d68-ae91-23869f229ddb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:57:09.401940 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6714064e-1609-4d68-ae91-23869f229ddb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:09.403697 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6714064e-1609-4d68-ae91-23869f229ddb admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:09.418725 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da17f9f-89d6-4cc0-8fcc-48b6201ecdf8 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:09.428322 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 834/1680] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Sep 19 14:57:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:57:09.429002 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6714064e-1609-4d68-ae91-23869f229ddb admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:09.432681 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f183b076-6adb-433e-8a6f-54136a234a86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c2b78646374cb79ded4b7b59ba49c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:09.433446 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f183b076-6adb-433e-8a6f-54136a234a86 service neutron] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:09.433726 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f183b076-6adb-433e-8a6f-54136a234a86 service neutron] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:09.434000 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f183b076-6adb-433e-8a6f-54136a234a86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:09.434760 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-6714064e-1609-4d68-ae91-23869f229ddb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:09.440266 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-f183b076-6adb-433e-8a6f-54136a234a86 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:09.463482 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6714064e-1609-4d68-ae91-23869f229ddb admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:09.475496 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf442db5-6cf3-461b-90e6-daa7bb06146b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:09.476202 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf442db5-6cf3-461b-90e6-daa7bb06146b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:09.476509 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf442db5-6cf3-461b-90e6-daa7bb06146b admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:09.476785 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf442db5-6cf3-461b-90e6-daa7bb06146b admin admin] PATH_INFO: `/v3/projects/8793dca3e0cc42e18890406667917389` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:09.477072 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f183b076-6adb-433e-8a6f-54136a234a86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:09.478709 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf442db5-6cf3-461b-90e6-daa7bb06146b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8793dca3e0cc42e18890406667917389)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:09.479606 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f183b076-6adb-433e-8a6f-54136a234a86 service neutron] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:09.480662 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf442db5-6cf3-461b-90e6-daa7bb06146b admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:09.505580 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 847/1681] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:57:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:57:09.506946 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f183b076-6adb-433e-8a6f-54136a234a86 service neutron] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:09.512618 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-f183b076-6adb-433e-8a6f-54136a234a86 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:09.605870 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-cf442db5-6cf3-461b-90e6-daa7bb06146b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8793dca3e0cc42e18890406667917389', 'request_id': 'req-cf442db5-6cf3-461b-90e6-daa7bb06146b'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:09.619523 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-cf442db5-6cf3-461b-90e6-daa7bb06146b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8793dca3e0cc42e18890406667917389', 'request_id': 'req-cf442db5-6cf3-461b-90e6-daa7bb06146b'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:09.626837 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-cf442db5-6cf3-461b-90e6-daa7bb06146b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8793dca3e0cc42e18890406667917389', 'request_id': 'req-cf442db5-6cf3-461b-90e6-daa7bb06146b'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:09.657283 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-cf442db5-6cf3-461b-90e6-daa7bb06146b admin admin] The token cache is being invalidate because project 8793dca3e0cc42e18890406667917389 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 14:57:09.657677 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-cf442db5-6cf3-461b-90e6-daa7bb06146b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:09.658298 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-cf442db5-6cf3-461b-90e6-daa7bb06146b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:09.660076 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 835/1682] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Sep 19 14:57:09 2022] DELETE /identity/v3/projects/8793dca3e0cc42e18890406667917389 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:09.660660 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf442db5-6cf3-461b-90e6-daa7bb06146b admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:09.663805 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-cf442db5-6cf3-461b-90e6-daa7bb06146b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:09.696128 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f183b076-6adb-433e-8a6f-54136a234a86 service neutron] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:09.760565 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:09.832321 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf442db5-6cf3-461b-90e6-daa7bb06146b admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:09.847714 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b2062e-07c6-442e-b656-e7b090b16882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:09.848366 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b2062e-07c6-442e-b656-e7b090b16882 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:09.848957 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b2062e-07c6-442e-b656-e7b090b16882 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:09.849244 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b2062e-07c6-442e-b656-e7b090b16882 admin admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:09.849900 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b2062e-07c6-442e-b656-e7b090b16882 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:09.856291 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b2062e-07c6-442e-b656-e7b090b16882 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:09.933748 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 836/1683] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Sep 19 14:57:09 2022] POST /identity/v3/projects => generated 373 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:57:09.934899 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b2062e-07c6-442e-b656-e7b090b16882 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:09.948078 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-32b2062e-07c6-442e-b656-e7b090b16882 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:09.969209 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015a5220-6fa3-410a-a887-3a5786b1ed3e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055439dc35e946f4a82535c684f9b60d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:09.972634 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015a5220-6fa3-410a-a887-3a5786b1ed3e service nova] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:09.972896 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015a5220-6fa3-410a-a887-3a5786b1ed3e service nova] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:09.974376 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015a5220-6fa3-410a-a887-3a5786b1ed3e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:09.983823 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-015a5220-6fa3-410a-a887-3a5786b1ed3e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:10.134174 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015a5220-6fa3-410a-a887-3a5786b1ed3e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:10.136005 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015a5220-6fa3-410a-a887-3a5786b1ed3e service nova] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:10.165999 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b2062e-07c6-442e-b656-e7b090b16882 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:10.170107 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 848/1684] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:57:09 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 663 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:57:10.171293 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015a5220-6fa3-410a-a887-3a5786b1ed3e service nova] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:10.194228 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41968c44-9528-4ded-9195-f60127af5abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:10.195147 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41968c44-9528-4ded-9195-f60127af5abc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:10.195563 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41968c44-9528-4ded-9195-f60127af5abc admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:10.195991 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41968c44-9528-4ded-9195-f60127af5abc admin admin] PATH_INFO: `/v3/users/a440d6e0c088459da9853416fa14a655` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:10.203973 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015a5220-6fa3-410a-a887-3a5786b1ed3e service nova] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:10.204626 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41968c44-9528-4ded-9195-f60127af5abc admin admin] RBAC: Authorizing `identity:delete_user(user_id=a440d6e0c088459da9853416fa14a655)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:10.217955 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41968c44-9528-4ded-9195-f60127af5abc admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:10.219947 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84edd08-2aed-4bf7-8e00-9e8ed3deda03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:10.220892 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84edd08-2aed-4bf7-8e00-9e8ed3deda03 admin admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:10.221180 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84edd08-2aed-4bf7-8e00-9e8ed3deda03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:10.221597 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84edd08-2aed-4bf7-8e00-9e8ed3deda03 admin admin] PATH_INFO: `/v3/users` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:10.222372 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84edd08-2aed-4bf7-8e00-9e8ed3deda03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:10.226206 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84edd08-2aed-4bf7-8e00-9e8ed3deda03 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:10.289973 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 849/1685] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Sep 19 14:57:10 2022] POST /identity/v3/users => generated 287 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:57:10.293411 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84edd08-2aed-4bf7-8e00-9e8ed3deda03 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:10.309303 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84edd08-2aed-4bf7-8e00-9e8ed3deda03 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:10.324052 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d51d61a-7e0c-424b-afac-365ac8b92cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:10.327646 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d51d61a-7e0c-424b-afac-365ac8b92cdc admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:10.327986 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d51d61a-7e0c-424b-afac-365ac8b92cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:10.328271 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d51d61a-7e0c-424b-afac-365ac8b92cdc admin admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:10.330492 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d51d61a-7e0c-424b-afac-365ac8b92cdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:10.334655 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d51d61a-7e0c-424b-afac-365ac8b92cdc admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:10.338307 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:10.339773 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-41968c44-9528-4ded-9195-f60127af5abc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a440d6e0c088459da9853416fa14a655'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:10.366825 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-41968c44-9528-4ded-9195-f60127af5abc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a440d6e0c088459da9853416fa14a655'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:10.379548 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 850/1686] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:57:10 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:57:10.380594 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d51d61a-7e0c-424b-afac-365ac8b92cdc admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:10.382979 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-3d51d61a-7e0c-424b-afac-365ac8b92cdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:10.383286 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-41968c44-9528-4ded-9195-f60127af5abc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a440d6e0c088459da9853416fa14a655'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:10.404878 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-41968c44-9528-4ded-9195-f60127af5abc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a440d6e0c088459da9853416fa14a655'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:10.409485 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-41968c44-9528-4ded-9195-f60127af5abc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a440d6e0c088459da9853416fa14a655'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:10.420304 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 837/1687] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Sep 19 14:57:09 2022] DELETE /identity/v3/users/a440d6e0c088459da9853416fa14a655 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:10.421623 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41968c44-9528-4ded-9195-f60127af5abc admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:10.428344 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-41968c44-9528-4ded-9195-f60127af5abc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:10.518400 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d51d61a-7e0c-424b-afac-365ac8b92cdc admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:10.593438 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:10.615276 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973c6627-0a8b-4857-961d-b2ea3c5fad08 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e7a0148db8462b8ba24bac6dd15298', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:10.615580 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973c6627-0a8b-4857-961d-b2ea3c5fad08 service placement] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:10.615826 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973c6627-0a8b-4857-961d-b2ea3c5fad08 service placement] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:10.616092 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973c6627-0a8b-4857-961d-b2ea3c5fad08 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:10.618152 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-973c6627-0a8b-4857-961d-b2ea3c5fad08 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:10.624948 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41968c44-9528-4ded-9195-f60127af5abc admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:10.631522 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973c6627-0a8b-4857-961d-b2ea3c5fad08 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:10.633188 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973c6627-0a8b-4857-961d-b2ea3c5fad08 service placement] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:10.641036 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeac3879-9c32-43c5-af43-d165c7c086b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:10.641876 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeac3879-9c32-43c5-af43-d165c7c086b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:10.642224 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeac3879-9c32-43c5-af43-d165c7c086b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:10.646604 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeac3879-9c32-43c5-af43-d165c7c086b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:10.647232 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeac3879-9c32-43c5-af43-d165c7c086b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:10.650235 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeac3879-9c32-43c5-af43-d165c7c086b0 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:10.656390 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 851/1688] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:57:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:57:10.668525 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973c6627-0a8b-4857-961d-b2ea3c5fad08 service placement] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:10.671007 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-973c6627-0a8b-4857-961d-b2ea3c5fad08 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:10.677878 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 838/1689] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:57:10 2022] GET /identity/v3/roles => generated 1420 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:57:10.681470 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a731b1f6-8bb0-4bd6-8052-addf9c9fdad2 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:10.683439 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a731b1f6-8bb0-4bd6-8052-addf9c9fdad2 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:10.683844 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a731b1f6-8bb0-4bd6-8052-addf9c9fdad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:10.720930 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973c6627-0a8b-4857-961d-b2ea3c5fad08 service placement] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:10.732252 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-a731b1f6-8bb0-4bd6-8052-addf9c9fdad2 None None] MFA Rules not processed for user `56875d0b48a04325a01d0d999ad186ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:10.732481 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520c3f77-c258-4f3a-88dc-150530791ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:10.732955 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520c3f77-c258-4f3a-88dc-150530791ef1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:10.733237 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520c3f77-c258-4f3a-88dc-150530791ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:10.733520 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-a731b1f6-8bb0-4bd6-8052-addf9c9fdad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:10.733633 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520c3f77-c258-4f3a-88dc-150530791ef1 admin admin] PATH_INFO: `/v3/projects/1054c8a9b2cc44e0b11808f376e133ea` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:10.734767 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520c3f77-c258-4f3a-88dc-150530791ef1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1054c8a9b2cc44e0b11808f376e133ea)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:10.737007 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520c3f77-c258-4f3a-88dc-150530791ef1 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:10.879377 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-520c3f77-c258-4f3a-88dc-150530791ef1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1054c8a9b2cc44e0b11808f376e133ea', 'request_id': 'req-520c3f77-c258-4f3a-88dc-150530791ef1'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:10.909280 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-520c3f77-c258-4f3a-88dc-150530791ef1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1054c8a9b2cc44e0b11808f376e133ea', 'request_id': 'req-520c3f77-c258-4f3a-88dc-150530791ef1'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:10.917247 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-520c3f77-c258-4f3a-88dc-150530791ef1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1054c8a9b2cc44e0b11808f376e133ea', 'request_id': 'req-520c3f77-c258-4f3a-88dc-150530791ef1'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:10.928387 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 839/1690] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:57:10 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:10.928387 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a731b1f6-8bb0-4bd6-8052-addf9c9fdad2 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:10.941042 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-520c3f77-c258-4f3a-88dc-150530791ef1 admin admin] The token cache is being invalidate because project 1054c8a9b2cc44e0b11808f376e133ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 14:57:10.941534 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-520c3f77-c258-4f3a-88dc-150530791ef1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:10.943788 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-520c3f77-c258-4f3a-88dc-150530791ef1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:10.949148 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 852/1691] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Sep 19 14:57:10 2022] DELETE /identity/v3/projects/1054c8a9b2cc44e0b11808f376e133ea => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:10.951200 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7757cef-5976-4a32-951d-067f73626bc8 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:10.952638 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7757cef-5976-4a32-951d-067f73626bc8 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:10.953049 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7757cef-5976-4a32-951d-067f73626bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:10.981992 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a731b1f6-8bb0-4bd6-8052-addf9c9fdad2 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:11.036725 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-e7757cef-5976-4a32-951d-067f73626bc8 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:11.042696 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-e7757cef-5976-4a32-951d-067f73626bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:11.069042 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:11.206229 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a907c6-481c-4289-99df-05d08481d554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:11.209547 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a907c6-481c-4289-99df-05d08481d554 admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:11.209907 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a907c6-481c-4289-99df-05d08481d554 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:11.210194 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a907c6-481c-4289-99df-05d08481d554 admin admin] PATH_INFO: `/v3/projects/c094510ef75e45899734ad2a56dffed2/users/fef7900069b049c1b04d95ddac8b0235/roles/efa0e5b3413748dc828a89b12d67df79` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:11.290641 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a907c6-481c-4289-99df-05d08481d554 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c094510ef75e45899734ad2a56dffed2, user_id=fef7900069b049c1b04d95ddac8b0235, role_id=efa0e5b3413748dc828a89b12d67df79)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:11.300485 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a907c6-481c-4289-99df-05d08481d554 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:11.314702 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 853/1692] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:57:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:11.319508 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7757cef-5976-4a32-951d-067f73626bc8 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:11.323493 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-e7757cef-5976-4a32-951d-067f73626bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:11.358464 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 840/1693] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 14:57:10 2022] PUT /identity/v3/projects/c094510ef75e45899734ad2a56dffed2/users/fef7900069b049c1b04d95ddac8b0235/roles/efa0e5b3413748dc828a89b12d67df79 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:11.360595 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2e5b0e-8332-4800-9cd7-96d5cb50d008 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:11.361544 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2e5b0e-8332-4800-9cd7-96d5cb50d008 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:11.361957 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2e5b0e-8332-4800-9cd7-96d5cb50d008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:11.392574 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-ec2e5b0e-8332-4800-9cd7-96d5cb50d008 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:11.394444 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-ec2e5b0e-8332-4800-9cd7-96d5cb50d008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:11.400205 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7757cef-5976-4a32-951d-067f73626bc8 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:11.466978 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 841/1694] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:57:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:11.468277 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce255612-e60e-4110-a4d9-67528d94d096 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:11.468606 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce255612-e60e-4110-a4d9-67528d94d096 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:11.468881 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce255612-e60e-4110-a4d9-67528d94d096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:11.498059 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:11.513766 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-ce255612-e60e-4110-a4d9-67528d94d096 None None] MFA Rules not processed for user `fef7900069b049c1b04d95ddac8b0235`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:11.515573 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-ce255612-e60e-4110-a4d9-67528d94d096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:11.582282 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b259c5-0ee6-4b37-9195-37168b5484b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:11.582936 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b259c5-0ee6-4b37-9195-37168b5484b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:11.583224 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b259c5-0ee6-4b37-9195-37168b5484b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:11.583498 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b259c5-0ee6-4b37-9195-37168b5484b9 admin admin] PATH_INFO: `/v3/projects/530e96755e0344a3841dd8c4688f9158` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:11.586030 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b259c5-0ee6-4b37-9195-37168b5484b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=530e96755e0344a3841dd8c4688f9158)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:11.588163 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b259c5-0ee6-4b37-9195-37168b5484b9 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:11.627124 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 842/1695] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:57:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:11.640775 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce255612-e60e-4110-a4d9-67528d94d096 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:11.673966 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce255612-e60e-4110-a4d9-67528d94d096 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:11.680676 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13663fe-28cf-4610-9dad-c5d41eb3dc88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:11.681440 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13663fe-28cf-4610-9dad-c5d41eb3dc88 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:11.681969 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13663fe-28cf-4610-9dad-c5d41eb3dc88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:11.682409 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13663fe-28cf-4610-9dad-c5d41eb3dc88 admin admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:11.683368 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13663fe-28cf-4610-9dad-c5d41eb3dc88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:57:11.683910 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13663fe-28cf-4610-9dad-c5d41eb3dc88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:11.685890 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13663fe-28cf-4610-9dad-c5d41eb3dc88 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:11.708675 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 843/1696] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Sep 19 14:57:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:57:11.710583 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85803a9-aeb1-48a6-bcd2-1d475a50ac06 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:11.711126 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85803a9-aeb1-48a6-bcd2-1d475a50ac06 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:11.711760 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85803a9-aeb1-48a6-bcd2-1d475a50ac06 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:11.713771 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 844/1697] 10.222.0.72 () {54 vars in 912 bytes} [Mon Sep 19 14:57:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:57:11.715188 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85803a9-aeb1-48a6-bcd2-1d475a50ac06 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:11.734255 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85803a9-aeb1-48a6-bcd2-1d475a50ac06 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:11.777210 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-a9b259c5-0ee6-4b37-9195-37168b5484b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '530e96755e0344a3841dd8c4688f9158', 'request_id': 'req-a9b259c5-0ee6-4b37-9195-37168b5484b9'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:11.791240 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-a9b259c5-0ee6-4b37-9195-37168b5484b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '530e96755e0344a3841dd8c4688f9158', 'request_id': 'req-a9b259c5-0ee6-4b37-9195-37168b5484b9'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:11.814662 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-a9b259c5-0ee6-4b37-9195-37168b5484b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '530e96755e0344a3841dd8c4688f9158', 'request_id': 'req-a9b259c5-0ee6-4b37-9195-37168b5484b9'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:11.847968 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cde13f-9ac0-4d64-aca0-6c493f0ab87b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:11.848179 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-a9b259c5-0ee6-4b37-9195-37168b5484b9 admin admin] The token cache is being invalidate because project 530e96755e0344a3841dd8c4688f9158 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 14:57:11.848277 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cde13f-9ac0-4d64-aca0-6c493f0ab87b admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:11.848565 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cde13f-9ac0-4d64-aca0-6c493f0ab87b admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:11.848932 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cde13f-9ac0-4d64-aca0-6c493f0ab87b admin admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:11.849179 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-a9b259c5-0ee6-4b37-9195-37168b5484b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:11.850454 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cde13f-9ac0-4d64-aca0-6c493f0ab87b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:11.850907 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-a9b259c5-0ee6-4b37-9195-37168b5484b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:11.857308 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 854/1698] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Sep 19 14:57:11 2022] DELETE /identity/v3/projects/530e96755e0344a3841dd8c4688f9158 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:11.857308 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e76b4c-cc83-4e3e-887d-242e9a043bf2 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:11.857531 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cde13f-9ac0-4d64-aca0-6c493f0ab87b admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:11.859344 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e76b4c-cc83-4e3e-887d-242e9a043bf2 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:11.861787 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e76b4c-cc83-4e3e-887d-242e9a043bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:11.917228 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-83e76b4c-cc83-4e3e-887d-242e9a043bf2 None None] MFA Rules not processed for user `f4c2b78646374cb79ded4b7b59ba49c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:11.919616 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-83e76b4c-cc83-4e3e-887d-242e9a043bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:11.940972 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 845/1699] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Sep 19 14:57:11 2022] POST /identity/v3/projects => generated 373 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:57:11.945896 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cde13f-9ac0-4d64-aca0-6c493f0ab87b admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:11.953001 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-b4cde13f-9ac0-4d64-aca0-6c493f0ab87b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:12.028878 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:12.061543 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 855/1700] 10.222.0.72 () {58 vars in 1009 bytes} [Mon Sep 19 14:57:11 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:12.062930 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e76b4c-cc83-4e3e-887d-242e9a043bf2 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:12.064810 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-83e76b4c-cc83-4e3e-887d-242e9a043bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:12.096177 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e76b4c-cc83-4e3e-887d-242e9a043bf2 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:12.127271 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cde13f-9ac0-4d64-aca0-6c493f0ab87b admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:12.140956 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a474d0f-a1b9-4309-9320-72f8b378e7c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:12.142042 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a474d0f-a1b9-4309-9320-72f8b378e7c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:12.142395 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a474d0f-a1b9-4309-9320-72f8b378e7c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:12.142835 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a474d0f-a1b9-4309-9320-72f8b378e7c4 admin admin] PATH_INFO: `/v3/projects/93217f5b2c5a459fa5fe2925baa87a2b` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:12.146145 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a474d0f-a1b9-4309-9320-72f8b378e7c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93217f5b2c5a459fa5fe2925baa87a2b)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:12.149367 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a474d0f-a1b9-4309-9320-72f8b378e7c4 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:12.167149 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:12.229283 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c227cf4f-5c2e-4da7-bdf6-b7f2018fd9ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:12.230189 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c227cf4f-5c2e-4da7-bdf6-b7f2018fd9ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:12.231334 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c227cf4f-5c2e-4da7-bdf6-b7f2018fd9ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:12.232262 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c227cf4f-5c2e-4da7-bdf6-b7f2018fd9ab admin admin] PATH_INFO: `/v3/users/96736c6419394013b37d4ed06088e59b` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:12.235832 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c227cf4f-5c2e-4da7-bdf6-b7f2018fd9ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=96736c6419394013b37d4ed06088e59b)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:12.238842 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c227cf4f-5c2e-4da7-bdf6-b7f2018fd9ab admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:12.246497 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-7a474d0f-a1b9-4309-9320-72f8b378e7c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93217f5b2c5a459fa5fe2925baa87a2b', 'request_id': 'req-7a474d0f-a1b9-4309-9320-72f8b378e7c4'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:12.262739 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-7a474d0f-a1b9-4309-9320-72f8b378e7c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93217f5b2c5a459fa5fe2925baa87a2b', 'request_id': 'req-7a474d0f-a1b9-4309-9320-72f8b378e7c4'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:12.272605 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-7a474d0f-a1b9-4309-9320-72f8b378e7c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93217f5b2c5a459fa5fe2925baa87a2b', 'request_id': 'req-7a474d0f-a1b9-4309-9320-72f8b378e7c4'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:12.311056 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-7a474d0f-a1b9-4309-9320-72f8b378e7c4 admin admin] The token cache is being invalidate because project 93217f5b2c5a459fa5fe2925baa87a2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 14:57:12.311427 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-7a474d0f-a1b9-4309-9320-72f8b378e7c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:12.312231 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-7a474d0f-a1b9-4309-9320-72f8b378e7c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:12.317405 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 846/1701] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Sep 19 14:57:11 2022] DELETE /identity/v3/projects/93217f5b2c5a459fa5fe2925baa87a2b => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:12.319216 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a474d0f-a1b9-4309-9320-72f8b378e7c4 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:12.323123 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-7a474d0f-a1b9-4309-9320-72f8b378e7c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:12.323982 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-c227cf4f-5c2e-4da7-bdf6-b7f2018fd9ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96736c6419394013b37d4ed06088e59b'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:12.365272 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-c227cf4f-5c2e-4da7-bdf6-b7f2018fd9ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96736c6419394013b37d4ed06088e59b'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:12.378031 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-c227cf4f-5c2e-4da7-bdf6-b7f2018fd9ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96736c6419394013b37d4ed06088e59b'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:12.380937 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-c227cf4f-5c2e-4da7-bdf6-b7f2018fd9ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96736c6419394013b37d4ed06088e59b'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:12.426734 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-c227cf4f-5c2e-4da7-bdf6-b7f2018fd9ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96736c6419394013b37d4ed06088e59b'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:12.450578 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 856/1702] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Sep 19 14:57:12 2022] DELETE /identity/v3/users/96736c6419394013b37d4ed06088e59b => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:12.454383 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c227cf4f-5c2e-4da7-bdf6-b7f2018fd9ab admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:12.455083 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a474d0f-a1b9-4309-9320-72f8b378e7c4 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:12.457162 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-c227cf4f-5c2e-4da7-bdf6-b7f2018fd9ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:12.625001 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5877d4c-49f0-4142-a5f4-368f14d86031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:12.626309 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5877d4c-49f0-4142-a5f4-368f14d86031 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:12.626309 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5877d4c-49f0-4142-a5f4-368f14d86031 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:12.626309 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5877d4c-49f0-4142-a5f4-368f14d86031 admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:12.626882 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5877d4c-49f0-4142-a5f4-368f14d86031 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:12.629321 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5877d4c-49f0-4142-a5f4-368f14d86031 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:12.684797 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 847/1703] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Sep 19 14:57:12 2022] POST /identity/v3/users => generated 287 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:57:12.684797 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5877d4c-49f0-4142-a5f4-368f14d86031 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:12.695604 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-b5877d4c-49f0-4142-a5f4-368f14d86031 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:12.698716 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c227cf4f-5c2e-4da7-bdf6-b7f2018fd9ab admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:12.735805 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe519b14-610a-4d88-8b4e-42c390c61fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:12.737656 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe519b14-610a-4d88-8b4e-42c390c61fa3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:12.738155 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe519b14-610a-4d88-8b4e-42c390c61fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:12.738633 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe519b14-610a-4d88-8b4e-42c390c61fa3 admin admin] PATH_INFO: `/v3/projects/9bd8640abe3e4e35a4dabd365051929d` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:12.740557 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe519b14-610a-4d88-8b4e-42c390c61fa3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bd8640abe3e4e35a4dabd365051929d)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:12.755091 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe519b14-610a-4d88-8b4e-42c390c61fa3 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:12.782225 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:12.862227 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:12.879448 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-fe519b14-610a-4d88-8b4e-42c390c61fa3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bd8640abe3e4e35a4dabd365051929d', 'request_id': 'req-fe519b14-610a-4d88-8b4e-42c390c61fa3'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:12.893284 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-fe519b14-610a-4d88-8b4e-42c390c61fa3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bd8640abe3e4e35a4dabd365051929d', 'request_id': 'req-fe519b14-610a-4d88-8b4e-42c390c61fa3'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:12.915245 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-fe519b14-610a-4d88-8b4e-42c390c61fa3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bd8640abe3e4e35a4dabd365051929d', 'request_id': 'req-fe519b14-610a-4d88-8b4e-42c390c61fa3'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:12.929480 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5877d4c-49f0-4142-a5f4-368f14d86031 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:12.943676 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-fe519b14-610a-4d88-8b4e-42c390c61fa3 admin admin] The token cache is being invalidate because project 9bd8640abe3e4e35a4dabd365051929d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 14:57:12.946450 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-fe519b14-610a-4d88-8b4e-42c390c61fa3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:12.948792 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-fe519b14-610a-4d88-8b4e-42c390c61fa3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:12.959323 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 857/1704] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Sep 19 14:57:12 2022] DELETE /identity/v3/projects/9bd8640abe3e4e35a4dabd365051929d => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:12.960908 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e13dc56-8f69-4131-ad08-eff7123eaafe None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:12.961197 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e13dc56-8f69-4131-ad08-eff7123eaafe None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:12.961474 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e13dc56-8f69-4131-ad08-eff7123eaafe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:13.010573 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-7e13dc56-8f69-4131-ad08-eff7123eaafe None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:13.012394 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-7e13dc56-8f69-4131-ad08-eff7123eaafe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:13.059025 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055a6137-3f9c-48c1-a601-229288743d6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c2b78646374cb79ded4b7b59ba49c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:13.059786 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055a6137-3f9c-48c1-a601-229288743d6b service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:13.060161 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055a6137-3f9c-48c1-a601-229288743d6b service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:13.060655 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055a6137-3f9c-48c1-a601-229288743d6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:13.066636 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-055a6137-3f9c-48c1-a601-229288743d6b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:13.089098 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055a6137-3f9c-48c1-a601-229288743d6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:13.095311 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055a6137-3f9c-48c1-a601-229288743d6b service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:13.123888 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 848/1705] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:57:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:57:13.124792 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055a6137-3f9c-48c1-a601-229288743d6b service neutron] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:13.129153 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-055a6137-3f9c-48c1-a601-229288743d6b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:13.264212 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 858/1706] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:57:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:13.264212 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5a8e5d-0bd9-49f8-90e2-9b0e551b8782 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:13.264212 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5a8e5d-0bd9-49f8-90e2-9b0e551b8782 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:13.264212 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5a8e5d-0bd9-49f8-90e2-9b0e551b8782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:13.293686 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055a6137-3f9c-48c1-a601-229288743d6b service neutron] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:13.301526 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608934aa-b82a-4adc-9029-6447d9dbaa56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:13.302168 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608934aa-b82a-4adc-9029-6447d9dbaa56 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:13.302451 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608934aa-b82a-4adc-9029-6447d9dbaa56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:13.302714 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608934aa-b82a-4adc-9029-6447d9dbaa56 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:13.303391 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608934aa-b82a-4adc-9029-6447d9dbaa56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:13.307544 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608934aa-b82a-4adc-9029-6447d9dbaa56 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:13.332188 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 849/1707] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:57:13 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:57:13.333109 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608934aa-b82a-4adc-9029-6447d9dbaa56 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:13.345172 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-608934aa-b82a-4adc-9029-6447d9dbaa56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:13.359684 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-5e5a8e5d-0bd9-49f8-90e2-9b0e551b8782 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:13.360779 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-5e5a8e5d-0bd9-49f8-90e2-9b0e551b8782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:13.374990 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608934aa-b82a-4adc-9029-6447d9dbaa56 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:13.384480 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e1851b-991e-4d09-ae99-163d7c557b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:13.385169 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e1851b-991e-4d09-ae99-163d7c557b7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:13.385402 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e1851b-991e-4d09-ae99-163d7c557b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:13.386119 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e1851b-991e-4d09-ae99-163d7c557b7d admin admin] PATH_INFO: `/v3/projects/ed4e913500c64c3f9eaa7c381dc13030` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:13.392313 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 859/1708] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:57:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:13.393185 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e1851b-991e-4d09-ae99-163d7c557b7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed4e913500c64c3f9eaa7c381dc13030)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:13.393298 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5a8e5d-0bd9-49f8-90e2-9b0e551b8782 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:13.394808 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e1851b-991e-4d09-ae99-163d7c557b7d admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:13.401175 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-5e5a8e5d-0bd9-49f8-90e2-9b0e551b8782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:13.509066 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-57e1851b-991e-4d09-ae99-163d7c557b7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed4e913500c64c3f9eaa7c381dc13030', 'request_id': 'req-57e1851b-991e-4d09-ae99-163d7c557b7d'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:13.526302 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-57e1851b-991e-4d09-ae99-163d7c557b7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed4e913500c64c3f9eaa7c381dc13030', 'request_id': 'req-57e1851b-991e-4d09-ae99-163d7c557b7d'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:13.536785 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-57e1851b-991e-4d09-ae99-163d7c557b7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed4e913500c64c3f9eaa7c381dc13030', 'request_id': 'req-57e1851b-991e-4d09-ae99-163d7c557b7d'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:13.566979 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-57e1851b-991e-4d09-ae99-163d7c557b7d admin admin] The token cache is being invalidate because project ed4e913500c64c3f9eaa7c381dc13030 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 14:57:13.566979 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-57e1851b-991e-4d09-ae99-163d7c557b7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:13.567790 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-57e1851b-991e-4d09-ae99-163d7c557b7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:13.572172 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 850/1709] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Sep 19 14:57:13 2022] DELETE /identity/v3/projects/ed4e913500c64c3f9eaa7c381dc13030 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:13.573218 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158afccd-10e5-4a93-995d-e7a918e03cfc None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:13.573495 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158afccd-10e5-4a93-995d-e7a918e03cfc None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:13.573772 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158afccd-10e5-4a93-995d-e7a918e03cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:13.574947 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5a8e5d-0bd9-49f8-90e2-9b0e551b8782 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:13.614325 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-158afccd-10e5-4a93-995d-e7a918e03cfc None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:13.615698 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-158afccd-10e5-4a93-995d-e7a918e03cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:13.635425 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:13.646206 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:13.713957 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cbe5cb-4c87-4fc6-90d1-4e26ff8526f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055439dc35e946f4a82535c684f9b60d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:13.715402 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cbe5cb-4c87-4fc6-90d1-4e26ff8526f5 service nova] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:13.715693 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cbe5cb-4c87-4fc6-90d1-4e26ff8526f5 service nova] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:13.716885 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cbe5cb-4c87-4fc6-90d1-4e26ff8526f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:13.719478 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-97cbe5cb-4c87-4fc6-90d1-4e26ff8526f5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:13.792529 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 851/1710] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:57:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:13.792529 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158afccd-10e5-4a93-995d-e7a918e03cfc None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:13.798390 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-158afccd-10e5-4a93-995d-e7a918e03cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:13.821412 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158afccd-10e5-4a93-995d-e7a918e03cfc None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:13.830859 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a204b3d-bd01-44ed-9f60-ade9a2a6e20f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:13.831641 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a204b3d-bd01-44ed-9f60-ade9a2a6e20f admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:13.832017 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a204b3d-bd01-44ed-9f60-ade9a2a6e20f admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:13.832437 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a204b3d-bd01-44ed-9f60-ade9a2a6e20f admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:13.833239 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a204b3d-bd01-44ed-9f60-ade9a2a6e20f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:13.836155 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a204b3d-bd01-44ed-9f60-ade9a2a6e20f admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:13.860526 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 852/1711] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:57:13 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:57:13.861901 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bfd92c-82c7-4b4d-854c-801b475c951d None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:13.862185 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bfd92c-82c7-4b4d-854c-801b475c951d None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:13.862456 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bfd92c-82c7-4b4d-854c-801b475c951d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:13.912874 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-a1bfd92c-82c7-4b4d-854c-801b475c951d None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:13.914221 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-a1bfd92c-82c7-4b4d-854c-801b475c951d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:13.931216 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 853/1712] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:57:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:13.932546 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b186945-a101-4d39-a40a-6c14622809be None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:13.932925 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b186945-a101-4d39-a40a-6c14622809be None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:13.933197 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b186945-a101-4d39-a40a-6c14622809be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:13.952690 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cbe5cb-4c87-4fc6-90d1-4e26ff8526f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:13.958314 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cbe5cb-4c87-4fc6-90d1-4e26ff8526f5 service nova] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:13.968170 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-7b186945-a101-4d39-a40a-6c14622809be None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:13.969531 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-7b186945-a101-4d39-a40a-6c14622809be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:13.999804 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 854/1713] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:57:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:14.001552 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b186945-a101-4d39-a40a-6c14622809be None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:14.023800 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b186945-a101-4d39-a40a-6c14622809be None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:14.026817 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 860/1714] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:57:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 634 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:57:14.030685 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cbe5cb-4c87-4fc6-90d1-4e26ff8526f5 service nova] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:14.035111 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f22547-ee62-4106-96e1-65da6d37768e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:14.035742 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f22547-ee62-4106-96e1-65da6d37768e admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:14.036392 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f22547-ee62-4106-96e1-65da6d37768e admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:14.036685 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f22547-ee62-4106-96e1-65da6d37768e admin admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:14.037340 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f22547-ee62-4106-96e1-65da6d37768e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:57:14.037644 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f22547-ee62-4106-96e1-65da6d37768e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:14.043698 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f22547-ee62-4106-96e1-65da6d37768e admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:14.072410 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 855/1715] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Sep 19 14:57:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:57:14.072410 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f22547-ee62-4106-96e1-65da6d37768e admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:14.107038 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f22547-ee62-4106-96e1-65da6d37768e admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:14.118136 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c27bbf-03c9-4c3e-bba9-e84f1d0cfef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:14.118768 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c27bbf-03c9-4c3e-bba9-e84f1d0cfef9 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:14.119046 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c27bbf-03c9-4c3e-bba9-e84f1d0cfef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:14.120547 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c27bbf-03c9-4c3e-bba9-e84f1d0cfef9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:14.122202 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c27bbf-03c9-4c3e-bba9-e84f1d0cfef9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:57:14.122513 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c27bbf-03c9-4c3e-bba9-e84f1d0cfef9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:14.124125 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c27bbf-03c9-4c3e-bba9-e84f1d0cfef9 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:14.153636 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cbe5cb-4c87-4fc6-90d1-4e26ff8526f5 service nova] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:14.155405 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 856/1716] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Sep 19 14:57:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:57:14.160791 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1762827d-19c8-43bc-8e22-1caf59b3da9c None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:14.161067 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1762827d-19c8-43bc-8e22-1caf59b3da9c None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:14.161338 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1762827d-19c8-43bc-8e22-1caf59b3da9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:14.173564 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c19b07b-3793-4d7c-8185-f55648eaeb88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:14.178813 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c19b07b-3793-4d7c-8185-f55648eaeb88 admin admin] REQUEST_METHOD: `PUT` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:14.179204 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c19b07b-3793-4d7c-8185-f55648eaeb88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:14.179436 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c19b07b-3793-4d7c-8185-f55648eaeb88 admin admin] PATH_INFO: `/v3/projects/0d75db32de404780bcbd2c02dddd5447/users/f4549c964ac14292ab3b0bd0f5569134/roles/efa0e5b3413748dc828a89b12d67df79` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:14.207802 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-1762827d-19c8-43bc-8e22-1caf59b3da9c None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:14.210399 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-1762827d-19c8-43bc-8e22-1caf59b3da9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:14.224145 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 857/1717] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:57:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:14.225349 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1762827d-19c8-43bc-8e22-1caf59b3da9c None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:14.261431 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1762827d-19c8-43bc-8e22-1caf59b3da9c None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:14.279922 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b6c967-7f6f-4aed-9fc5-83bd926e589c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:14.283749 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b6c967-7f6f-4aed-9fc5-83bd926e589c admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:14.284038 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b6c967-7f6f-4aed-9fc5-83bd926e589c admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:14.285743 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b6c967-7f6f-4aed-9fc5-83bd926e589c admin admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:14.288315 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b6c967-7f6f-4aed-9fc5-83bd926e589c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:14.289307 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c19b07b-3793-4d7c-8185-f55648eaeb88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d75db32de404780bcbd2c02dddd5447, user_id=f4549c964ac14292ab3b0bd0f5569134, role_id=efa0e5b3413748dc828a89b12d67df79)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:14.299641 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b6c967-7f6f-4aed-9fc5-83bd926e589c admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:14.302602 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c19b07b-3793-4d7c-8185-f55648eaeb88 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:14.352899 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 861/1718] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 14:57:14 2022] PUT /identity/v3/projects/0d75db32de404780bcbd2c02dddd5447/users/f4549c964ac14292ab3b0bd0f5569134/roles/efa0e5b3413748dc828a89b12d67df79 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:14.368180 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c19b07b-3793-4d7c-8185-f55648eaeb88 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:14.439039 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 858/1719] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Sep 19 14:57:14 2022] POST /identity/v3/projects => generated 369 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:57:14.440017 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b6c967-7f6f-4aed-9fc5-83bd926e589c admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:14.602112 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c19b07b-3793-4d7c-8185-f55648eaeb88 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:14.640625 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b6c967-7f6f-4aed-9fc5-83bd926e589c admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:14.655250 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db67bdcc-b69b-4aa4-8543-0f97efbbff6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:14.655985 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db67bdcc-b69b-4aa4-8543-0f97efbbff6b admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:14.656353 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db67bdcc-b69b-4aa4-8543-0f97efbbff6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:14.656751 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db67bdcc-b69b-4aa4-8543-0f97efbbff6b admin admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:14.661113 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db67bdcc-b69b-4aa4-8543-0f97efbbff6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:57:14.661520 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db67bdcc-b69b-4aa4-8543-0f97efbbff6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:14.663607 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db67bdcc-b69b-4aa4-8543-0f97efbbff6b admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:14.691427 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 859/1720] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Sep 19 14:57:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:57:14.693013 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72554b21-56a4-4e25-9791-540549afaef6 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:14.696854 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72554b21-56a4-4e25-9791-540549afaef6 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:14.697221 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72554b21-56a4-4e25-9791-540549afaef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:14.746510 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:14.769331 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e222dc70-87fd-48a6-9c25-821efef5c972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:14.769969 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e222dc70-87fd-48a6-9c25-821efef5c972 admin admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:14.770252 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e222dc70-87fd-48a6-9c25-821efef5c972 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:14.770565 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e222dc70-87fd-48a6-9c25-821efef5c972 admin admin] PATH_INFO: `/v3/projects` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:14.771187 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e222dc70-87fd-48a6-9c25-821efef5c972 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:14.773137 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e222dc70-87fd-48a6-9c25-821efef5c972 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:14.788892 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-72554b21-56a4-4e25-9791-540549afaef6 None None] MFA Rules not processed for user `f4549c964ac14292ab3b0bd0f5569134`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:14.790217 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-72554b21-56a4-4e25-9791-540549afaef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:14.834375 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:14.885520 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 862/1721] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Sep 19 14:57:14 2022] POST /identity/v3/projects => generated 373 bytes in 532 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:57:14.892594 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e222dc70-87fd-48a6-9c25-821efef5c972 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:14.934846 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 860/1722] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:57:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:14.936078 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72554b21-56a4-4e25-9791-540549afaef6 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:14.958520 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72554b21-56a4-4e25-9791-540549afaef6 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:15.090558 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e222dc70-87fd-48a6-9c25-821efef5c972 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:15.101104 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54528b6b-abc3-4975-8926-c8664e4cec43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:15.104689 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54528b6b-abc3-4975-8926-c8664e4cec43 admin admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:15.105005 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54528b6b-abc3-4975-8926-c8664e4cec43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:15.105290 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54528b6b-abc3-4975-8926-c8664e4cec43 admin admin] PATH_INFO: `/v3/users` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:15.106360 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54528b6b-abc3-4975-8926-c8664e4cec43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:15.111692 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54528b6b-abc3-4975-8926-c8664e4cec43 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:15.136028 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170e6cfb-75ad-4f4c-964d-c445a4f8615a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:15.136695 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170e6cfb-75ad-4f4c-964d-c445a4f8615a admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:15.136980 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170e6cfb-75ad-4f4c-964d-c445a4f8615a admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:15.137259 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170e6cfb-75ad-4f4c-964d-c445a4f8615a admin admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:15.137909 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170e6cfb-75ad-4f4c-964d-c445a4f8615a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:15.145073 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170e6cfb-75ad-4f4c-964d-c445a4f8615a admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:15.175083 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 863/1723] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Sep 19 14:57:14 2022] POST /identity/v3/users => generated 285 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:57:15.176634 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54528b6b-abc3-4975-8926-c8664e4cec43 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:15.180596 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-54528b6b-abc3-4975-8926-c8664e4cec43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:15.211268 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54528b6b-abc3-4975-8926-c8664e4cec43 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:15.215214 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 861/1724] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Sep 19 14:57:14 2022] POST /identity/v3/projects => generated 399 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:57:15.220821 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170e6cfb-75ad-4f4c-964d-c445a4f8615a admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:15.222386 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51acd2b1-b4eb-49ac-b80a-7e38d70a5c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:15.223457 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51acd2b1-b4eb-49ac-b80a-7e38d70a5c25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:15.223726 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51acd2b1-b4eb-49ac-b80a-7e38d70a5c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:15.224083 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51acd2b1-b4eb-49ac-b80a-7e38d70a5c25 admin admin] PATH_INFO: `/v3/users/fef7900069b049c1b04d95ddac8b0235` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:15.225393 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51acd2b1-b4eb-49ac-b80a-7e38d70a5c25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fef7900069b049c1b04d95ddac8b0235)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:15.227670 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51acd2b1-b4eb-49ac-b80a-7e38d70a5c25 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:15.304895 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-51acd2b1-b4eb-49ac-b80a-7e38d70a5c25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fef7900069b049c1b04d95ddac8b0235'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:15.324283 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-51acd2b1-b4eb-49ac-b80a-7e38d70a5c25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fef7900069b049c1b04d95ddac8b0235'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:15.343098 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-51acd2b1-b4eb-49ac-b80a-7e38d70a5c25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fef7900069b049c1b04d95ddac8b0235'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:15.345759 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170e6cfb-75ad-4f4c-964d-c445a4f8615a admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:15.347799 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-51acd2b1-b4eb-49ac-b80a-7e38d70a5c25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fef7900069b049c1b04d95ddac8b0235'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:15.355185 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea3ad29-e919-4382-8593-a292986dde70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:15.355815 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea3ad29-e919-4382-8593-a292986dde70 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:15.356109 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea3ad29-e919-4382-8593-a292986dde70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:15.356403 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea3ad29-e919-4382-8593-a292986dde70 admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:15.357081 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea3ad29-e919-4382-8593-a292986dde70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:15.363389 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-51acd2b1-b4eb-49ac-b80a-7e38d70a5c25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fef7900069b049c1b04d95ddac8b0235'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:15.367428 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea3ad29-e919-4382-8593-a292986dde70 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:15.379731 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 864/1725] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Sep 19 14:57:15 2022] DELETE /identity/v3/users/fef7900069b049c1b04d95ddac8b0235 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:15.382943 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51acd2b1-b4eb-49ac-b80a-7e38d70a5c25 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:15.384497 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-51acd2b1-b4eb-49ac-b80a-7e38d70a5c25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:15.414709 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 862/1726] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Sep 19 14:57:15 2022] POST /identity/v3/users => generated 287 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:57:15.416501 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afabf22-2dd8-4ec8-928c-79648b617f51 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:15.416805 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afabf22-2dd8-4ec8-928c-79648b617f51 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:15.417202 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afabf22-2dd8-4ec8-928c-79648b617f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:15.475498 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:15.522060 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-7afabf22-2dd8-4ec8-928c-79648b617f51 None None] MFA Rules not processed for user `afbbbf11f3234297ab1dd509f064480f`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:15.523591 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-7afabf22-2dd8-4ec8-928c-79648b617f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:15.526421 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51acd2b1-b4eb-49ac-b80a-7e38d70a5c25 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:15.537542 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:15.539878 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5937c0-f841-460c-832b-999e79036a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:15.540961 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5937c0-f841-460c-832b-999e79036a41 admin admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:15.543132 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5937c0-f841-460c-832b-999e79036a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:15.543724 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5937c0-f841-460c-832b-999e79036a41 admin admin] PATH_INFO: `/v3/projects` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:15.544566 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5937c0-f841-460c-832b-999e79036a41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:15.549929 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5937c0-f841-460c-832b-999e79036a41 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:15.608527 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 865/1727] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Sep 19 14:57:15 2022] POST /identity/v3/projects => generated 373 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:57:15.613785 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c229f61-2d55-4cfb-a38f-2d0b885eeec0 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:15.616126 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c229f61-2d55-4cfb-a38f-2d0b885eeec0 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:15.616259 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c229f61-2d55-4cfb-a38f-2d0b885eeec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:15.677378 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 863/1728] 10.222.0.72 () {58 vars in 1009 bytes} [Mon Sep 19 14:57:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:15.678489 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-8c229f61-2d55-4cfb-a38f-2d0b885eeec0 None None] MFA Rules not processed for user `c3773acf65044281ae7837258aefd5ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:15.679571 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afabf22-2dd8-4ec8-928c-79648b617f51 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:15.681618 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-8c229f61-2d55-4cfb-a38f-2d0b885eeec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:15.702071 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-7afabf22-2dd8-4ec8-928c-79648b617f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:15.789813 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afabf22-2dd8-4ec8-928c-79648b617f51 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:15.907189 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 866/1729] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:57:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:15.908238 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c229f61-2d55-4cfb-a38f-2d0b885eeec0 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:15.909905 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-8c229f61-2d55-4cfb-a38f-2d0b885eeec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:15.973579 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a51e06-8e81-43d3-9098-17fd9f625c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:15.975172 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a51e06-8e81-43d3-9098-17fd9f625c6f admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:15.975556 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a51e06-8e81-43d3-9098-17fd9f625c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:15.975889 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a51e06-8e81-43d3-9098-17fd9f625c6f admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:15.976688 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a51e06-8e81-43d3-9098-17fd9f625c6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:15.979875 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a51e06-8e81-43d3-9098-17fd9f625c6f admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:16.012779 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 864/1730] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:57:15 2022] GET /identity/v3/roles => generated 1420 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:57:16.014202 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb560d6f-f58c-435e-965d-6bbabd92bba9 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:16.014494 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb560d6f-f58c-435e-965d-6bbabd92bba9 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:16.014769 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb560d6f-f58c-435e-965d-6bbabd92bba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:16.022704 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c229f61-2d55-4cfb-a38f-2d0b885eeec0 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:16.031044 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73342e77-1393-4bc3-bfcf-172ecfe500af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:16.032813 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73342e77-1393-4bc3-bfcf-172ecfe500af admin admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:16.033411 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73342e77-1393-4bc3-bfcf-172ecfe500af admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:16.033912 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73342e77-1393-4bc3-bfcf-172ecfe500af admin admin] PATH_INFO: `/v3/users` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:16.035331 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73342e77-1393-4bc3-bfcf-172ecfe500af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:16.037853 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73342e77-1393-4bc3-bfcf-172ecfe500af admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:16.038061 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-fb560d6f-f58c-435e-965d-6bbabd92bba9 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:16.039462 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-fb560d6f-f58c-435e-965d-6bbabd92bba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:16.061981 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 865/1731] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:57:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:16.063708 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb560d6f-f58c-435e-965d-6bbabd92bba9 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:16.066611 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-fb560d6f-f58c-435e-965d-6bbabd92bba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:16.082482 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 867/1732] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Sep 19 14:57:15 2022] POST /identity/v3/users => generated 300 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:57:16.083573 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73342e77-1393-4bc3-bfcf-172ecfe500af admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:16.091651 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb560d6f-f58c-435e-965d-6bbabd92bba9 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:16.098689 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73342e77-1393-4bc3-bfcf-172ecfe500af admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:16.101470 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac23c4d-a86b-49d5-ac37-3d2e105b0fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:16.102270 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac23c4d-a86b-49d5-ac37-3d2e105b0fef admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:16.102700 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac23c4d-a86b-49d5-ac37-3d2e105b0fef admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:16.103195 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac23c4d-a86b-49d5-ac37-3d2e105b0fef admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:16.103997 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac23c4d-a86b-49d5-ac37-3d2e105b0fef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:16.106066 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac23c4d-a86b-49d5-ac37-3d2e105b0fef admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:16.116639 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafc162b-4b2b-4ea9-9733-c6e01f0a69fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:16.117572 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafc162b-4b2b-4ea9-9733-c6e01f0a69fa admin admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:16.119651 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 866/1733] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:57:16 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:57:16.119938 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafc162b-4b2b-4ea9-9733-c6e01f0a69fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:16.120319 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafc162b-4b2b-4ea9-9733-c6e01f0a69fa admin admin] PATH_INFO: `/v3/users` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:16.121392 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac23c4d-a86b-49d5-ac37-3d2e105b0fef admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:16.122532 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafc162b-4b2b-4ea9-9733-c6e01f0a69fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:16.124272 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-4ac23c4d-a86b-49d5-ac37-3d2e105b0fef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:16.127767 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafc162b-4b2b-4ea9-9733-c6e01f0a69fa admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:16.174197 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 868/1734] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Sep 19 14:57:16 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:57:16.176350 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafc162b-4b2b-4ea9-9733-c6e01f0a69fa admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:16.180279 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-cafc162b-4b2b-4ea9-9733-c6e01f0a69fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:16.231613 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:16.270510 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac23c4d-a86b-49d5-ac37-3d2e105b0fef admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:16.285278 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e22eb2-c548-4798-9309-f831345b2f41 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055439dc35e946f4a82535c684f9b60d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:16.287172 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e22eb2-c548-4798-9309-f831345b2f41 service nova] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:16.287457 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e22eb2-c548-4798-9309-f831345b2f41 service nova] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:16.287735 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e22eb2-c548-4798-9309-f831345b2f41 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:16.302343 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e22eb2-c548-4798-9309-f831345b2f41 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:16.307731 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e22eb2-c548-4798-9309-f831345b2f41 service nova] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:16.332907 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 867/1735] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:57:16 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:57:16.334073 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e22eb2-c548-4798-9309-f831345b2f41 service nova] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:16.337106 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafc162b-4b2b-4ea9-9733-c6e01f0a69fa admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:16.358030 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284d9b2e-749e-42f6-93bb-1d6f6011159b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8504425c3a414608b030d0cf1af78af5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:16.358636 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e22eb2-c548-4798-9309-f831345b2f41 service nova] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:16.359148 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284d9b2e-749e-42f6-93bb-1d6f6011159b service swift] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:16.359148 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284d9b2e-749e-42f6-93bb-1d6f6011159b service swift] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:16.359287 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284d9b2e-749e-42f6-93bb-1d6f6011159b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:16.371670 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb85220-5217-4563-8908-1f67150b2171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:16.372225 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb85220-5217-4563-8908-1f67150b2171 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:16.372558 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb85220-5217-4563-8908-1f67150b2171 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:16.372827 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb85220-5217-4563-8908-1f67150b2171 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:16.373476 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb85220-5217-4563-8908-1f67150b2171 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:16.375286 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb85220-5217-4563-8908-1f67150b2171 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:16.384679 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:16.397692 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 868/1736] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:57:16 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:57:16.400678 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb85220-5217-4563-8908-1f67150b2171 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:16.414620 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-7fb85220-5217-4563-8908-1f67150b2171 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:16.570562 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284d9b2e-749e-42f6-93bb-1d6f6011159b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:16.581991 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284d9b2e-749e-42f6-93bb-1d6f6011159b service swift] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:16.597602 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb85220-5217-4563-8908-1f67150b2171 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:16.608557 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ae68f8-f9af-4e31-afdf-364e2bad07d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c2b78646374cb79ded4b7b59ba49c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:16.609490 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ae68f8-f9af-4e31-afdf-364e2bad07d6 service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:16.610345 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ae68f8-f9af-4e31-afdf-364e2bad07d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:16.610932 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ae68f8-f9af-4e31-afdf-364e2bad07d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:16.620740 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 869/1737] 10.222.0.72 () {60 vars in 1384 bytes} [Mon Sep 19 14:57:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 14:57:16.621883 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284d9b2e-749e-42f6-93bb-1d6f6011159b service swift] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:16.635149 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ae68f8-f9af-4e31-afdf-364e2bad07d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:16.639187 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ae68f8-f9af-4e31-afdf-364e2bad07d6 service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:16.669078 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 869/1738] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:57:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:57:16.678105 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ae68f8-f9af-4e31-afdf-364e2bad07d6 service neutron] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:16.691820 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284d9b2e-749e-42f6-93bb-1d6f6011159b service swift] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:16.716461 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ae68f8-f9af-4e31-afdf-364e2bad07d6 service neutron] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:16.723030 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59a55e9-90ef-43fd-964b-83e4fce2611d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:16.727574 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23beda7-6625-4a36-91a7-3d30fa919ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:16.729229 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a55e9-90ef-43fd-964b-83e4fce2611d admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:16.729229 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a55e9-90ef-43fd-964b-83e4fce2611d admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:16.729457 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a55e9-90ef-43fd-964b-83e4fce2611d admin admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:16.733367 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59a55e9-90ef-43fd-964b-83e4fce2611d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:16.740073 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23beda7-6625-4a36-91a7-3d30fa919ac2 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:16.740767 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23beda7-6625-4a36-91a7-3d30fa919ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:16.741130 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23beda7-6625-4a36-91a7-3d30fa919ac2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:16.742272 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59a55e9-90ef-43fd-964b-83e4fce2611d admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:16.743047 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23beda7-6625-4a36-91a7-3d30fa919ac2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:16.747338 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23beda7-6625-4a36-91a7-3d30fa919ac2 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:16.784842 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 870/1739] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:57:16 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:57:16.785966 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23beda7-6625-4a36-91a7-3d30fa919ac2 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:16.803057 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23beda7-6625-4a36-91a7-3d30fa919ac2 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:16.816244 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 870/1740] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:57:16 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:57:16.822275 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59a55e9-90ef-43fd-964b-83e4fce2611d admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:16.824271 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6b90e7-25bb-4d51-8122-867e19844149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:16.825226 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b90e7-25bb-4d51-8122-867e19844149 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:16.825722 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b90e7-25bb-4d51-8122-867e19844149 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:16.826204 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b90e7-25bb-4d51-8122-867e19844149 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:16.827061 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6b90e7-25bb-4d51-8122-867e19844149 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:16.836089 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6b90e7-25bb-4d51-8122-867e19844149 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:16.866549 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59a55e9-90ef-43fd-964b-83e4fce2611d admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:16.874886 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 871/1741] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:57:16 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:57:16.896252 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2857ad4b-5eb3-491e-958a-760a8f9ae3cf None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:16.896707 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2857ad4b-5eb3-491e-958a-760a8f9ae3cf None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:16.897831 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2857ad4b-5eb3-491e-958a-760a8f9ae3cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:16.916706 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5a846b-9d90-4442-97bd-9df84947fa51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:16.923415 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5a846b-9d90-4442-97bd-9df84947fa51 admin admin] REQUEST_METHOD: `PUT` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:16.923733 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5a846b-9d90-4442-97bd-9df84947fa51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:16.924013 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5a846b-9d90-4442-97bd-9df84947fa51 admin admin] PATH_INFO: `/v3/projects/8e6db0b65a3f4835b9b40afa30a04a10/users/5871cc5af88642b1beccb3a1914af91e/roles/efa0e5b3413748dc828a89b12d67df79` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:16.965125 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5a846b-9d90-4442-97bd-9df84947fa51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e6db0b65a3f4835b9b40afa30a04a10, user_id=5871cc5af88642b1beccb3a1914af91e, role_id=efa0e5b3413748dc828a89b12d67df79)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:16.968224 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5a846b-9d90-4442-97bd-9df84947fa51 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:17.018683 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 871/1742] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 14:57:16 2022] PUT /identity/v3/projects/8e6db0b65a3f4835b9b40afa30a04a10/users/5871cc5af88642b1beccb3a1914af91e/roles/efa0e5b3413748dc828a89b12d67df79 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:17.019848 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5a846b-9d90-4442-97bd-9df84947fa51 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:17.041999 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-2857ad4b-5eb3-491e-958a-760a8f9ae3cf None None] MFA Rules not processed for user `f4c2b78646374cb79ded4b7b59ba49c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:17.044693 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-2857ad4b-5eb3-491e-958a-760a8f9ae3cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:17.252276 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5a846b-9d90-4442-97bd-9df84947fa51 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:17.255343 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d319e947-6e51-4b1b-9a4a-9e9bf65b965d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:17.264652 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d319e947-6e51-4b1b-9a4a-9e9bf65b965d admin admin] REQUEST_METHOD: `PUT` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:17.265082 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d319e947-6e51-4b1b-9a4a-9e9bf65b965d admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:17.265479 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d319e947-6e51-4b1b-9a4a-9e9bf65b965d admin admin] PATH_INFO: `/v3/projects/ebf93090f12c4157b73dad9dc9b463fc/users/3cadbd1af62d4c60aac9e41cf606e121/roles/efa0e5b3413748dc828a89b12d67df79` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:17.285931 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 872/1743] 10.222.0.85 () {58 vars in 1015 bytes} [Mon Sep 19 14:57:16 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 414 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:17.286966 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2857ad4b-5eb3-491e-958a-760a8f9ae3cf None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:17.315618 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d319e947-6e51-4b1b-9a4a-9e9bf65b965d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebf93090f12c4157b73dad9dc9b463fc, user_id=3cadbd1af62d4c60aac9e41cf606e121, role_id=efa0e5b3413748dc828a89b12d67df79)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:17.327517 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d319e947-6e51-4b1b-9a4a-9e9bf65b965d admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:17.337220 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2857ad4b-5eb3-491e-958a-760a8f9ae3cf None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:17.338752 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:17.345313 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bdd7fc-4e86-4848-af70-c1a1bab2dcd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:17.346561 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bdd7fc-4e86-4848-af70-c1a1bab2dcd8 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:17.347024 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bdd7fc-4e86-4848-af70-c1a1bab2dcd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:17.347423 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bdd7fc-4e86-4848-af70-c1a1bab2dcd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:17.350689 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bdd7fc-4e86-4848-af70-c1a1bab2dcd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:17.353019 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bdd7fc-4e86-4848-af70-c1a1bab2dcd8 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:17.366692 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 872/1744] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 14:57:17 2022] PUT /identity/v3/projects/ebf93090f12c4157b73dad9dc9b463fc/users/3cadbd1af62d4c60aac9e41cf606e121/roles/efa0e5b3413748dc828a89b12d67df79 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:17.367701 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d319e947-6e51-4b1b-9a4a-9e9bf65b965d admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:17.398100 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 873/1745] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:57:17 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:57:17.401365 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5131f3e-1879-4a16-9d87-a2b29b1b3947 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:17.402341 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5131f3e-1879-4a16-9d87-a2b29b1b3947 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:17.403545 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5131f3e-1879-4a16-9d87-a2b29b1b3947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:17.488322 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-b5131f3e-1879-4a16-9d87-a2b29b1b3947 None None] MFA Rules not processed for user `5871cc5af88642b1beccb3a1914af91e`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:17.489678 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-b5131f3e-1879-4a16-9d87-a2b29b1b3947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:17.732771 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d319e947-6e51-4b1b-9a4a-9e9bf65b965d admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:17.753798 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7911b5-e090-48a9-bb87-bc669418096e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:17.756042 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7911b5-e090-48a9-bb87-bc669418096e admin admin] REQUEST_METHOD: `PUT` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:17.758903 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7911b5-e090-48a9-bb87-bc669418096e admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:17.760219 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7911b5-e090-48a9-bb87-bc669418096e admin admin] PATH_INFO: `/v3/projects/10131a286c71442d905d68a2cc9e8ff8/users/cfca28aa4486400ea96e9db5abfda6f3/roles/ddb643577b2e4e478100ec370decfaeb` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:17.808776 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 874/1746] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:57:17 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 409 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:17.815014 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5f4b34-6b3b-45ab-a2cc-158d9ee1c192 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:17.815350 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5f4b34-6b3b-45ab-a2cc-158d9ee1c192 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:17.816107 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5f4b34-6b3b-45ab-a2cc-158d9ee1c192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:17.823040 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7911b5-e090-48a9-bb87-bc669418096e admin admin] RBAC: Authorizing `identity:create_grant(project_id=10131a286c71442d905d68a2cc9e8ff8, user_id=cfca28aa4486400ea96e9db5abfda6f3, role_id=ddb643577b2e4e478100ec370decfaeb)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:17.826003 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7911b5-e090-48a9-bb87-bc669418096e admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:17.876671 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 873/1747] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 14:57:17 2022] PUT /identity/v3/projects/10131a286c71442d905d68a2cc9e8ff8/users/cfca28aa4486400ea96e9db5abfda6f3/roles/ddb643577b2e4e478100ec370decfaeb => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:17.877786 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7911b5-e090-48a9-bb87-bc669418096e admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:17.935385 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:17.958761 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-5c5f4b34-6b3b-45ab-a2cc-158d9ee1c192 None None] MFA Rules not processed for user `3cadbd1af62d4c60aac9e41cf606e121`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:17.961487 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-5c5f4b34-6b3b-45ab-a2cc-158d9ee1c192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:18.135701 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7911b5-e090-48a9-bb87-bc669418096e admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:18.149061 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe68c36-da11-462e-9658-4d29e97deb8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:18.149754 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe68c36-da11-462e-9658-4d29e97deb8c admin admin] REQUEST_METHOD: `PUT` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:18.150032 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe68c36-da11-462e-9658-4d29e97deb8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:18.150306 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe68c36-da11-462e-9658-4d29e97deb8c admin admin] PATH_INFO: `/v3/projects/823ff0a6025747838cf1c89b78a54744/users/9e87ce596a5f4a1f92a4a509a00cacf2/roles/efa0e5b3413748dc828a89b12d67df79` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:18.187922 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe68c36-da11-462e-9658-4d29e97deb8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=823ff0a6025747838cf1c89b78a54744, user_id=9e87ce596a5f4a1f92a4a509a00cacf2, role_id=efa0e5b3413748dc828a89b12d67df79)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:18.190663 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe68c36-da11-462e-9658-4d29e97deb8c admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:18.206150 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 875/1748] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:57:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 394 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:18.206507 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5f4b34-6b3b-45ab-a2cc-158d9ee1c192 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:18.216129 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 874/1749] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 14:57:17 2022] PUT /identity/v3/projects/823ff0a6025747838cf1c89b78a54744/users/9e87ce596a5f4a1f92a4a509a00cacf2/roles/efa0e5b3413748dc828a89b12d67df79 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:18.225729 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe68c36-da11-462e-9658-4d29e97deb8c admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:18.439118 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5f4b34-6b3b-45ab-a2cc-158d9ee1c192 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:18.458432 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe68c36-da11-462e-9658-4d29e97deb8c admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:18.474423 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9f86b1-d35f-40d6-83ff-7825da7d6a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:18.475282 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9f86b1-d35f-40d6-83ff-7825da7d6a81 admin admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:18.475765 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9f86b1-d35f-40d6-83ff-7825da7d6a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:18.478046 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9f86b1-d35f-40d6-83ff-7825da7d6a81 admin admin] PATH_INFO: `/v3/projects` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:18.478980 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9f86b1-d35f-40d6-83ff-7825da7d6a81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:18.490356 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9f86b1-d35f-40d6-83ff-7825da7d6a81 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:18.520243 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:18.593622 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 875/1750] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Sep 19 14:57:18 2022] POST /identity/v3/projects => generated 367 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:57:18.595865 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9f86b1-d35f-40d6-83ff-7825da7d6a81 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:18.630418 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da97c1e2-94a9-4081-a5b2-ca223751964d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c2b78646374cb79ded4b7b59ba49c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:18.632558 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da97c1e2-94a9-4081-a5b2-ca223751964d service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:18.632971 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da97c1e2-94a9-4081-a5b2-ca223751964d service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:18.633253 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da97c1e2-94a9-4081-a5b2-ca223751964d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:18.663061 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da97c1e2-94a9-4081-a5b2-ca223751964d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:18.664573 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da97c1e2-94a9-4081-a5b2-ca223751964d service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:18.704892 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 876/1751] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:57:18 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:57:18.707096 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da97c1e2-94a9-4081-a5b2-ca223751964d service neutron] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:18.762566 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da97c1e2-94a9-4081-a5b2-ca223751964d service neutron] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:18.843327 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9f86b1-d35f-40d6-83ff-7825da7d6a81 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:18.861552 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbba34c-6af2-48ab-bf45-00431b6cc340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:18.863653 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbba34c-6af2-48ab-bf45-00431b6cc340 admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:18.864381 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbba34c-6af2-48ab-bf45-00431b6cc340 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:18.866451 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbba34c-6af2-48ab-bf45-00431b6cc340 admin admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:18.868471 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbba34c-6af2-48ab-bf45-00431b6cc340 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:18.874186 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbba34c-6af2-48ab-bf45-00431b6cc340 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:18.900748 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 876/1752] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:57:18 2022] GET /identity/v3/roles => generated 1420 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:57:18.906149 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa309e6-001e-42ce-a5bd-81bdf20f4153 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:18.907293 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa309e6-001e-42ce-a5bd-81bdf20f4153 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:18.910208 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa309e6-001e-42ce-a5bd-81bdf20f4153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:18.944496 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:18.963815 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8019db8c-3c2e-4e03-ac58-d7f343e4cfe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:18.963815 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8019db8c-3c2e-4e03-ac58-d7f343e4cfe2 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:18.964364 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8019db8c-3c2e-4e03-ac58-d7f343e4cfe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:18.967832 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8019db8c-3c2e-4e03-ac58-d7f343e4cfe2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:18.968692 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8019db8c-3c2e-4e03-ac58-d7f343e4cfe2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:18.971422 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8019db8c-3c2e-4e03-ac58-d7f343e4cfe2 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:18.981455 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-baa309e6-001e-42ce-a5bd-81bdf20f4153 None None] MFA Rules not processed for user `9e87ce596a5f4a1f92a4a509a00cacf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:18.983391 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-baa309e6-001e-42ce-a5bd-81bdf20f4153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:19.039716 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 877/1753] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Sep 19 14:57:18 2022] POST /identity/v3/projects => generated 371 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:57:19.041504 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8019db8c-3c2e-4e03-ac58-d7f343e4cfe2 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:19.161114 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 877/1754] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:57:18 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:19.163100 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa309e6-001e-42ce-a5bd-81bdf20f4153 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:19.165263 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-baa309e6-001e-42ce-a5bd-81bdf20f4153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:19.194543 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8019db8c-3c2e-4e03-ac58-d7f343e4cfe2 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:19.207853 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66806b1b-2f7c-4782-84da-e6579475e06a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:19.208930 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66806b1b-2f7c-4782-84da-e6579475e06a admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:19.209419 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66806b1b-2f7c-4782-84da-e6579475e06a admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:19.209959 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66806b1b-2f7c-4782-84da-e6579475e06a admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:19.211101 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66806b1b-2f7c-4782-84da-e6579475e06a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:19.214676 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66806b1b-2f7c-4782-84da-e6579475e06a admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:19.258307 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 878/1755] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Sep 19 14:57:19 2022] POST /identity/v3/users => generated 290 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:57:19.260623 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66806b1b-2f7c-4782-84da-e6579475e06a admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:19.293104 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66806b1b-2f7c-4782-84da-e6579475e06a admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:19.304691 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f288430a-a2c1-4ad0-9c88-0c39be9bc3d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:19.305585 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f288430a-a2c1-4ad0-9c88-0c39be9bc3d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:19.306356 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f288430a-a2c1-4ad0-9c88-0c39be9bc3d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:19.307625 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f288430a-a2c1-4ad0-9c88-0c39be9bc3d7 admin admin] PATH_INFO: `/v3/projects/10131a286c71442d905d68a2cc9e8ff8/users/cfca28aa4486400ea96e9db5abfda6f3/roles/ddb643577b2e4e478100ec370decfaeb` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:19.314428 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f288430a-a2c1-4ad0-9c88-0c39be9bc3d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10131a286c71442d905d68a2cc9e8ff8, user_id=cfca28aa4486400ea96e9db5abfda6f3, role_id=ddb643577b2e4e478100ec370decfaeb)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:19.321536 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f288430a-a2c1-4ad0-9c88-0c39be9bc3d7 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:19.347662 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 879/1756] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 14:57:19 2022] PUT /identity/v3/projects/10131a286c71442d905d68a2cc9e8ff8/users/cfca28aa4486400ea96e9db5abfda6f3/roles/ddb643577b2e4e478100ec370decfaeb => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:19.347662 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f288430a-a2c1-4ad0-9c88-0c39be9bc3d7 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:19.361164 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa309e6-001e-42ce-a5bd-81bdf20f4153 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:19.441370 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:19.532155 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928350f2-f4ac-491f-94e7-47fa4339411e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c2b78646374cb79ded4b7b59ba49c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:19.536395 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928350f2-f4ac-491f-94e7-47fa4339411e service neutron] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:19.538464 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928350f2-f4ac-491f-94e7-47fa4339411e service neutron] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:19.539350 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928350f2-f4ac-491f-94e7-47fa4339411e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:19.546181 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f288430a-a2c1-4ad0-9c88-0c39be9bc3d7 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:19.567029 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928350f2-f4ac-491f-94e7-47fa4339411e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:19.575577 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9341d54-880e-4ceb-ae8e-578a34d0f3ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:19.575577 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9341d54-880e-4ceb-ae8e-578a34d0f3ce admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:19.575577 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9341d54-880e-4ceb-ae8e-578a34d0f3ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:19.575577 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9341d54-880e-4ceb-ae8e-578a34d0f3ce admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:19.575966 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9341d54-880e-4ceb-ae8e-578a34d0f3ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:19.576224 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928350f2-f4ac-491f-94e7-47fa4339411e service neutron] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:19.576319 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9341d54-880e-4ceb-ae8e-578a34d0f3ce admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:19.595031 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 878/1757] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:57:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:57:19.596030 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928350f2-f4ac-491f-94e7-47fa4339411e service neutron] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:19.629419 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928350f2-f4ac-491f-94e7-47fa4339411e service neutron] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:19.643218 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f52dc03-2cb6-44f3-ad6d-1950becf7113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:19.643975 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52dc03-2cb6-44f3-ad6d-1950becf7113 admin admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:19.646803 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52dc03-2cb6-44f3-ad6d-1950becf7113 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:19.647449 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52dc03-2cb6-44f3-ad6d-1950becf7113 admin admin] PATH_INFO: `/v3/projects` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:19.650202 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f52dc03-2cb6-44f3-ad6d-1950becf7113 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:19.653519 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 880/1758] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Sep 19 14:57:19 2022] POST /identity/v3/users => generated 292 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:57:19.654463 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9341d54-880e-4ceb-ae8e-578a34d0f3ce admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:19.655540 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f52dc03-2cb6-44f3-ad6d-1950becf7113 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:19.694955 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9341d54-880e-4ceb-ae8e-578a34d0f3ce admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:19.719518 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed70c0de-eb77-429a-acf8-3c780baa65ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:19.720155 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed70c0de-eb77-429a-acf8-3c780baa65ca admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:19.720468 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed70c0de-eb77-429a-acf8-3c780baa65ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:19.720750 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed70c0de-eb77-429a-acf8-3c780baa65ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:19.721411 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed70c0de-eb77-429a-acf8-3c780baa65ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:19.723051 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed70c0de-eb77-429a-acf8-3c780baa65ca admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:19.731748 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 879/1759] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Sep 19 14:57:19 2022] POST /identity/v3/projects => generated 401 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:57:19.735594 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8050e2a6-7308-4330-94cd-090fee3d0f87 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:19.736004 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8050e2a6-7308-4330-94cd-090fee3d0f87 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:19.738012 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8050e2a6-7308-4330-94cd-090fee3d0f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:19.777903 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 881/1760] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:57:19 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:57:19.779066 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed70c0de-eb77-429a-acf8-3c780baa65ca admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:19.820449 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-8050e2a6-7308-4330-94cd-090fee3d0f87 None None] MFA Rules not processed for user `cfca28aa4486400ea96e9db5abfda6f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:19.826384 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-8050e2a6-7308-4330-94cd-090fee3d0f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:19.831786 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed70c0de-eb77-429a-acf8-3c780baa65ca admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:19.927883 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:20.013978 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2fb46b-8ae8-4594-8103-12dd143ca5e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:20.014617 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2fb46b-8ae8-4594-8103-12dd143ca5e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:20.014903 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2fb46b-8ae8-4594-8103-12dd143ca5e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:20.015179 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2fb46b-8ae8-4594-8103-12dd143ca5e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:20.015990 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2fb46b-8ae8-4594-8103-12dd143ca5e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:20.017858 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2fb46b-8ae8-4594-8103-12dd143ca5e6 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:20.050328 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 882/1761] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:57:19 2022] GET /identity/v3/roles => generated 1420 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:57:20.054354 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2fb46b-8ae8-4594-8103-12dd143ca5e6 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:20.088415 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2fb46b-8ae8-4594-8103-12dd143ca5e6 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:20.091487 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 880/1762] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:57:19 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:20.093725 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8050e2a6-7308-4330-94cd-090fee3d0f87 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:20.114913 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd047c5-a01a-4d6a-a5b0-b720662f16df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:20.115735 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd047c5-a01a-4d6a-a5b0-b720662f16df admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:20.116174 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd047c5-a01a-4d6a-a5b0-b720662f16df admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:20.117251 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd047c5-a01a-4d6a-a5b0-b720662f16df admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:20.118069 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd047c5-a01a-4d6a-a5b0-b720662f16df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:20.122210 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd047c5-a01a-4d6a-a5b0-b720662f16df admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:20.134788 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8050e2a6-7308-4330-94cd-090fee3d0f87 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:20.146345 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3fb09b-582d-4009-a871-02fe618c4ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:20.148789 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3fb09b-582d-4009-a871-02fe618c4ca6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:20.149213 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3fb09b-582d-4009-a871-02fe618c4ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:20.149745 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3fb09b-582d-4009-a871-02fe618c4ca6 admin admin] PATH_INFO: `/v3/projects/3b39969849354bab82ad05d713cd19b0/users/97b52acaf38046a582ff01b20ed338c6/roles/ddb643577b2e4e478100ec370decfaeb` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:20.205157 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3fb09b-582d-4009-a871-02fe618c4ca6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b39969849354bab82ad05d713cd19b0, user_id=97b52acaf38046a582ff01b20ed338c6, role_id=ddb643577b2e4e478100ec370decfaeb)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:20.209982 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3fb09b-582d-4009-a871-02fe618c4ca6 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:20.210129 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 883/1763] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Sep 19 14:57:20 2022] POST /identity/v3/users => generated 307 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:57:20.211819 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd047c5-a01a-4d6a-a5b0-b720662f16df admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:20.217642 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-bcd047c5-a01a-4d6a-a5b0-b720662f16df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:20.240954 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 881/1764] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 14:57:20 2022] PUT /identity/v3/projects/3b39969849354bab82ad05d713cd19b0/users/97b52acaf38046a582ff01b20ed338c6/roles/ddb643577b2e4e478100ec370decfaeb => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:20.240954 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3fb09b-582d-4009-a871-02fe618c4ca6 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:20.262558 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd047c5-a01a-4d6a-a5b0-b720662f16df admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:20.447672 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3fb09b-582d-4009-a871-02fe618c4ca6 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:20.462106 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b3aa08-b283-4e83-ae97-4bd2d9593244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:20.464179 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b3aa08-b283-4e83-ae97-4bd2d9593244 admin admin] REQUEST_METHOD: `PUT` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:20.465370 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b3aa08-b283-4e83-ae97-4bd2d9593244 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:20.466263 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b3aa08-b283-4e83-ae97-4bd2d9593244 admin admin] PATH_INFO: `/v3/projects/5b441e0c58ef416f8c8a14718a4798ea/users/633e9756545e4d938f53e0b88575194b/roles/ddb643577b2e4e478100ec370decfaeb` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:20.482790 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60300c4-4b40-4d16-9ad5-63a0e94b4a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:20.483633 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60300c4-4b40-4d16-9ad5-63a0e94b4a80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:20.484221 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60300c4-4b40-4d16-9ad5-63a0e94b4a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:20.485350 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60300c4-4b40-4d16-9ad5-63a0e94b4a80 admin admin] PATH_INFO: `/v3/projects/c094510ef75e45899734ad2a56dffed2` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:20.489290 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60300c4-4b40-4d16-9ad5-63a0e94b4a80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c094510ef75e45899734ad2a56dffed2)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:20.494428 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60300c4-4b40-4d16-9ad5-63a0e94b4a80 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:20.509302 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b3aa08-b283-4e83-ae97-4bd2d9593244 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b441e0c58ef416f8c8a14718a4798ea, user_id=633e9756545e4d938f53e0b88575194b, role_id=ddb643577b2e4e478100ec370decfaeb)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:20.514340 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b3aa08-b283-4e83-ae97-4bd2d9593244 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:20.522056 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:20.568743 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 882/1765] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 14:57:20 2022] PUT /identity/v3/projects/5b441e0c58ef416f8c8a14718a4798ea/users/633e9756545e4d938f53e0b88575194b/roles/ddb643577b2e4e478100ec370decfaeb => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:20.569887 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b3aa08-b283-4e83-ae97-4bd2d9593244 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:20.573372 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-36b3aa08-b283-4e83-ae97-4bd2d9593244 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:20.631976 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-e60300c4-4b40-4d16-9ad5-63a0e94b4a80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c094510ef75e45899734ad2a56dffed2', 'request_id': 'req-e60300c4-4b40-4d16-9ad5-63a0e94b4a80'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:20.646196 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-e60300c4-4b40-4d16-9ad5-63a0e94b4a80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c094510ef75e45899734ad2a56dffed2', 'request_id': 'req-e60300c4-4b40-4d16-9ad5-63a0e94b4a80'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:20.658601 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-e60300c4-4b40-4d16-9ad5-63a0e94b4a80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c094510ef75e45899734ad2a56dffed2', 'request_id': 'req-e60300c4-4b40-4d16-9ad5-63a0e94b4a80'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:20.684414 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-e60300c4-4b40-4d16-9ad5-63a0e94b4a80 admin admin] The token cache is being invalidate because project c094510ef75e45899734ad2a56dffed2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 14:57:20.684717 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-e60300c4-4b40-4d16-9ad5-63a0e94b4a80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:20.685625 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-e60300c4-4b40-4d16-9ad5-63a0e94b4a80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:20.689749 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 884/1766] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Sep 19 14:57:20 2022] DELETE /identity/v3/projects/c094510ef75e45899734ad2a56dffed2 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:20.694243 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60300c4-4b40-4d16-9ad5-63a0e94b4a80 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:20.700069 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-e60300c4-4b40-4d16-9ad5-63a0e94b4a80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:20.778484 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:20.810450 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60300c4-4b40-4d16-9ad5-63a0e94b4a80 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:20.810750 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b3aa08-b283-4e83-ae97-4bd2d9593244 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:20.817172 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a874a1-b622-4f26-9e0e-3033bfb507b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:20.820437 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a874a1-b622-4f26-9e0e-3033bfb507b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:20.820437 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a874a1-b622-4f26-9e0e-3033bfb507b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:20.820437 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a874a1-b622-4f26-9e0e-3033bfb507b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:20.820437 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a874a1-b622-4f26-9e0e-3033bfb507b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:20.822883 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a874a1-b622-4f26-9e0e-3033bfb507b4 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:20.853041 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 885/1767] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:57:20 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:57:20.857951 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a874a1-b622-4f26-9e0e-3033bfb507b4 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:20.862460 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-82a874a1-b622-4f26-9e0e-3033bfb507b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:20.886368 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a874a1-b622-4f26-9e0e-3033bfb507b4 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:20.891686 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4436627-218e-4da2-894a-054817241520 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139dc7a4f1dc48fe8faea848bd1ac0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:20.892866 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4436627-218e-4da2-894a-054817241520 service cinder] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:20.896670 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4436627-218e-4da2-894a-054817241520 service cinder] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:20.896989 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4436627-218e-4da2-894a-054817241520 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:20.901357 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97070fa3-b239-46c1-a533-5149cd44b446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:20.901529 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-a4436627-218e-4da2-894a-054817241520 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:20.902228 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97070fa3-b239-46c1-a533-5149cd44b446 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:20.902604 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97070fa3-b239-46c1-a533-5149cd44b446 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:20.902957 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97070fa3-b239-46c1-a533-5149cd44b446 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:20.907884 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97070fa3-b239-46c1-a533-5149cd44b446 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:20.907884 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97070fa3-b239-46c1-a533-5149cd44b446 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:20.935618 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 886/1768] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:57:20 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:57:20.936753 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97070fa3-b239-46c1-a533-5149cd44b446 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:20.943088 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-97070fa3-b239-46c1-a533-5149cd44b446 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:20.973744 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97070fa3-b239-46c1-a533-5149cd44b446 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:20.985117 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1185d214-d7da-45dc-b471-a1dd18f80112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:20.985929 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1185d214-d7da-45dc-b471-a1dd18f80112 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:20.986307 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1185d214-d7da-45dc-b471-a1dd18f80112 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:20.988041 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1185d214-d7da-45dc-b471-a1dd18f80112 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:20.988873 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1185d214-d7da-45dc-b471-a1dd18f80112 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:20.992380 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1185d214-d7da-45dc-b471-a1dd18f80112 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:21.023333 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 887/1769] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:57:20 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:57:21.026628 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d707bf-9f91-42e7-8409-6438093a84e7 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:21.027038 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d707bf-9f91-42e7-8409-6438093a84e7 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:21.027423 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d707bf-9f91-42e7-8409-6438093a84e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:21.067578 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4436627-218e-4da2-894a-054817241520 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:21.069363 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4436627-218e-4da2-894a-054817241520 service cinder] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:21.070533 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-78d707bf-9f91-42e7-8409-6438093a84e7 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:21.073866 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-78d707bf-9f91-42e7-8409-6438093a84e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:21.101538 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 888/1770] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:57:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:21.102691 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d707bf-9f91-42e7-8409-6438093a84e7 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:21.113417 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 883/1771] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:57:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 544 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:57:21.119325 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4436627-218e-4da2-894a-054817241520 service cinder] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:21.124843 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d707bf-9f91-42e7-8409-6438093a84e7 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:21.150691 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dc3665-f51b-4425-9803-5e6796ef34cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:21.151472 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4436627-218e-4da2-894a-054817241520 service cinder] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:21.151602 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dc3665-f51b-4425-9803-5e6796ef34cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:21.152003 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dc3665-f51b-4425-9803-5e6796ef34cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:21.152458 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dc3665-f51b-4425-9803-5e6796ef34cd admin admin] PATH_INFO: `/v3/projects/38b8ea9adf5241f88ab9463c39dbc28a/users/93b242cff5234e5181c6708ce60aee98/roles/ddb643577b2e4e478100ec370decfaeb` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:21.168657 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10421495-c2cd-48e9-b267-d70052143ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:21.169347 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10421495-c2cd-48e9-b267-d70052143ec5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:21.169632 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10421495-c2cd-48e9-b267-d70052143ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:21.169909 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10421495-c2cd-48e9-b267-d70052143ec5 admin admin] PATH_INFO: `/v3/projects/3b39969849354bab82ad05d713cd19b0/users/97b52acaf38046a582ff01b20ed338c6/roles/ddb643577b2e4e478100ec370decfaeb` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:21.173565 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10421495-c2cd-48e9-b267-d70052143ec5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b39969849354bab82ad05d713cd19b0, user_id=97b52acaf38046a582ff01b20ed338c6, role_id=ddb643577b2e4e478100ec370decfaeb)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:21.178520 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10421495-c2cd-48e9-b267-d70052143ec5 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:21.205883 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dc3665-f51b-4425-9803-5e6796ef34cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=38b8ea9adf5241f88ab9463c39dbc28a, user_id=93b242cff5234e5181c6708ce60aee98, role_id=ddb643577b2e4e478100ec370decfaeb)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:21.209043 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dc3665-f51b-4425-9803-5e6796ef34cd admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:21.222543 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 884/1772] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 14:57:21 2022] PUT /identity/v3/projects/3b39969849354bab82ad05d713cd19b0/users/97b52acaf38046a582ff01b20ed338c6/roles/ddb643577b2e4e478100ec370decfaeb => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:21.224131 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10421495-c2cd-48e9-b267-d70052143ec5 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:21.252787 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 889/1773] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 14:57:21 2022] PUT /identity/v3/projects/38b8ea9adf5241f88ab9463c39dbc28a/users/93b242cff5234e5181c6708ce60aee98/roles/ddb643577b2e4e478100ec370decfaeb => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:21.261177 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb7d534-3a18-4bda-82d8-419d98735252 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:21.261989 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb7d534-3a18-4bda-82d8-419d98735252 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:21.271170 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb7d534-3a18-4bda-82d8-419d98735252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:21.343123 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-6cb7d534-3a18-4bda-82d8-419d98735252 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:21.344590 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-6cb7d534-3a18-4bda-82d8-419d98735252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:21.391125 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:21.432405 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10421495-c2cd-48e9-b267-d70052143ec5 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:21.572314 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 890/1774] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:57:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:21.585829 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3219f765-f366-4629-bf2b-8b126ed8c682 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:21.586208 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3219f765-f366-4629-bf2b-8b126ed8c682 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:21.586597 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3219f765-f366-4629-bf2b-8b126ed8c682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:21.613526 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2135af-e49f-458b-ab00-c1c6033e890f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:21.614321 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2135af-e49f-458b-ab00-c1c6033e890f admin admin] REQUEST_METHOD: `PUT` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:21.614670 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2135af-e49f-458b-ab00-c1c6033e890f admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:21.615052 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2135af-e49f-458b-ab00-c1c6033e890f admin admin] PATH_INFO: `/v3/projects/5b441e0c58ef416f8c8a14718a4798ea/users/633e9756545e4d938f53e0b88575194b/roles/ddb643577b2e4e478100ec370decfaeb` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:21.619909 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2135af-e49f-458b-ab00-c1c6033e890f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b441e0c58ef416f8c8a14718a4798ea, user_id=633e9756545e4d938f53e0b88575194b, role_id=ddb643577b2e4e478100ec370decfaeb)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:21.626863 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2135af-e49f-458b-ab00-c1c6033e890f admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:21.664590 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 885/1775] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 14:57:21 2022] PUT /identity/v3/projects/5b441e0c58ef416f8c8a14718a4798ea/users/633e9756545e4d938f53e0b88575194b/roles/ddb643577b2e4e478100ec370decfaeb => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:21.665732 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2135af-e49f-458b-ab00-c1c6033e890f admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:21.674514 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-3219f765-f366-4629-bf2b-8b126ed8c682 None None] MFA Rules not processed for user `97b52acaf38046a582ff01b20ed338c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:21.675748 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-3219f765-f366-4629-bf2b-8b126ed8c682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:21.937959 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2135af-e49f-458b-ab00-c1c6033e890f admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:21.975223 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221e2d21-4ebc-4908-884c-70e65c4cea10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:21.975965 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221e2d21-4ebc-4908-884c-70e65c4cea10 admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:21.977642 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221e2d21-4ebc-4908-884c-70e65c4cea10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:21.978032 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221e2d21-4ebc-4908-884c-70e65c4cea10 admin admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:21.980679 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221e2d21-4ebc-4908-884c-70e65c4cea10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:21.982371 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221e2d21-4ebc-4908-884c-70e65c4cea10 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:21.994020 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 891/1776] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:57:21 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 421 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:21.995030 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3219f765-f366-4629-bf2b-8b126ed8c682 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:22.055334 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3219f765-f366-4629-bf2b-8b126ed8c682 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:22.055674 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 886/1777] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:57:21 2022] GET /identity/v3/roles => generated 1420 bytes in 391 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:57:22.065657 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253ec663-80a5-40a1-9eb4-a64b2e714adc None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:22.066010 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253ec663-80a5-40a1-9eb4-a64b2e714adc None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:22.066226 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253ec663-80a5-40a1-9eb4-a64b2e714adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:22.081143 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5171360-20bc-4ee9-8844-371b5a7485ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:22.082229 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5171360-20bc-4ee9-8844-371b5a7485ab admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:22.082774 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5171360-20bc-4ee9-8844-371b5a7485ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:22.083413 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5171360-20bc-4ee9-8844-371b5a7485ab admin admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:22.084378 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5171360-20bc-4ee9-8844-371b5a7485ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:57:22.088900 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5171360-20bc-4ee9-8844-371b5a7485ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:22.090864 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5171360-20bc-4ee9-8844-371b5a7485ab admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:22.136156 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 892/1778] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Sep 19 14:57:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:57:22.137502 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5171360-20bc-4ee9-8844-371b5a7485ab admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:22.141339 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-b5171360-20bc-4ee9-8844-371b5a7485ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:22.164319 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:22.167985 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-253ec663-80a5-40a1-9eb4-a64b2e714adc None None] MFA Rules not processed for user `633e9756545e4d938f53e0b88575194b`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:22.169291 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-253ec663-80a5-40a1-9eb4-a64b2e714adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:22.369807 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 887/1779] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:57:22 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:22.369807 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253ec663-80a5-40a1-9eb4-a64b2e714adc None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:22.381820 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5171360-20bc-4ee9-8844-371b5a7485ab admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:22.392692 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253ec663-80a5-40a1-9eb4-a64b2e714adc None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:22.407947 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c7609b-fb54-47ec-8532-f1076d8161b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139dc7a4f1dc48fe8faea848bd1ac0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:22.408741 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c7609b-fb54-47ec-8532-f1076d8161b6 service cinder] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:22.409098 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c7609b-fb54-47ec-8532-f1076d8161b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:22.409451 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c7609b-fb54-47ec-8532-f1076d8161b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:22.420576 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634cec71-70ca-46d1-ad41-4d67dea5e961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:22.421585 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634cec71-70ca-46d1-ad41-4d67dea5e961 admin admin] REQUEST_METHOD: `PUT` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:22.422017 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634cec71-70ca-46d1-ad41-4d67dea5e961 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:22.422968 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634cec71-70ca-46d1-ad41-4d67dea5e961 admin admin] PATH_INFO: `/v3/projects/38b8ea9adf5241f88ab9463c39dbc28a/users/93b242cff5234e5181c6708ce60aee98/roles/ddb643577b2e4e478100ec370decfaeb` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:22.426709 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634cec71-70ca-46d1-ad41-4d67dea5e961 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38b8ea9adf5241f88ab9463c39dbc28a, user_id=93b242cff5234e5181c6708ce60aee98, role_id=ddb643577b2e4e478100ec370decfaeb)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:22.431319 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634cec71-70ca-46d1-ad41-4d67dea5e961 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:22.442037 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:22.461328 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c7609b-fb54-47ec-8532-f1076d8161b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:22.463154 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c7609b-fb54-47ec-8532-f1076d8161b6 service cinder] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:22.464343 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 888/1780] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 14:57:22 2022] PUT /identity/v3/projects/38b8ea9adf5241f88ab9463c39dbc28a/users/93b242cff5234e5181c6708ce60aee98/roles/ddb643577b2e4e478100ec370decfaeb => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:22.465602 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634cec71-70ca-46d1-ad41-4d67dea5e961 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:22.512770 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 893/1781] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:57:22 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:57:22.513784 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c7609b-fb54-47ec-8532-f1076d8161b6 service cinder] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:22.521446 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-77c7609b-fb54-47ec-8532-f1076d8161b6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:22.562619 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c7609b-fb54-47ec-8532-f1076d8161b6 service cinder] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:22.677732 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634cec71-70ca-46d1-ad41-4d67dea5e961 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:22.685613 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b075ba52-f10c-4cf0-ab8d-cc240a756e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:22.686629 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b075ba52-f10c-4cf0-ab8d-cc240a756e3e admin admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:22.687124 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b075ba52-f10c-4cf0-ab8d-cc240a756e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:22.687629 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b075ba52-f10c-4cf0-ab8d-cc240a756e3e admin admin] PATH_INFO: `/v3/projects` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:22.688513 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b075ba52-f10c-4cf0-ab8d-cc240a756e3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:22.690757 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b075ba52-f10c-4cf0-ab8d-cc240a756e3e admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:22.726103 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d633e62-4a78-4766-939f-e07c474f4b86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139dc7a4f1dc48fe8faea848bd1ac0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:22.726837 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d633e62-4a78-4766-939f-e07c474f4b86 service cinder] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:22.727094 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d633e62-4a78-4766-939f-e07c474f4b86 service cinder] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:22.727457 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d633e62-4a78-4766-939f-e07c474f4b86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:22.757144 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 889/1782] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Sep 19 14:57:22 2022] POST /identity/v3/projects => generated 371 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:57:22.768481 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aa7b16-b6f8-4346-b08b-47dada034e9e None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:22.769829 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aa7b16-b6f8-4346-b08b-47dada034e9e None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:22.770160 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aa7b16-b6f8-4346-b08b-47dada034e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:22.882016 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-19aa7b16-b6f8-4346-b08b-47dada034e9e None None] MFA Rules not processed for user `93b242cff5234e5181c6708ce60aee98`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:22.895875 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-19aa7b16-b6f8-4346-b08b-47dada034e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:22.973698 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d633e62-4a78-4766-939f-e07c474f4b86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:22.975181 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d633e62-4a78-4766-939f-e07c474f4b86 service cinder] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:23.018623 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 894/1783] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:57:22 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:57:23.019605 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d633e62-4a78-4766-939f-e07c474f4b86 service cinder] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:23.062041 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d633e62-4a78-4766-939f-e07c474f4b86 service cinder] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:23.189283 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 890/1784] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:57:22 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 431 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:23.192733 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2090d440-0cc6-4dd9-bc9a-f8f7c8700952 None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:23.193021 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2090d440-0cc6-4dd9-bc9a-f8f7c8700952 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:23.193546 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2090d440-0cc6-4dd9-bc9a-f8f7c8700952 None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:23.203978 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 891/1785] 10.222.0.72 () {54 vars in 921 bytes} [Mon Sep 19 14:57:23 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:57:23.242061 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:23.245114 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa2357b-d582-404b-8430-9e946a97ffed None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:23.245421 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa2357b-d582-404b-8430-9e946a97ffed None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:23.245652 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa2357b-d582-404b-8430-9e946a97ffed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:23.273053 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a651496-31ea-4373-a6d6-07abdd9087b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:23.273053 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a651496-31ea-4373-a6d6-07abdd9087b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:23.277302 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a651496-31ea-4373-a6d6-07abdd9087b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:23.277585 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a651496-31ea-4373-a6d6-07abdd9087b9 admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:23.278253 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a651496-31ea-4373-a6d6-07abdd9087b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:23.280202 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a651496-31ea-4373-a6d6-07abdd9087b9 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:23.309121 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-2fa2357b-d582-404b-8430-9e946a97ffed None None] MFA Rules not processed for user `055439dc35e946f4a82535c684f9b60d`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:23.316412 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-2fa2357b-d582-404b-8430-9e946a97ffed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:23.336373 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 895/1786] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Sep 19 14:57:23 2022] POST /identity/v3/users => generated 286 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:57:23.337147 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a651496-31ea-4373-a6d6-07abdd9087b9 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:23.509530 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a651496-31ea-4373-a6d6-07abdd9087b9 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:23.526460 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068688a9-d2db-4e4f-b411-930e3fdb86d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139dc7a4f1dc48fe8faea848bd1ac0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:23.529485 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068688a9-d2db-4e4f-b411-930e3fdb86d7 service cinder] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:23.529790 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068688a9-d2db-4e4f-b411-930e3fdb86d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:23.530069 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068688a9-d2db-4e4f-b411-930e3fdb86d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:23.556066 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 892/1787] 10.222.0.72 () {58 vars in 1018 bytes} [Mon Sep 19 14:57:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:23.556733 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068688a9-d2db-4e4f-b411-930e3fdb86d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:23.558834 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa2357b-d582-404b-8430-9e946a97ffed None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:23.560845 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068688a9-d2db-4e4f-b411-930e3fdb86d7 service cinder] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:23.575394 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:23.589338 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 896/1788] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:57:23 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:57:23.607103 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa2357b-d582-404b-8430-9e946a97ffed None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:23.633050 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89411e0-869a-408f-826c-2ef62bcf0521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:23.633685 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89411e0-869a-408f-826c-2ef62bcf0521 admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:23.633965 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89411e0-869a-408f-826c-2ef62bcf0521 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:23.634233 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89411e0-869a-408f-826c-2ef62bcf0521 admin admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:23.634883 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89411e0-869a-408f-826c-2ef62bcf0521 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:23.636518 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89411e0-869a-408f-826c-2ef62bcf0521 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:23.677647 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068688a9-d2db-4e4f-b411-930e3fdb86d7 service cinder] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:23.678698 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-068688a9-d2db-4e4f-b411-930e3fdb86d7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:23.708415 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 893/1789] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:57:23 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:57:23.712812 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89411e0-869a-408f-826c-2ef62bcf0521 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:23.726094 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068688a9-d2db-4e4f-b411-930e3fdb86d7 service cinder] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:23.751766 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89411e0-869a-408f-826c-2ef62bcf0521 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:23.756298 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9fcdb3-b81a-48c3-b168-43805b775787 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055439dc35e946f4a82535c684f9b60d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:23.760626 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9fcdb3-b81a-48c3-b168-43805b775787 service nova] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:23.761618 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9fcdb3-b81a-48c3-b168-43805b775787 service nova] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:23.761902 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9fcdb3-b81a-48c3-b168-43805b775787 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:23.777003 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d30b2d3-15ce-4e95-9d63-a3d71b705d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:23.777637 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d30b2d3-15ce-4e95-9d63-a3d71b705d39 admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:23.778004 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d30b2d3-15ce-4e95-9d63-a3d71b705d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:23.778208 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d30b2d3-15ce-4e95-9d63-a3d71b705d39 admin admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:23.778928 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d30b2d3-15ce-4e95-9d63-a3d71b705d39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:23.780454 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d30b2d3-15ce-4e95-9d63-a3d71b705d39 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:23.795264 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9fcdb3-b81a-48c3-b168-43805b775787 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:23.803222 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9fcdb3-b81a-48c3-b168-43805b775787 service nova] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:23.822786 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 894/1790] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:57:23 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:57:23.828875 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d30b2d3-15ce-4e95-9d63-a3d71b705d39 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:23.847780 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 897/1791] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:57:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 14:57:23.877307 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d30b2d3-15ce-4e95-9d63-a3d71b705d39 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:23.886557 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9fcdb3-b81a-48c3-b168-43805b775787 service nova] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:23.900937 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149ee885-66db-4818-a38d-f886e26c078f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:23.901932 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149ee885-66db-4818-a38d-f886e26c078f admin admin] REQUEST_METHOD: `PUT` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:23.902430 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149ee885-66db-4818-a38d-f886e26c078f admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:23.902920 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149ee885-66db-4818-a38d-f886e26c078f admin admin] PATH_INFO: `/v3/projects/d4faa8323ce84966a7bdbaecc0446bab/users/abb915734cc648e4809dafd442eb5c49/roles/efa0e5b3413748dc828a89b12d67df79` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:23.918542 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9fcdb3-b81a-48c3-b168-43805b775787 service nova] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:23.926589 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a849369-c993-4733-b0ce-d2b647bf2eca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139dc7a4f1dc48fe8faea848bd1ac0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:23.928265 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a849369-c993-4733-b0ce-d2b647bf2eca service cinder] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:23.928520 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a849369-c993-4733-b0ce-d2b647bf2eca service cinder] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:23.929310 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a849369-c993-4733-b0ce-d2b647bf2eca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:23.935095 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-8a849369-c993-4733-b0ce-d2b647bf2eca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:23.941236 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149ee885-66db-4818-a38d-f886e26c078f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4faa8323ce84966a7bdbaecc0446bab, user_id=abb915734cc648e4809dafd442eb5c49, role_id=efa0e5b3413748dc828a89b12d67df79)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:23.944512 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149ee885-66db-4818-a38d-f886e26c078f admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:23.980162 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 895/1792] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 14:57:23 2022] PUT /identity/v3/projects/d4faa8323ce84966a7bdbaecc0446bab/users/abb915734cc648e4809dafd442eb5c49/roles/efa0e5b3413748dc828a89b12d67df79 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:23.982224 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0ee683-15e8-4296-ac27-c2a780832879 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:23.982611 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0ee683-15e8-4296-ac27-c2a780832879 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:23.984433 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0ee683-15e8-4296-ac27-c2a780832879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:24.079602 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-9a0ee683-15e8-4296-ac27-c2a780832879 None None] MFA Rules not processed for user `abb915734cc648e4809dafd442eb5c49`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:24.081045 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-9a0ee683-15e8-4296-ac27-c2a780832879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:24.092903 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a849369-c993-4733-b0ce-d2b647bf2eca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:24.100528 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a849369-c993-4733-b0ce-d2b647bf2eca service cinder] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:24.139268 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 898/1793] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:57:23 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:57:24.362431 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 896/1794] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:57:23 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 382 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:24.367176 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a849369-c993-4733-b0ce-d2b647bf2eca service cinder] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:24.385271 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a849369-c993-4733-b0ce-d2b647bf2eca service cinder] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:24.587749 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21429998-f26a-4534-b3e0-97dfe978acce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:24.591142 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21429998-f26a-4534-b3e0-97dfe978acce admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:24.591450 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21429998-f26a-4534-b3e0-97dfe978acce admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:24.592972 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21429998-f26a-4534-b3e0-97dfe978acce admin admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:24.593714 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21429998-f26a-4534-b3e0-97dfe978acce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:24.595708 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21429998-f26a-4534-b3e0-97dfe978acce admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:24.685571 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:24.728927 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 899/1795] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Sep 19 14:57:24 2022] POST /identity/v3/projects => generated 373 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:57:24.730099 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0ee683-15e8-4296-ac27-c2a780832879 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:24.750792 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0ee683-15e8-4296-ac27-c2a780832879 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:24.979721 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aff7b8d-ca23-4e92-bd06-b5cb3709e90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:24.980555 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aff7b8d-ca23-4e92-bd06-b5cb3709e90e admin admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:24.981096 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aff7b8d-ca23-4e92-bd06-b5cb3709e90e admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:24.981514 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aff7b8d-ca23-4e92-bd06-b5cb3709e90e admin admin] PATH_INFO: `/v3/users` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:24.982456 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aff7b8d-ca23-4e92-bd06-b5cb3709e90e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:24.985294 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aff7b8d-ca23-4e92-bd06-b5cb3709e90e admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:25.036002 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 897/1796] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Sep 19 14:57:24 2022] POST /identity/v3/users => generated 293 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:57:25.039647 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21429998-f26a-4534-b3e0-97dfe978acce admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:25.058907 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21429998-f26a-4534-b3e0-97dfe978acce admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:25.073022 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a694a2ee-1f00-468c-9166-ed87b47ea382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:25.073876 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a694a2ee-1f00-468c-9166-ed87b47ea382 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:25.074409 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a694a2ee-1f00-468c-9166-ed87b47ea382 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:25.074836 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a694a2ee-1f00-468c-9166-ed87b47ea382 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:25.075630 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a694a2ee-1f00-468c-9166-ed87b47ea382 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:25.078935 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a694a2ee-1f00-468c-9166-ed87b47ea382 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:25.091226 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aff7b8d-ca23-4e92-bd06-b5cb3709e90e admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:25.128925 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 900/1797] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:57:25 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:57:25.131564 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a694a2ee-1f00-468c-9166-ed87b47ea382 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:25.166455 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a694a2ee-1f00-468c-9166-ed87b47ea382 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:25.190217 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1d89c0-7987-4c92-8c65-a54881ba9a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:25.195128 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1d89c0-7987-4c92-8c65-a54881ba9a33 admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:25.195572 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1d89c0-7987-4c92-8c65-a54881ba9a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:25.196100 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1d89c0-7987-4c92-8c65-a54881ba9a33 admin admin] PATH_INFO: `/v3/projects/8bf519ab65af47939e7cfeace5e7a039/users/9a7f48b943404778acdf90d433a2a7a4/roles/ddb643577b2e4e478100ec370decfaeb` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:25.249325 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:25.268005 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1d89c0-7987-4c92-8c65-a54881ba9a33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bf519ab65af47939e7cfeace5e7a039, user_id=9a7f48b943404778acdf90d433a2a7a4, role_id=ddb643577b2e4e478100ec370decfaeb)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:25.291023 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1d89c0-7987-4c92-8c65-a54881ba9a33 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:25.306958 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aff7b8d-ca23-4e92-bd06-b5cb3709e90e admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:25.319510 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5b165c-c726-4aa9-bee6-4dbb413b77da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139dc7a4f1dc48fe8faea848bd1ac0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:25.320063 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5b165c-c726-4aa9-bee6-4dbb413b77da service cinder] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:25.320360 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5b165c-c726-4aa9-bee6-4dbb413b77da service cinder] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:25.321068 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5b165c-c726-4aa9-bee6-4dbb413b77da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:25.323098 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-ba5b165c-c726-4aa9-bee6-4dbb413b77da service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:25.341017 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 901/1798] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 14:57:25 2022] PUT /identity/v3/projects/8bf519ab65af47939e7cfeace5e7a039/users/9a7f48b943404778acdf90d433a2a7a4/roles/ddb643577b2e4e478100ec370decfaeb => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:25.346147 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1d89c0-7987-4c92-8c65-a54881ba9a33 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:25.502082 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1d89c0-7987-4c92-8c65-a54881ba9a33 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:25.514226 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41da6458-7f98-41d4-9041-b5a2fbbecc11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:25.514957 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41da6458-7f98-41d4-9041-b5a2fbbecc11 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:25.515235 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41da6458-7f98-41d4-9041-b5a2fbbecc11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:25.516172 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41da6458-7f98-41d4-9041-b5a2fbbecc11 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:25.517481 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41da6458-7f98-41d4-9041-b5a2fbbecc11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:25.522268 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41da6458-7f98-41d4-9041-b5a2fbbecc11 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:25.540007 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5b165c-c726-4aa9-bee6-4dbb413b77da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:25.544939 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5b165c-c726-4aa9-bee6-4dbb413b77da service cinder] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:25.555859 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 902/1799] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:57:25 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:57:25.557202 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41da6458-7f98-41d4-9041-b5a2fbbecc11 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:25.584562 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41da6458-7f98-41d4-9041-b5a2fbbecc11 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:25.586480 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 898/1800] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:57:25 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 14:57:25.589591 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5b165c-c726-4aa9-bee6-4dbb413b77da service cinder] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:25.605223 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b4d182-e9c8-4ba2-be01-478ec7c4c610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:25.605870 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b4d182-e9c8-4ba2-be01-478ec7c4c610 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:25.606089 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b4d182-e9c8-4ba2-be01-478ec7c4c610 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:25.606460 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b4d182-e9c8-4ba2-be01-478ec7c4c610 admin admin] PATH_INFO: `/v3/users/3cadbd1af62d4c60aac9e41cf606e121` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:25.610321 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b4d182-e9c8-4ba2-be01-478ec7c4c610 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cadbd1af62d4c60aac9e41cf606e121)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:25.614333 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5b165c-c726-4aa9-bee6-4dbb413b77da service cinder] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:25.616749 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b4d182-e9c8-4ba2-be01-478ec7c4c610 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:25.621067 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288a15c5-9d07-4f88-8ec8-806a9ba1114e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:25.622565 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288a15c5-9d07-4f88-8ec8-806a9ba1114e admin admin] REQUEST_METHOD: `PUT` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:25.623067 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288a15c5-9d07-4f88-8ec8-806a9ba1114e admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:25.623565 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288a15c5-9d07-4f88-8ec8-806a9ba1114e admin admin] PATH_INFO: `/v3/projects/8bf519ab65af47939e7cfeace5e7a039/users/9a7f48b943404778acdf90d433a2a7a4/roles/ddb643577b2e4e478100ec370decfaeb` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:25.626337 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288a15c5-9d07-4f88-8ec8-806a9ba1114e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bf519ab65af47939e7cfeace5e7a039, user_id=9a7f48b943404778acdf90d433a2a7a4, role_id=ddb643577b2e4e478100ec370decfaeb)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:25.630560 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288a15c5-9d07-4f88-8ec8-806a9ba1114e admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:25.649332 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 899/1801] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 14:57:25 2022] PUT /identity/v3/projects/8bf519ab65af47939e7cfeace5e7a039/users/9a7f48b943404778acdf90d433a2a7a4/roles/ddb643577b2e4e478100ec370decfaeb => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:25.661010 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b653b274-b939-437b-999e-20f11c7201d5 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:25.661373 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b653b274-b939-437b-999e-20f11c7201d5 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:25.661709 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b653b274-b939-437b-999e-20f11c7201d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:25.766451 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-19b4d182-e9c8-4ba2-be01-478ec7c4c610 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cadbd1af62d4c60aac9e41cf606e121'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:25.812690 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-b653b274-b939-437b-999e-20f11c7201d5 None None] MFA Rules not processed for user `9a7f48b943404778acdf90d433a2a7a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:25.821927 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-b653b274-b939-437b-999e-20f11c7201d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:25.836830 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-19b4d182-e9c8-4ba2-be01-478ec7c4c610 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cadbd1af62d4c60aac9e41cf606e121'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:25.857752 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-19b4d182-e9c8-4ba2-be01-478ec7c4c610 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cadbd1af62d4c60aac9e41cf606e121'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:25.881987 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-19b4d182-e9c8-4ba2-be01-478ec7c4c610 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cadbd1af62d4c60aac9e41cf606e121'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:25.883891 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-19b4d182-e9c8-4ba2-be01-478ec7c4c610 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cadbd1af62d4c60aac9e41cf606e121'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:25.902364 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 903/1802] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Sep 19 14:57:25 2022] DELETE /identity/v3/users/3cadbd1af62d4c60aac9e41cf606e121 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:25.907732 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a04adb-4b24-4ea4-a1ea-7ed7741a35d9 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:25.908034 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a04adb-4b24-4ea4-a1ea-7ed7741a35d9 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:25.908306 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a04adb-4b24-4ea4-a1ea-7ed7741a35d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:25.977606 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-08a04adb-4b24-4ea4-a1ea-7ed7741a35d9 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:25.979003 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-08a04adb-4b24-4ea4-a1ea-7ed7741a35d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:26.047260 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:26.126332 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 904/1803] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:57:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 14:57:26.181168 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a04adb-4b24-4ea4-a1ea-7ed7741a35d9 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:26.182367 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-08a04adb-4b24-4ea4-a1ea-7ed7741a35d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:26.200360 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 900/1804] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:57:25 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 540 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 14:57:26.229383 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b653b274-b939-437b-999e-20f11c7201d5 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:26.233235 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-b653b274-b939-437b-999e-20f11c7201d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:26.364911 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a04adb-4b24-4ea4-a1ea-7ed7741a35d9 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:26.373180 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca4e311-c627-4840-833e-60ca24cc8bdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c2b78646374cb79ded4b7b59ba49c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:26.374246 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca4e311-c627-4840-833e-60ca24cc8bdf service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:26.374970 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca4e311-c627-4840-833e-60ca24cc8bdf service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:26.375984 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca4e311-c627-4840-833e-60ca24cc8bdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:26.398674 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca4e311-c627-4840-833e-60ca24cc8bdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:26.400919 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca4e311-c627-4840-833e-60ca24cc8bdf service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:26.417737 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 905/1805] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:57:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:57:26.461231 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b653b274-b939-437b-999e-20f11c7201d5 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:26.478754 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:26.612401 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7969be4b-7a08-4af7-848e-c67a251d91ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139dc7a4f1dc48fe8faea848bd1ac0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:26.613042 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7969be4b-7a08-4af7-848e-c67a251d91ab service cinder] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:26.613323 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7969be4b-7a08-4af7-848e-c67a251d91ab service cinder] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:26.613598 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7969be4b-7a08-4af7-848e-c67a251d91ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:26.813879 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7969be4b-7a08-4af7-848e-c67a251d91ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:26.815800 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7969be4b-7a08-4af7-848e-c67a251d91ab service cinder] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:26.868663 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 901/1806] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:57:26 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 640 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 14:57:27.281679 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca4e311-c627-4840-833e-60ca24cc8bdf service neutron] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:27.299792 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca4e311-c627-4840-833e-60ca24cc8bdf service neutron] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:27.311574 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00956787-e053-40a9-8954-88ef946ad49c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139dc7a4f1dc48fe8faea848bd1ac0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:27.313716 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00956787-e053-40a9-8954-88ef946ad49c service cinder] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:27.314011 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00956787-e053-40a9-8954-88ef946ad49c service cinder] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:27.318625 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00956787-e053-40a9-8954-88ef946ad49c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:27.327282 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-00956787-e053-40a9-8954-88ef946ad49c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:27.469720 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00956787-e053-40a9-8954-88ef946ad49c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:27.471573 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00956787-e053-40a9-8954-88ef946ad49c service cinder] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:27.484619 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 906/1807] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:57:27 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:57:28.061398 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7a3a57-a45f-4664-9e80-6195bdd03518 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:28.061890 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7a3a57-a45f-4664-9e80-6195bdd03518 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:28.061980 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7a3a57-a45f-4664-9e80-6195bdd03518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:28.064863 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00956787-e053-40a9-8954-88ef946ad49c service cinder] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:28.066599 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-00956787-e053-40a9-8954-88ef946ad49c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:28.121270 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00956787-e053-40a9-8954-88ef946ad49c service cinder] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:28.139248 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd05c2af-4074-4ba6-9530-6fd7382d9e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:28.152170 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd05c2af-4074-4ba6-9530-6fd7382d9e4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:28.152813 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd05c2af-4074-4ba6-9530-6fd7382d9e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:28.155013 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd05c2af-4074-4ba6-9530-6fd7382d9e4b admin admin] PATH_INFO: `/v3/projects/ebf93090f12c4157b73dad9dc9b463fc` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:28.159178 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-4a7a3a57-a45f-4664-9e80-6195bdd03518 None None] MFA Rules not processed for user `c3773acf65044281ae7837258aefd5ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:28.160880 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-4a7a3a57-a45f-4664-9e80-6195bdd03518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:28.162800 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd05c2af-4074-4ba6-9530-6fd7382d9e4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebf93090f12c4157b73dad9dc9b463fc)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:28.165426 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd05c2af-4074-4ba6-9530-6fd7382d9e4b admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:28.344678 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-fd05c2af-4074-4ba6-9530-6fd7382d9e4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebf93090f12c4157b73dad9dc9b463fc', 'request_id': 'req-fd05c2af-4074-4ba6-9530-6fd7382d9e4b'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:28.382440 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-fd05c2af-4074-4ba6-9530-6fd7382d9e4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebf93090f12c4157b73dad9dc9b463fc', 'request_id': 'req-fd05c2af-4074-4ba6-9530-6fd7382d9e4b'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:28.383274 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 902/1808] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:57:28 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:28.410949 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-fd05c2af-4074-4ba6-9530-6fd7382d9e4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebf93090f12c4157b73dad9dc9b463fc', 'request_id': 'req-fd05c2af-4074-4ba6-9530-6fd7382d9e4b'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:28.421026 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:28.449125 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-fd05c2af-4074-4ba6-9530-6fd7382d9e4b admin admin] The token cache is being invalidate because project ebf93090f12c4157b73dad9dc9b463fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 14:57:28.450236 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-fd05c2af-4074-4ba6-9530-6fd7382d9e4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:28.451505 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-fd05c2af-4074-4ba6-9530-6fd7382d9e4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:28.461137 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 907/1809] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Sep 19 14:57:28 2022] DELETE /identity/v3/projects/ebf93090f12c4157b73dad9dc9b463fc => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 14:57:28.461921 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7a3a57-a45f-4664-9e80-6195bdd03518 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:28.501595 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7a3a57-a45f-4664-9e80-6195bdd03518 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:28.626446 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27861e4c-3440-44f4-8215-d491860058f6 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:28.627057 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27861e4c-3440-44f4-8215-d491860058f6 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:28.627525 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27861e4c-3440-44f4-8215-d491860058f6 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:28.629460 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 908/1810] 10.222.0.72 () {54 vars in 921 bytes} [Mon Sep 19 14:57:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:57:28.745934 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ab8b0e-1419-4cbc-b5fb-345821eb7a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:28.748179 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ab8b0e-1419-4cbc-b5fb-345821eb7a6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:28.748496 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ab8b0e-1419-4cbc-b5fb-345821eb7a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:28.748772 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ab8b0e-1419-4cbc-b5fb-345821eb7a6b admin admin] PATH_INFO: `/v3/users/633e9756545e4d938f53e0b88575194b` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:28.751800 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ab8b0e-1419-4cbc-b5fb-345821eb7a6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=633e9756545e4d938f53e0b88575194b)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:28.753815 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ab8b0e-1419-4cbc-b5fb-345821eb7a6b admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:28.764253 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a64690-1068-4d45-82cc-2aa77c818a4a None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:28.764807 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a64690-1068-4d45-82cc-2aa77c818a4a None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:28.765220 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a64690-1068-4d45-82cc-2aa77c818a4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:28.787217 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:28.826930 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-e1a64690-1068-4d45-82cc-2aa77c818a4a None None] MFA Rules not processed for user `055439dc35e946f4a82535c684f9b60d`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:28.831740 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-e1a64690-1068-4d45-82cc-2aa77c818a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:28.942171 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-21ab8b0e-1419-4cbc-b5fb-345821eb7a6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '633e9756545e4d938f53e0b88575194b'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:28.980821 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-21ab8b0e-1419-4cbc-b5fb-345821eb7a6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '633e9756545e4d938f53e0b88575194b'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:29.021824 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-21ab8b0e-1419-4cbc-b5fb-345821eb7a6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '633e9756545e4d938f53e0b88575194b'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:29.023953 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-21ab8b0e-1419-4cbc-b5fb-345821eb7a6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '633e9756545e4d938f53e0b88575194b'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:29.042754 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-21ab8b0e-1419-4cbc-b5fb-345821eb7a6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '633e9756545e4d938f53e0b88575194b'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:29.060669 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 903/1811] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Sep 19 14:57:28 2022] DELETE /identity/v3/users/633e9756545e4d938f53e0b88575194b => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 14:57:29.061750 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ab8b0e-1419-4cbc-b5fb-345821eb7a6b admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:29.070843 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-21ab8b0e-1419-4cbc-b5fb-345821eb7a6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:29.087834 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 909/1812] 10.222.0.72 () {58 vars in 1018 bytes} [Mon Sep 19 14:57:28 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 14:57:29.286363 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ab8b0e-1419-4cbc-b5fb-345821eb7a6b admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:29.311029 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e7b686-3e8f-4964-a23d-08a4945e03a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:29.312478 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e7b686-3e8f-4964-a23d-08a4945e03a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:29.313097 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e7b686-3e8f-4964-a23d-08a4945e03a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:29.313612 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e7b686-3e8f-4964-a23d-08a4945e03a6 admin admin] PATH_INFO: `/v3/users/5871cc5af88642b1beccb3a1914af91e` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:29.317210 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e7b686-3e8f-4964-a23d-08a4945e03a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5871cc5af88642b1beccb3a1914af91e)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:29.320610 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e7b686-3e8f-4964-a23d-08a4945e03a6 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:29.462103 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-90e7b686-3e8f-4964-a23d-08a4945e03a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5871cc5af88642b1beccb3a1914af91e'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:29.489339 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-90e7b686-3e8f-4964-a23d-08a4945e03a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5871cc5af88642b1beccb3a1914af91e'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:29.504153 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-90e7b686-3e8f-4964-a23d-08a4945e03a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5871cc5af88642b1beccb3a1914af91e'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:29.505556 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-90e7b686-3e8f-4964-a23d-08a4945e03a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5871cc5af88642b1beccb3a1914af91e'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:29.519476 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-90e7b686-3e8f-4964-a23d-08a4945e03a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5871cc5af88642b1beccb3a1914af91e'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:29.529097 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 904/1813] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Sep 19 14:57:29 2022] DELETE /identity/v3/users/5871cc5af88642b1beccb3a1914af91e => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:29.535080 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc72cd06-36a6-45ff-b002-ea9d05756f21 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:29.536295 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc72cd06-36a6-45ff-b002-ea9d05756f21 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:29.536880 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc72cd06-36a6-45ff-b002-ea9d05756f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:29.620532 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-fc72cd06-36a6-45ff-b002-ea9d05756f21 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:29.627655 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-fc72cd06-36a6-45ff-b002-ea9d05756f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:29.823482 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 910/1814] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:57:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 14:57:29.866499 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e7b686-3e8f-4964-a23d-08a4945e03a6 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:29.868022 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-90e7b686-3e8f-4964-a23d-08a4945e03a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:29.896215 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:DELETE=20,keystone:SELECT=78,keystone:INSERT=2 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:30.012064 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e7b686-3e8f-4964-a23d-08a4945e03a6 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:30.017496 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bd6591-cd1a-4f27-87e9-2eee77b361c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c2b78646374cb79ded4b7b59ba49c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:30.018360 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd6591-cd1a-4f27-87e9-2eee77b361c5 service neutron] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:30.018797 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd6591-cd1a-4f27-87e9-2eee77b361c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:30.019220 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd6591-cd1a-4f27-87e9-2eee77b361c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:30.043607 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bd6591-cd1a-4f27-87e9-2eee77b361c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:30.046016 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bd6591-cd1a-4f27-87e9-2eee77b361c5 service neutron] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:30.070756 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 905/1815] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:57:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:57:30.233143 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc72cd06-36a6-45ff-b002-ea9d05756f21 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:30.235186 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-fc72cd06-36a6-45ff-b002-ea9d05756f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:30.444775 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc72cd06-36a6-45ff-b002-ea9d05756f21 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:30.458938 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37a8983-2e39-4ad8-9615-f4882de62a1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055439dc35e946f4a82535c684f9b60d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:30.459973 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37a8983-2e39-4ad8-9615-f4882de62a1a service nova] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:30.460256 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37a8983-2e39-4ad8-9615-f4882de62a1a service nova] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:30.460547 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37a8983-2e39-4ad8-9615-f4882de62a1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:30.468207 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-a37a8983-2e39-4ad8-9615-f4882de62a1a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:30.493596 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37a8983-2e39-4ad8-9615-f4882de62a1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:30.497487 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37a8983-2e39-4ad8-9615-f4882de62a1a service nova] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:30.523258 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 911/1816] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:57:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 14:57:30.668370 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bd6591-cd1a-4f27-87e9-2eee77b361c5 service neutron] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:30.669295 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-c5bd6591-cd1a-4f27-87e9-2eee77b361c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:30.692209 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bd6591-cd1a-4f27-87e9-2eee77b361c5 service neutron] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:30.705002 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ced142-7e42-46a4-a11a-e4c56c4c63c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:30.705654 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ced142-7e42-46a4-a11a-e4c56c4c63c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:30.705949 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ced142-7e42-46a4-a11a-e4c56c4c63c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:30.706723 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ced142-7e42-46a4-a11a-e4c56c4c63c8 admin admin] PATH_INFO: `/v3/projects/5b441e0c58ef416f8c8a14718a4798ea` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:30.709398 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ced142-7e42-46a4-a11a-e4c56c4c63c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b441e0c58ef416f8c8a14718a4798ea)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:30.711301 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ced142-7e42-46a4-a11a-e4c56c4c63c8 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:30.829636 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-29ced142-7e42-46a4-a11a-e4c56c4c63c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b441e0c58ef416f8c8a14718a4798ea', 'request_id': 'req-29ced142-7e42-46a4-a11a-e4c56c4c63c8'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:30.839504 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-29ced142-7e42-46a4-a11a-e4c56c4c63c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b441e0c58ef416f8c8a14718a4798ea', 'request_id': 'req-29ced142-7e42-46a4-a11a-e4c56c4c63c8'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:30.853468 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-29ced142-7e42-46a4-a11a-e4c56c4c63c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b441e0c58ef416f8c8a14718a4798ea', 'request_id': 'req-29ced142-7e42-46a4-a11a-e4c56c4c63c8'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:30.867204 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-29ced142-7e42-46a4-a11a-e4c56c4c63c8 admin admin] The token cache is being invalidate because project 5b441e0c58ef416f8c8a14718a4798ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 14:57:30.867464 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-29ced142-7e42-46a4-a11a-e4c56c4c63c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:30.868139 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-29ced142-7e42-46a4-a11a-e4c56c4c63c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:30.870278 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 906/1817] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Sep 19 14:57:30 2022] DELETE /identity/v3/projects/5b441e0c58ef416f8c8a14718a4798ea => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:30.878815 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f53f6a-a9a6-4eb6-8101-c58021ef3501 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:30.879414 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f53f6a-a9a6-4eb6-8101-c58021ef3501 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:30.879414 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f53f6a-a9a6-4eb6-8101-c58021ef3501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:30.949690 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-43f53f6a-a9a6-4eb6-8101-c58021ef3501 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:30.950866 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-43f53f6a-a9a6-4eb6-8101-c58021ef3501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:30.974595 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:31.010395 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ced142-7e42-46a4-a11a-e4c56c4c63c8 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:31.010395 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-29ced142-7e42-46a4-a11a-e4c56c4c63c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:31.140304 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 912/1818] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:57:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:31.142574 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f6662c-3ae7-43de-8d4b-7c8a362dbec4 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:31.142863 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f6662c-3ae7-43de-8d4b-7c8a362dbec4 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:31.143140 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f6662c-3ae7-43de-8d4b-7c8a362dbec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:31.163104 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ced142-7e42-46a4-a11a-e4c56c4c63c8 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:31.174648 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4f9066-ab23-4f12-9b13-70a80d906113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:31.176132 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f9066-ab23-4f12-9b13-70a80d906113 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:31.199950 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f9066-ab23-4f12-9b13-70a80d906113 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:31.203835 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f9066-ab23-4f12-9b13-70a80d906113 admin admin] PATH_INFO: `/v3/users/9e87ce596a5f4a1f92a4a509a00cacf2` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:31.219631 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4f9066-ab23-4f12-9b13-70a80d906113 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e87ce596a5f4a1f92a4a509a00cacf2)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:31.228041 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-37f6662c-3ae7-43de-8d4b-7c8a362dbec4 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:31.229292 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-37f6662c-3ae7-43de-8d4b-7c8a362dbec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:31.231032 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4f9066-ab23-4f12-9b13-70a80d906113 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:31.280917 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 913/1819] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:57:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:31.283940 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f6662c-3ae7-43de-8d4b-7c8a362dbec4 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:31.313354 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f6662c-3ae7-43de-8d4b-7c8a362dbec4 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:31.333975 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1ab1bd-c181-4955-95b3-2d0cd1cce283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:31.334983 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ab1bd-c181-4955-95b3-2d0cd1cce283 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:31.336050 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ab1bd-c181-4955-95b3-2d0cd1cce283 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:31.336598 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ab1bd-c181-4955-95b3-2d0cd1cce283 admin admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:31.339871 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1ab1bd-c181-4955-95b3-2d0cd1cce283 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:57:31.341228 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1ab1bd-c181-4955-95b3-2d0cd1cce283 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:31.347083 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1ab1bd-c181-4955-95b3-2d0cd1cce283 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:31.366147 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:31.371173 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 914/1820] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Sep 19 14:57:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:57:31.376974 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1ab1bd-c181-4955-95b3-2d0cd1cce283 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:31.412228 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-be4f9066-ab23-4f12-9b13-70a80d906113 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e87ce596a5f4a1f92a4a509a00cacf2'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:31.424868 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1ab1bd-c181-4955-95b3-2d0cd1cce283 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:31.442842 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9372aca9-51ec-4e23-9e84-49c99474fd1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:31.443743 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9372aca9-51ec-4e23-9e84-49c99474fd1d admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:31.443994 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9372aca9-51ec-4e23-9e84-49c99474fd1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:31.444269 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9372aca9-51ec-4e23-9e84-49c99474fd1d admin admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:31.444948 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9372aca9-51ec-4e23-9e84-49c99474fd1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:31.453563 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9372aca9-51ec-4e23-9e84-49c99474fd1d admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:31.456394 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-be4f9066-ab23-4f12-9b13-70a80d906113 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e87ce596a5f4a1f92a4a509a00cacf2'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:31.476686 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-be4f9066-ab23-4f12-9b13-70a80d906113 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e87ce596a5f4a1f92a4a509a00cacf2'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:31.481924 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-be4f9066-ab23-4f12-9b13-70a80d906113 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e87ce596a5f4a1f92a4a509a00cacf2'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:31.502325 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-be4f9066-ab23-4f12-9b13-70a80d906113 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e87ce596a5f4a1f92a4a509a00cacf2'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:31.539807 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 907/1821] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Sep 19 14:57:31 2022] DELETE /identity/v3/users/9e87ce596a5f4a1f92a4a509a00cacf2 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:31.545614 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320f7199-39e5-4575-9ddd-8c2920556675 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:31.545899 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320f7199-39e5-4575-9ddd-8c2920556675 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:31.546178 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320f7199-39e5-4575-9ddd-8c2920556675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:31.568306 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 915/1822] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Sep 19 14:57:31 2022] POST /identity/v3/projects => generated 387 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:57:31.574004 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9372aca9-51ec-4e23-9e84-49c99474fd1d admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:31.584111 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-9372aca9-51ec-4e23-9e84-49c99474fd1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:31.630098 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-320f7199-39e5-4575-9ddd-8c2920556675 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:31.638633 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-320f7199-39e5-4575-9ddd-8c2920556675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:31.799388 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 908/1823] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:57:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:31.820205 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9372aca9-51ec-4e23-9e84-49c99474fd1d admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:31.820595 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320f7199-39e5-4575-9ddd-8c2920556675 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:31.822215 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-320f7199-39e5-4575-9ddd-8c2920556675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:31.840376 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2924a57-8f72-4946-9059-6b0365e4f0ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:31.841373 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2924a57-8f72-4946-9059-6b0365e4f0ef admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:31.841873 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2924a57-8f72-4946-9059-6b0365e4f0ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:31.842331 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2924a57-8f72-4946-9059-6b0365e4f0ef admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:31.849993 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2924a57-8f72-4946-9059-6b0365e4f0ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:31.853026 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2924a57-8f72-4946-9059-6b0365e4f0ef admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:31.901649 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 916/1824] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Sep 19 14:57:31 2022] POST /identity/v3/users => generated 294 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:57:31.910540 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2924a57-8f72-4946-9059-6b0365e4f0ef admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:31.938146 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2924a57-8f72-4946-9059-6b0365e4f0ef admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:31.955326 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853d47d4-6205-4c60-90d3-1000a70b19dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:31.956881 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853d47d4-6205-4c60-90d3-1000a70b19dd admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:31.957364 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853d47d4-6205-4c60-90d3-1000a70b19dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:31.957728 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853d47d4-6205-4c60-90d3-1000a70b19dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:31.958858 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853d47d4-6205-4c60-90d3-1000a70b19dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:31.961863 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853d47d4-6205-4c60-90d3-1000a70b19dd admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:31.973817 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320f7199-39e5-4575-9ddd-8c2920556675 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:31.981594 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2090990d-91e1-410b-912b-967bc4748043 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c2b78646374cb79ded4b7b59ba49c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:31.982608 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2090990d-91e1-410b-912b-967bc4748043 service neutron] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:31.982760 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 917/1825] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:57:31 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:57:31.982858 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2090990d-91e1-410b-912b-967bc4748043 service neutron] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:31.983296 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2090990d-91e1-410b-912b-967bc4748043 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:31.987482 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853d47d4-6205-4c60-90d3-1000a70b19dd admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:31.998585 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853d47d4-6205-4c60-90d3-1000a70b19dd admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:32.004934 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc02a4b0-95e2-4acd-9864-163d5d0e04a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:32.005501 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2090990d-91e1-410b-912b-967bc4748043 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:32.006022 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc02a4b0-95e2-4acd-9864-163d5d0e04a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:32.006508 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc02a4b0-95e2-4acd-9864-163d5d0e04a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:32.006922 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc02a4b0-95e2-4acd-9864-163d5d0e04a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:32.007301 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2090990d-91e1-410b-912b-967bc4748043 service neutron] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:32.007992 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc02a4b0-95e2-4acd-9864-163d5d0e04a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:32.010239 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc02a4b0-95e2-4acd-9864-163d5d0e04a4 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:32.030139 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 909/1826] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:57:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 14:57:32.030906 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 918/1827] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:57:31 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:57:32.031946 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2090990d-91e1-410b-912b-967bc4748043 service neutron] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:32.066120 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2090990d-91e1-410b-912b-967bc4748043 service neutron] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:32.073031 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eabed4-9fd6-4e87-88b7-46a644a6ddb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:32.073844 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eabed4-9fd6-4e87-88b7-46a644a6ddb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:32.074209 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eabed4-9fd6-4e87-88b7-46a644a6ddb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:32.074748 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eabed4-9fd6-4e87-88b7-46a644a6ddb3 admin admin] PATH_INFO: `/v3/projects/9948c2e3008d4bae81a65c08412d35bf/users/018aaacc64224e238604b846f3f0557c/roles/efa0e5b3413748dc828a89b12d67df79` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:32.108855 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eabed4-9fd6-4e87-88b7-46a644a6ddb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9948c2e3008d4bae81a65c08412d35bf, user_id=018aaacc64224e238604b846f3f0557c, role_id=efa0e5b3413748dc828a89b12d67df79)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:32.118562 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eabed4-9fd6-4e87-88b7-46a644a6ddb3 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:32.139905 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 910/1828] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 14:57:32 2022] PUT /identity/v3/projects/9948c2e3008d4bae81a65c08412d35bf/users/018aaacc64224e238604b846f3f0557c/roles/efa0e5b3413748dc828a89b12d67df79 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 14:57:32.153031 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabefef2-3b18-415b-ad9d-dc750458b376 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:32.153220 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabefef2-3b18-415b-ad9d-dc750458b376 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:32.153529 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabefef2-3b18-415b-ad9d-dc750458b376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:32.182558 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eabed4-9fd6-4e87-88b7-46a644a6ddb3 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:32.184578 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-85eabed4-9fd6-4e87-88b7-46a644a6ddb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:32.193891 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-cabefef2-3b18-415b-ad9d-dc750458b376 None None] MFA Rules not processed for user `018aaacc64224e238604b846f3f0557c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:32.195019 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-cabefef2-3b18-415b-ad9d-dc750458b376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:32.228030 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:32.238499 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:32.278955 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eabed4-9fd6-4e87-88b7-46a644a6ddb3 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:32.283313 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 919/1829] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:57:32 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:32.284557 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c041f62-6e08-476f-b7c7-60099e3cd552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:32.285341 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c041f62-6e08-476f-b7c7-60099e3cd552 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:32.285630 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c041f62-6e08-476f-b7c7-60099e3cd552 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:32.285971 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c041f62-6e08-476f-b7c7-60099e3cd552 admin admin] PATH_INFO: `/v3/projects/8e6db0b65a3f4835b9b40afa30a04a10` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:32.287457 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c041f62-6e08-476f-b7c7-60099e3cd552 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e6db0b65a3f4835b9b40afa30a04a10)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:32.288261 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabefef2-3b18-415b-ad9d-dc750458b376 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:32.289417 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c041f62-6e08-476f-b7c7-60099e3cd552 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:32.300899 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabefef2-3b18-415b-ad9d-dc750458b376 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:32.306039 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7985aa-3468-49f5-9175-09a27bd38932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:32.306686 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7985aa-3468-49f5-9175-09a27bd38932 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:32.306974 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7985aa-3468-49f5-9175-09a27bd38932 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:32.307255 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7985aa-3468-49f5-9175-09a27bd38932 admin admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:32.307892 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7985aa-3468-49f5-9175-09a27bd38932 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:32.309927 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7985aa-3468-49f5-9175-09a27bd38932 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:32.344365 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 920/1830] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Sep 19 14:57:32 2022] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:57:32.346520 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7985aa-3468-49f5-9175-09a27bd38932 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:32.348569 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-1c041f62-6e08-476f-b7c7-60099e3cd552 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e6db0b65a3f4835b9b40afa30a04a10', 'request_id': 'req-1c041f62-6e08-476f-b7c7-60099e3cd552'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:32.357081 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-1c041f62-6e08-476f-b7c7-60099e3cd552 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e6db0b65a3f4835b9b40afa30a04a10', 'request_id': 'req-1c041f62-6e08-476f-b7c7-60099e3cd552'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:32.364876 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-1c041f62-6e08-476f-b7c7-60099e3cd552 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e6db0b65a3f4835b9b40afa30a04a10', 'request_id': 'req-1c041f62-6e08-476f-b7c7-60099e3cd552'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:32.380034 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-1c041f62-6e08-476f-b7c7-60099e3cd552 admin admin] The token cache is being invalidate because project 8e6db0b65a3f4835b9b40afa30a04a10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 14:57:32.380346 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-1c041f62-6e08-476f-b7c7-60099e3cd552 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:32.381038 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-1c041f62-6e08-476f-b7c7-60099e3cd552 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:32.382739 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 911/1831] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Sep 19 14:57:32 2022] DELETE /identity/v3/projects/8e6db0b65a3f4835b9b40afa30a04a10 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 14:57:32.386600 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c041f62-6e08-476f-b7c7-60099e3cd552 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:32.388005 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-1c041f62-6e08-476f-b7c7-60099e3cd552 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:32.451833 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7985aa-3468-49f5-9175-09a27bd38932 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:32.456481 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d487bf91-c1dd-48c6-ab26-46f9d3201523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:32.457110 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d487bf91-c1dd-48c6-ab26-46f9d3201523 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:32.457394 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d487bf91-c1dd-48c6-ab26-46f9d3201523 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:32.457673 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d487bf91-c1dd-48c6-ab26-46f9d3201523 admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:32.458317 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d487bf91-c1dd-48c6-ab26-46f9d3201523 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:32.460257 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d487bf91-c1dd-48c6-ab26-46f9d3201523 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:32.489257 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 921/1832] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Sep 19 14:57:32 2022] POST /identity/v3/users => generated 293 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 14:57:32.490396 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d487bf91-c1dd-48c6-ab26-46f9d3201523 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:32.492303 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-d487bf91-c1dd-48c6-ab26-46f9d3201523 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:32.502144 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c041f62-6e08-476f-b7c7-60099e3cd552 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:32.508733 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa1f1de-6bcc-4846-87b8-596ef9d2e4f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:32.508982 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d487bf91-c1dd-48c6-ab26-46f9d3201523 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:32.509788 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa1f1de-6bcc-4846-87b8-596ef9d2e4f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:32.510216 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa1f1de-6bcc-4846-87b8-596ef9d2e4f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:32.511344 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa1f1de-6bcc-4846-87b8-596ef9d2e4f2 admin admin] PATH_INFO: `/v3/users/97b52acaf38046a582ff01b20ed338c6` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:32.512690 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa1f1de-6bcc-4846-87b8-596ef9d2e4f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97b52acaf38046a582ff01b20ed338c6)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:32.514598 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa1f1de-6bcc-4846-87b8-596ef9d2e4f2 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:32.522067 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e797079d-9f4c-4045-ba7c-0fb9f38ec2c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:32.522713 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e797079d-9f4c-4045-ba7c-0fb9f38ec2c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:32.522993 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e797079d-9f4c-4045-ba7c-0fb9f38ec2c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:32.523267 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e797079d-9f4c-4045-ba7c-0fb9f38ec2c3 admin admin] PATH_INFO: `/v3/projects/823ff0a6025747838cf1c89b78a54744` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:32.526210 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e797079d-9f4c-4045-ba7c-0fb9f38ec2c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=823ff0a6025747838cf1c89b78a54744)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:32.527655 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e797079d-9f4c-4045-ba7c-0fb9f38ec2c3 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:32.610702 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-ffa1f1de-6bcc-4846-87b8-596ef9d2e4f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97b52acaf38046a582ff01b20ed338c6'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:32.612609 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-e797079d-9f4c-4045-ba7c-0fb9f38ec2c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '823ff0a6025747838cf1c89b78a54744', 'request_id': 'req-e797079d-9f4c-4045-ba7c-0fb9f38ec2c3'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:32.622434 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-e797079d-9f4c-4045-ba7c-0fb9f38ec2c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '823ff0a6025747838cf1c89b78a54744', 'request_id': 'req-e797079d-9f4c-4045-ba7c-0fb9f38ec2c3'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:32.628434 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:32.630023 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-e797079d-9f4c-4045-ba7c-0fb9f38ec2c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '823ff0a6025747838cf1c89b78a54744', 'request_id': 'req-e797079d-9f4c-4045-ba7c-0fb9f38ec2c3'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:32.630515 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-ffa1f1de-6bcc-4846-87b8-596ef9d2e4f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97b52acaf38046a582ff01b20ed338c6'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:32.646258 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-e797079d-9f4c-4045-ba7c-0fb9f38ec2c3 admin admin] The token cache is being invalidate because project 823ff0a6025747838cf1c89b78a54744 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 14:57:32.646584 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-e797079d-9f4c-4045-ba7c-0fb9f38ec2c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:32.647234 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-e797079d-9f4c-4045-ba7c-0fb9f38ec2c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:32.649832 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-ffa1f1de-6bcc-4846-87b8-596ef9d2e4f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97b52acaf38046a582ff01b20ed338c6'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:32.651515 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-ffa1f1de-6bcc-4846-87b8-596ef9d2e4f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97b52acaf38046a582ff01b20ed338c6'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:32.651891 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 922/1833] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Sep 19 14:57:32 2022] DELETE /identity/v3/projects/823ff0a6025747838cf1c89b78a54744 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:32.653387 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e797079d-9f4c-4045-ba7c-0fb9f38ec2c3 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:32.654848 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-e797079d-9f4c-4045-ba7c-0fb9f38ec2c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:32.666243 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-ffa1f1de-6bcc-4846-87b8-596ef9d2e4f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97b52acaf38046a582ff01b20ed338c6'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:32.682044 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 912/1834] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Sep 19 14:57:32 2022] DELETE /identity/v3/users/97b52acaf38046a582ff01b20ed338c6 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 14:57:32.682044 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa1f1de-6bcc-4846-87b8-596ef9d2e4f2 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:32.682294 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-ffa1f1de-6bcc-4846-87b8-596ef9d2e4f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:32.692862 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:32.772901 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e797079d-9f4c-4045-ba7c-0fb9f38ec2c3 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:32.853034 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b580538d-f720-4673-94a0-c84a37c166c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:32.854213 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b580538d-f720-4673-94a0-c84a37c166c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:32.854564 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b580538d-f720-4673-94a0-c84a37c166c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:32.854917 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b580538d-f720-4673-94a0-c84a37c166c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:32.855686 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b580538d-f720-4673-94a0-c84a37c166c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:32.857518 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b580538d-f720-4673-94a0-c84a37c166c6 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:32.867484 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa1f1de-6bcc-4846-87b8-596ef9d2e4f2 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:32.875018 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99b7a25-0346-4830-814f-c91ec43d44f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:32.876262 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b7a25-0346-4830-814f-c91ec43d44f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:32.877007 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 923/1835] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:57:32 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:57:32.877564 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b7a25-0346-4830-814f-c91ec43d44f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:32.877896 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b580538d-f720-4673-94a0-c84a37c166c6 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:32.878336 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b7a25-0346-4830-814f-c91ec43d44f7 admin admin] PATH_INFO: `/v3/users/93b242cff5234e5181c6708ce60aee98` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:32.879998 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-b580538d-f720-4673-94a0-c84a37c166c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:32.880705 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99b7a25-0346-4830-814f-c91ec43d44f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93b242cff5234e5181c6708ce60aee98)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:32.884000 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99b7a25-0346-4830-814f-c91ec43d44f7 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:32.911687 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b580538d-f720-4673-94a0-c84a37c166c6 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:32.928116 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f639f1-4a47-4a5c-8574-4d823e689919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:32.929053 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f639f1-4a47-4a5c-8574-4d823e689919 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:32.929532 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f639f1-4a47-4a5c-8574-4d823e689919 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:32.929964 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f639f1-4a47-4a5c-8574-4d823e689919 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:32.930991 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f639f1-4a47-4a5c-8574-4d823e689919 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:32.934171 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f639f1-4a47-4a5c-8574-4d823e689919 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:32.962281 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 924/1836] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:57:32 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:57:32.963680 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f639f1-4a47-4a5c-8574-4d823e689919 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:32.990878 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f639f1-4a47-4a5c-8574-4d823e689919 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:32.996169 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-a99b7a25-0346-4830-814f-c91ec43d44f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93b242cff5234e5181c6708ce60aee98'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:32.999311 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d45d3c-2b3b-426f-ae03-e13998d69e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:33.000257 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d45d3c-2b3b-426f-ae03-e13998d69e4a admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:33.000636 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d45d3c-2b3b-426f-ae03-e13998d69e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:33.001106 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d45d3c-2b3b-426f-ae03-e13998d69e4a admin admin] PATH_INFO: `/v3/projects/218b835447c64695ad431a27326dfdbf/users/22b75085af354164b4d7ab62d218277c/roles/efa0e5b3413748dc828a89b12d67df79` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:33.025027 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-a99b7a25-0346-4830-814f-c91ec43d44f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93b242cff5234e5181c6708ce60aee98'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:33.026720 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d45d3c-2b3b-426f-ae03-e13998d69e4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=218b835447c64695ad431a27326dfdbf, user_id=22b75085af354164b4d7ab62d218277c, role_id=efa0e5b3413748dc828a89b12d67df79)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:33.034633 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d45d3c-2b3b-426f-ae03-e13998d69e4a admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:33.039124 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-a99b7a25-0346-4830-814f-c91ec43d44f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93b242cff5234e5181c6708ce60aee98'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:33.040480 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-a99b7a25-0346-4830-814f-c91ec43d44f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93b242cff5234e5181c6708ce60aee98'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:33.055083 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-a99b7a25-0346-4830-814f-c91ec43d44f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93b242cff5234e5181c6708ce60aee98'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:33.063632 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 913/1837] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Sep 19 14:57:32 2022] DELETE /identity/v3/users/93b242cff5234e5181c6708ce60aee98 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:33.076479 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 925/1838] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 14:57:32 2022] PUT /identity/v3/projects/218b835447c64695ad431a27326dfdbf/users/22b75085af354164b4d7ab62d218277c/roles/efa0e5b3413748dc828a89b12d67df79 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:33.081557 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0daad0-a44a-454e-a2cb-0e3eff320bbf None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:33.081557 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0daad0-a44a-454e-a2cb-0e3eff320bbf None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:33.082173 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0daad0-a44a-454e-a2cb-0e3eff320bbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:33.133662 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-fa0daad0-a44a-454e-a2cb-0e3eff320bbf None None] MFA Rules not processed for user `22b75085af354164b4d7ab62d218277c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:33.135437 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-fa0daad0-a44a-454e-a2cb-0e3eff320bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:33.204600 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:33.250001 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 914/1839] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:57:33 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:33.251076 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d45d3c-2b3b-426f-ae03-e13998d69e4a admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:33.253115 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-c0d45d3c-2b3b-426f-ae03-e13998d69e4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:33.353191 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d45d3c-2b3b-426f-ae03-e13998d69e4a admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:33.403503 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:33.421352 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0daad0-a44a-454e-a2cb-0e3eff320bbf None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:33.422864 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-fa0daad0-a44a-454e-a2cb-0e3eff320bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:33.446045 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8de0e47-5e2c-4819-924f-cfe30ed00be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:33.446882 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8de0e47-5e2c-4819-924f-cfe30ed00be4 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:33.447003 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8de0e47-5e2c-4819-924f-cfe30ed00be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:33.447202 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8de0e47-5e2c-4819-924f-cfe30ed00be4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:33.447925 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8de0e47-5e2c-4819-924f-cfe30ed00be4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:33.450015 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8de0e47-5e2c-4819-924f-cfe30ed00be4 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:33.510562 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0daad0-a44a-454e-a2cb-0e3eff320bbf None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:33.514612 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 926/1840] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Sep 19 14:57:33 2022] POST /identity/v3/projects => generated 387 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 14:57:33.518732 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8de0e47-5e2c-4819-924f-cfe30ed00be4 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:33.600469 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1426cae1-14e2-44f1-b9f8-3d1c80ece7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:33.601436 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1426cae1-14e2-44f1-b9f8-3d1c80ece7d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:33.601959 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1426cae1-14e2-44f1-b9f8-3d1c80ece7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:33.602272 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1426cae1-14e2-44f1-b9f8-3d1c80ece7d0 admin admin] PATH_INFO: `/v3/projects/3b39969849354bab82ad05d713cd19b0` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:33.603960 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1426cae1-14e2-44f1-b9f8-3d1c80ece7d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b39969849354bab82ad05d713cd19b0)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:33.607020 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1426cae1-14e2-44f1-b9f8-3d1c80ece7d0 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:33.619150 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8de0e47-5e2c-4819-924f-cfe30ed00be4 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:33.625005 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ba3059-7dae-4ad5-864f-5fcdc1b0fef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:33.625678 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba3059-7dae-4ad5-864f-5fcdc1b0fef7 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:33.626953 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba3059-7dae-4ad5-864f-5fcdc1b0fef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:33.627063 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba3059-7dae-4ad5-864f-5fcdc1b0fef7 admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:33.627669 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ba3059-7dae-4ad5-864f-5fcdc1b0fef7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:33.631417 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ba3059-7dae-4ad5-864f-5fcdc1b0fef7 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:33.659782 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 927/1841] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Sep 19 14:57:33 2022] POST /identity/v3/users => generated 300 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:57:33.660691 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ba3059-7dae-4ad5-864f-5fcdc1b0fef7 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:33.662453 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-d1ba3059-7dae-4ad5-864f-5fcdc1b0fef7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:33.677674 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ba3059-7dae-4ad5-864f-5fcdc1b0fef7 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:33.698194 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-1426cae1-14e2-44f1-b9f8-3d1c80ece7d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b39969849354bab82ad05d713cd19b0', 'request_id': 'req-1426cae1-14e2-44f1-b9f8-3d1c80ece7d0'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:33.713852 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-1426cae1-14e2-44f1-b9f8-3d1c80ece7d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b39969849354bab82ad05d713cd19b0', 'request_id': 'req-1426cae1-14e2-44f1-b9f8-3d1c80ece7d0'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:33.724242 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-1426cae1-14e2-44f1-b9f8-3d1c80ece7d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b39969849354bab82ad05d713cd19b0', 'request_id': 'req-1426cae1-14e2-44f1-b9f8-3d1c80ece7d0'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:33.740994 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-1426cae1-14e2-44f1-b9f8-3d1c80ece7d0 admin admin] The token cache is being invalidate because project 3b39969849354bab82ad05d713cd19b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 14:57:33.741422 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-1426cae1-14e2-44f1-b9f8-3d1c80ece7d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:33.742221 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-1426cae1-14e2-44f1-b9f8-3d1c80ece7d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:33.748048 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 915/1842] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Sep 19 14:57:33 2022] DELETE /identity/v3/projects/3b39969849354bab82ad05d713cd19b0 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:33.748048 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1426cae1-14e2-44f1-b9f8-3d1c80ece7d0 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:33.752416 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-1426cae1-14e2-44f1-b9f8-3d1c80ece7d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:33.779925 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed21c01-e050-4c7b-8b72-564a09424dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:33.780653 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed21c01-e050-4c7b-8b72-564a09424dce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:33.780989 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed21c01-e050-4c7b-8b72-564a09424dce admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:33.783153 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed21c01-e050-4c7b-8b72-564a09424dce admin admin] PATH_INFO: `/v3/projects/38b8ea9adf5241f88ab9463c39dbc28a` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:33.784916 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed21c01-e050-4c7b-8b72-564a09424dce admin admin] RBAC: Authorizing `identity:delete_project(project_id=38b8ea9adf5241f88ab9463c39dbc28a)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:33.787993 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed21c01-e050-4c7b-8b72-564a09424dce admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:33.793394 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:33.859224 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1426cae1-14e2-44f1-b9f8-3d1c80ece7d0 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:33.863323 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-1ed21c01-e050-4c7b-8b72-564a09424dce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38b8ea9adf5241f88ab9463c39dbc28a', 'request_id': 'req-1ed21c01-e050-4c7b-8b72-564a09424dce'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:33.866491 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:33.874569 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-1ed21c01-e050-4c7b-8b72-564a09424dce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38b8ea9adf5241f88ab9463c39dbc28a', 'request_id': 'req-1ed21c01-e050-4c7b-8b72-564a09424dce'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:33.887005 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-1ed21c01-e050-4c7b-8b72-564a09424dce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38b8ea9adf5241f88ab9463c39dbc28a', 'request_id': 'req-1ed21c01-e050-4c7b-8b72-564a09424dce'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:33.902062 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-1ed21c01-e050-4c7b-8b72-564a09424dce admin admin] The token cache is being invalidate because project 38b8ea9adf5241f88ab9463c39dbc28a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 14:57:33.902387 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-1ed21c01-e050-4c7b-8b72-564a09424dce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:33.903030 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-1ed21c01-e050-4c7b-8b72-564a09424dce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:33.909207 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 928/1843] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Sep 19 14:57:33 2022] DELETE /identity/v3/projects/38b8ea9adf5241f88ab9463c39dbc28a => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:33.909207 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2832f877-cb17-4981-a036-08051bc247b7 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:33.909207 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2832f877-cb17-4981-a036-08051bc247b7 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:33.909207 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2832f877-cb17-4981-a036-08051bc247b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:33.928804 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-2832f877-cb17-4981-a036-08051bc247b7 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:33.929975 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-2832f877-cb17-4981-a036-08051bc247b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:33.931067 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05af695f-45ce-4e89-9b2e-348f095413f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:33.931995 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af695f-45ce-4e89-9b2e-348f095413f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:33.932544 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af695f-45ce-4e89-9b2e-348f095413f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:33.932824 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af695f-45ce-4e89-9b2e-348f095413f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:33.933477 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05af695f-45ce-4e89-9b2e-348f095413f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:33.935388 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05af695f-45ce-4e89-9b2e-348f095413f7 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:33.938408 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 929/1844] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:57:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:33.940020 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5313f6bc-6760-4077-955b-21ab1b3fd265 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:33.941078 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5313f6bc-6760-4077-955b-21ab1b3fd265 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:33.941561 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5313f6bc-6760-4077-955b-21ab1b3fd265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:33.950420 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 916/1845] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:57:33 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:57:33.951867 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c964fc-ceb1-4cd5-99a9-a5130927ef26 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:33.952396 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c964fc-ceb1-4cd5-99a9-a5130927ef26 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:33.952682 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c964fc-ceb1-4cd5-99a9-a5130927ef26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:33.969213 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-5313f6bc-6760-4077-955b-21ab1b3fd265 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:33.970653 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-5313f6bc-6760-4077-955b-21ab1b3fd265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:33.973500 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-86c964fc-ceb1-4cd5-99a9-a5130927ef26 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:33.974727 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-86c964fc-ceb1-4cd5-99a9-a5130927ef26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:33.986173 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 930/1846] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:57:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:33.986173 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5313f6bc-6760-4077-955b-21ab1b3fd265 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:33.986173 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-5313f6bc-6760-4077-955b-21ab1b3fd265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:33.989940 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 917/1847] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:57:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:33.991713 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e07631-74d7-4d62-ada3-031fd0f57bf8 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:33.992001 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e07631-74d7-4d62-ada3-031fd0f57bf8 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:33.992629 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e07631-74d7-4d62-ada3-031fd0f57bf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:33.994952 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5313f6bc-6760-4077-955b-21ab1b3fd265 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:33.999637 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ad747e-3e3b-4566-bfec-ebdeac661f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:34.000631 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad747e-3e3b-4566-bfec-ebdeac661f2b admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:34.000915 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad747e-3e3b-4566-bfec-ebdeac661f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:34.001190 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad747e-3e3b-4566-bfec-ebdeac661f2b admin admin] PATH_INFO: `/v3/projects/80f7ee330d5b43d5998856e607a1d3c2/users/a5d8dd21def44e9799b9afa5c6d51a6f/roles/ddb643577b2e4e478100ec370decfaeb` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:34.014064 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-32e07631-74d7-4d62-ada3-031fd0f57bf8 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:34.016149 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-32e07631-74d7-4d62-ada3-031fd0f57bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:34.017868 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ad747e-3e3b-4566-bfec-ebdeac661f2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=80f7ee330d5b43d5998856e607a1d3c2, user_id=a5d8dd21def44e9799b9afa5c6d51a6f, role_id=ddb643577b2e4e478100ec370decfaeb)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:34.020701 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ad747e-3e3b-4566-bfec-ebdeac661f2b admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:34.024007 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 918/1848] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:57:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:34.024889 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e07631-74d7-4d62-ada3-031fd0f57bf8 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:34.036017 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 931/1849] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 14:57:33 2022] PUT /identity/v3/projects/80f7ee330d5b43d5998856e607a1d3c2/users/a5d8dd21def44e9799b9afa5c6d51a6f/roles/ddb643577b2e4e478100ec370decfaeb => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:34.036222 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e07631-74d7-4d62-ada3-031fd0f57bf8 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:34.037042 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ad747e-3e3b-4566-bfec-ebdeac661f2b admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:34.095565 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6abc0b7-b521-4a12-8cbd-b76b53af9e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:34.096279 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6abc0b7-b521-4a12-8cbd-b76b53af9e25 admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:34.096720 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6abc0b7-b521-4a12-8cbd-b76b53af9e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:34.096999 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6abc0b7-b521-4a12-8cbd-b76b53af9e25 admin admin] PATH_INFO: `/v3/domains` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:34.097642 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6abc0b7-b521-4a12-8cbd-b76b53af9e25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:57:34.097958 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6abc0b7-b521-4a12-8cbd-b76b53af9e25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:34.099569 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6abc0b7-b521-4a12-8cbd-b76b53af9e25 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:34.099666 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ad747e-3e3b-4566-bfec-ebdeac661f2b admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:34.104707 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c9e933-7988-40c2-8ef2-2ade9bb53235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:34.105312 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c9e933-7988-40c2-8ef2-2ade9bb53235 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:34.105590 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c9e933-7988-40c2-8ef2-2ade9bb53235 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:34.105862 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c9e933-7988-40c2-8ef2-2ade9bb53235 admin admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:34.106533 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c9e933-7988-40c2-8ef2-2ade9bb53235 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:57:34.106840 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c9e933-7988-40c2-8ef2-2ade9bb53235 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:34.108476 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c9e933-7988-40c2-8ef2-2ade9bb53235 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:34.111539 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 919/1850] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Sep 19 14:57:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:57:34.112421 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6abc0b7-b521-4a12-8cbd-b76b53af9e25 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:34.123706 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 932/1851] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Sep 19 14:57:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:57:34.123706 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c9e933-7988-40c2-8ef2-2ade9bb53235 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:34.124675 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6abc0b7-b521-4a12-8cbd-b76b53af9e25 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:34.129744 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d82dcf-f18e-4b7d-a39e-5c3c7dcde7a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:34.130342 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d82dcf-f18e-4b7d-a39e-5c3c7dcde7a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:34.130624 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d82dcf-f18e-4b7d-a39e-5c3c7dcde7a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:34.130899 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d82dcf-f18e-4b7d-a39e-5c3c7dcde7a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:34.131314 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c9e933-7988-40c2-8ef2-2ade9bb53235 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:34.131603 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d82dcf-f18e-4b7d-a39e-5c3c7dcde7a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:34.133229 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d82dcf-f18e-4b7d-a39e-5c3c7dcde7a9 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:34.135921 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed84d83f-98d3-4bfc-9ea2-85a40d3a1b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:34.136533 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed84d83f-98d3-4bfc-9ea2-85a40d3a1b08 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:34.136813 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed84d83f-98d3-4bfc-9ea2-85a40d3a1b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:34.137088 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed84d83f-98d3-4bfc-9ea2-85a40d3a1b08 admin admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:34.137705 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed84d83f-98d3-4bfc-9ea2-85a40d3a1b08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:34.139604 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed84d83f-98d3-4bfc-9ea2-85a40d3a1b08 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:34.144579 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 920/1852] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:57:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:57:34.145364 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d82dcf-f18e-4b7d-a39e-5c3c7dcde7a9 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:34.154882 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d82dcf-f18e-4b7d-a39e-5c3c7dcde7a9 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:34.159729 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf5da03-9b8e-461f-87be-90d68b6d18b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:34.160467 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf5da03-9b8e-461f-87be-90d68b6d18b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:34.160772 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf5da03-9b8e-461f-87be-90d68b6d18b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:34.160989 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf5da03-9b8e-461f-87be-90d68b6d18b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:34.161614 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf5da03-9b8e-461f-87be-90d68b6d18b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:34.163669 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf5da03-9b8e-461f-87be-90d68b6d18b2 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:34.170836 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 933/1853] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Sep 19 14:57:34 2022] POST /identity/v3/projects => generated 381 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:57:34.171830 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed84d83f-98d3-4bfc-9ea2-85a40d3a1b08 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:34.196949 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 921/1854] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Sep 19 14:57:34 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:57:34.197840 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf5da03-9b8e-461f-87be-90d68b6d18b2 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:34.219196 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:34.240169 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed84d83f-98d3-4bfc-9ea2-85a40d3a1b08 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:34.266532 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf5da03-9b8e-461f-87be-90d68b6d18b2 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:34.270842 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:34.271692 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b7d725-7f30-45f0-80e4-37d3817ecefd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:34.272303 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b7d725-7f30-45f0-80e4-37d3817ecefd admin admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:34.272613 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b7d725-7f30-45f0-80e4-37d3817ecefd admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:34.272932 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b7d725-7f30-45f0-80e4-37d3817ecefd admin admin] PATH_INFO: `/v3/users` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:34.273674 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b7d725-7f30-45f0-80e4-37d3817ecefd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:34.275636 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b7d725-7f30-45f0-80e4-37d3817ecefd admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:34.300811 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 922/1855] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Sep 19 14:57:34 2022] POST /identity/v3/users => generated 291 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:57:34.302616 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b7d725-7f30-45f0-80e4-37d3817ecefd admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:34.314713 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165acf6d-aeae-40e6-9d44-c22cbb7c84cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:34.315855 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b7d725-7f30-45f0-80e4-37d3817ecefd admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:34.316354 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165acf6d-aeae-40e6-9d44-c22cbb7c84cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:34.316993 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165acf6d-aeae-40e6-9d44-c22cbb7c84cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:34.317496 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165acf6d-aeae-40e6-9d44-c22cbb7c84cf admin admin] PATH_INFO: `/v3/projects/80f7ee330d5b43d5998856e607a1d3c2/users/a5d8dd21def44e9799b9afa5c6d51a6f/roles/ddb643577b2e4e478100ec370decfaeb` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:34.320963 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165acf6d-aeae-40e6-9d44-c22cbb7c84cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=80f7ee330d5b43d5998856e607a1d3c2, user_id=a5d8dd21def44e9799b9afa5c6d51a6f, role_id=ddb643577b2e4e478100ec370decfaeb)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:34.321816 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbecf23-fed4-4c8a-afb2-9ab6c0df2731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:34.322580 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbecf23-fed4-4c8a-afb2-9ab6c0df2731 admin admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:34.323005 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbecf23-fed4-4c8a-afb2-9ab6c0df2731 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:34.323435 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbecf23-fed4-4c8a-afb2-9ab6c0df2731 admin admin] PATH_INFO: `/v3/users` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:34.324207 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbecf23-fed4-4c8a-afb2-9ab6c0df2731 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:34.324390 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165acf6d-aeae-40e6-9d44-c22cbb7c84cf admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:34.326443 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbecf23-fed4-4c8a-afb2-9ab6c0df2731 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:34.340176 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 934/1856] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 14:57:34 2022] PUT /identity/v3/projects/80f7ee330d5b43d5998856e607a1d3c2/users/a5d8dd21def44e9799b9afa5c6d51a6f/roles/ddb643577b2e4e478100ec370decfaeb => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:34.352064 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165acf6d-aeae-40e6-9d44-c22cbb7c84cf admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:34.368380 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 923/1857] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Sep 19 14:57:34 2022] POST /identity/v3/users => generated 292 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:57:34.369227 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb78e1e-8959-497c-ad2f-954cf843d38a None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:34.369574 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb78e1e-8959-497c-ad2f-954cf843d38a None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:34.369910 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb78e1e-8959-497c-ad2f-954cf843d38a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:34.403826 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-7bb78e1e-8959-497c-ad2f-954cf843d38a None None] MFA Rules not processed for user `a5d8dd21def44e9799b9afa5c6d51a6f`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:34.405075 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-7bb78e1e-8959-497c-ad2f-954cf843d38a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:34.494932 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165acf6d-aeae-40e6-9d44-c22cbb7c84cf admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:34.502893 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 924/1858] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:57:34 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:34.506226 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb78e1e-8959-497c-ad2f-954cf843d38a None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:34.507604 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1184c886-041f-45e9-b5cd-4cb69ed160e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:34.508232 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1184c886-041f-45e9-b5cd-4cb69ed160e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:34.508539 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1184c886-041f-45e9-b5cd-4cb69ed160e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:34.508844 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1184c886-041f-45e9-b5cd-4cb69ed160e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:34.514246 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1184c886-041f-45e9-b5cd-4cb69ed160e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:34.516992 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1184c886-041f-45e9-b5cd-4cb69ed160e4 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:34.529774 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb78e1e-8959-497c-ad2f-954cf843d38a None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:34.530897 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 935/1859] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:57:34 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:57:34.533631 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1184c886-041f-45e9-b5cd-4cb69ed160e4 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:34.535420 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-1184c886-041f-45e9-b5cd-4cb69ed160e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:34.538254 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a64daa7-7e83-4b45-9489-a06b369b99f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:34.538910 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a64daa7-7e83-4b45-9489-a06b369b99f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:34.539220 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a64daa7-7e83-4b45-9489-a06b369b99f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:34.539490 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a64daa7-7e83-4b45-9489-a06b369b99f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:34.540215 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a64daa7-7e83-4b45-9489-a06b369b99f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:34.545457 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a64daa7-7e83-4b45-9489-a06b369b99f0 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:34.557674 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 925/1860] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:57:34 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:57:34.558557 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a64daa7-7e83-4b45-9489-a06b369b99f0 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:34.577730 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a64daa7-7e83-4b45-9489-a06b369b99f0 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:34.583618 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e7674a-1ac9-43ac-952e-71c0f16c4e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:34.584294 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e7674a-1ac9-43ac-952e-71c0f16c4e9b admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:34.584638 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e7674a-1ac9-43ac-952e-71c0f16c4e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:34.584915 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e7674a-1ac9-43ac-952e-71c0f16c4e9b admin admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:34.585555 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e7674a-1ac9-43ac-952e-71c0f16c4e9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:34.587156 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e7674a-1ac9-43ac-952e-71c0f16c4e9b admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:34.598203 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 926/1861] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:57:34 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:57:34.598872 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e7674a-1ac9-43ac-952e-71c0f16c4e9b admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:34.611063 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1184c886-041f-45e9-b5cd-4cb69ed160e4 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:34.611709 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e7674a-1ac9-43ac-952e-71c0f16c4e9b admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:34.614904 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c63a99f-cbc3-43c7-8a58-95716ff8ec67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139dc7a4f1dc48fe8faea848bd1ac0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:34.615516 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c63a99f-cbc3-43c7-8a58-95716ff8ec67 service cinder] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:34.615849 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c63a99f-cbc3-43c7-8a58-95716ff8ec67 service cinder] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:34.616136 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c63a99f-cbc3-43c7-8a58-95716ff8ec67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:34.616711 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d69fb71-5120-4af2-8733-d5d44d6adff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:34.617366 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d69fb71-5120-4af2-8733-d5d44d6adff0 admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:34.617618 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d69fb71-5120-4af2-8733-d5d44d6adff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:34.617899 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d69fb71-5120-4af2-8733-d5d44d6adff0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:34.618707 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d69fb71-5120-4af2-8733-d5d44d6adff0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:34.620288 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d69fb71-5120-4af2-8733-d5d44d6adff0 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:34.627709 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c63a99f-cbc3-43c7-8a58-95716ff8ec67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:34.629366 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c63a99f-cbc3-43c7-8a58-95716ff8ec67 service cinder] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:34.632045 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 927/1862] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:57:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:57:34.632716 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d69fb71-5120-4af2-8733-d5d44d6adff0 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:34.640210 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 936/1863] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:57:34 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:57:34.641240 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c63a99f-cbc3-43c7-8a58-95716ff8ec67 service cinder] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:34.644490 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d69fb71-5120-4af2-8733-d5d44d6adff0 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:34.651344 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dc88f6-a343-4982-a774-28f723052d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:34.652010 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc88f6-a343-4982-a774-28f723052d5f admin admin] REQUEST_METHOD: `PUT` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:34.652290 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc88f6-a343-4982-a774-28f723052d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:34.652624 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc88f6-a343-4982-a774-28f723052d5f admin admin] PATH_INFO: `/v3/projects/b670cd40bdf24e478beeffaa5b07242d/users/81112735676f477280bc3f5c25b3c8f7/roles/efa0e5b3413748dc828a89b12d67df79` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:34.653607 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c63a99f-cbc3-43c7-8a58-95716ff8ec67 service cinder] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:34.659412 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857fd1ed-ed19-4f1e-8790-9a4d4242b2ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:34.660246 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857fd1ed-ed19-4f1e-8790-9a4d4242b2ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:34.660778 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857fd1ed-ed19-4f1e-8790-9a4d4242b2ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:34.660949 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857fd1ed-ed19-4f1e-8790-9a4d4242b2ac admin admin] PATH_INFO: `/v3/projects/1c00b1073322444f9e8d9f28d400f2e0/users/e7f5f5ede98a4d71b841d30ebd8be230/roles/efa0e5b3413748dc828a89b12d67df79` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:34.676314 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dc88f6-a343-4982-a774-28f723052d5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b670cd40bdf24e478beeffaa5b07242d, user_id=81112735676f477280bc3f5c25b3c8f7, role_id=efa0e5b3413748dc828a89b12d67df79)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:34.679428 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dc88f6-a343-4982-a774-28f723052d5f admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:34.680918 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857fd1ed-ed19-4f1e-8790-9a4d4242b2ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c00b1073322444f9e8d9f28d400f2e0, user_id=e7f5f5ede98a4d71b841d30ebd8be230, role_id=efa0e5b3413748dc828a89b12d67df79)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:34.684153 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857fd1ed-ed19-4f1e-8790-9a4d4242b2ac admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:34.698174 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 928/1864] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 14:57:34 2022] PUT /identity/v3/projects/b670cd40bdf24e478beeffaa5b07242d/users/81112735676f477280bc3f5c25b3c8f7/roles/efa0e5b3413748dc828a89b12d67df79 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:34.704530 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 937/1865] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 14:57:34 2022] PUT /identity/v3/projects/1c00b1073322444f9e8d9f28d400f2e0/users/e7f5f5ede98a4d71b841d30ebd8be230/roles/efa0e5b3413748dc828a89b12d67df79 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:34.711176 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b74870-9ed7-4277-a4d9-e32cb8db9e1c None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:34.711306 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae37490-a5e2-4a7b-bb4a-b919cb6db1a2 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:34.711982 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b74870-9ed7-4277-a4d9-e32cb8db9e1c None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:34.712143 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae37490-a5e2-4a7b-bb4a-b919cb6db1a2 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:34.712227 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b74870-9ed7-4277-a4d9-e32cb8db9e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:34.712305 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae37490-a5e2-4a7b-bb4a-b919cb6db1a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:34.741142 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-35b74870-9ed7-4277-a4d9-e32cb8db9e1c None None] MFA Rules not processed for user `81112735676f477280bc3f5c25b3c8f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:34.742368 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-35b74870-9ed7-4277-a4d9-e32cb8db9e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:34.745168 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-4ae37490-a5e2-4a7b-bb4a-b919cb6db1a2 None None] MFA Rules not processed for user `e7f5f5ede98a4d71b841d30ebd8be230`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:34.746533 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-4ae37490-a5e2-4a7b-bb4a-b919cb6db1a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:34.751329 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:34.768953 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:34.827851 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 929/1866] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:57:34 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:34.828458 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 938/1867] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:57:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:34.837249 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b74870-9ed7-4277-a4d9-e32cb8db9e1c None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:34.837594 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae37490-a5e2-4a7b-bb4a-b919cb6db1a2 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:34.964294 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b74870-9ed7-4277-a4d9-e32cb8db9e1c None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:34.968308 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae37490-a5e2-4a7b-bb4a-b919cb6db1a2 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:34.970166 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c927c3c3-118c-431a-8a8a-71220275aab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:34.971403 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c927c3c3-118c-431a-8a8a-71220275aab4 admin admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:34.972017 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c927c3c3-118c-431a-8a8a-71220275aab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:34.972304 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c927c3c3-118c-431a-8a8a-71220275aab4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:34.973028 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c927c3c3-118c-431a-8a8a-71220275aab4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:34.975819 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c927c3c3-118c-431a-8a8a-71220275aab4 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:34.980388 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fc4498-c3d1-434b-9106-e8486daf2056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:34.981231 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fc4498-c3d1-434b-9106-e8486daf2056 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:34.981586 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fc4498-c3d1-434b-9106-e8486daf2056 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:34.981929 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fc4498-c3d1-434b-9106-e8486daf2056 admin admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:34.982647 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fc4498-c3d1-434b-9106-e8486daf2056 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:34.985278 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fc4498-c3d1-434b-9106-e8486daf2056 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:35.024283 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 939/1868] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Sep 19 14:57:34 2022] POST /identity/v3/projects => generated 383 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:57:35.030265 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fc4498-c3d1-434b-9106-e8486daf2056 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:35.030784 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 930/1869] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Sep 19 14:57:34 2022] POST /identity/v3/projects => generated 383 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:57:35.034539 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c927c3c3-118c-431a-8a8a-71220275aab4 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:35.120045 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c927c3c3-118c-431a-8a8a-71220275aab4 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:35.126220 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bd485f-73f2-406e-8829-f694b187c309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:35.126800 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd485f-73f2-406e-8829-f694b187c309 admin admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:35.127105 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd485f-73f2-406e-8829-f694b187c309 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:35.127547 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd485f-73f2-406e-8829-f694b187c309 admin admin] PATH_INFO: `/v3/users` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:35.128391 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bd485f-73f2-406e-8829-f694b187c309 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:35.129280 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fc4498-c3d1-434b-9106-e8486daf2056 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:35.130538 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bd485f-73f2-406e-8829-f694b187c309 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:35.146868 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beef50e-5ae4-4083-9dfe-8eefae29cefb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:35.148560 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beef50e-5ae4-4083-9dfe-8eefae29cefb admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:35.149263 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beef50e-5ae4-4083-9dfe-8eefae29cefb admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:35.149569 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beef50e-5ae4-4083-9dfe-8eefae29cefb admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:35.150302 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beef50e-5ae4-4083-9dfe-8eefae29cefb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:35.152933 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beef50e-5ae4-4083-9dfe-8eefae29cefb admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:35.166334 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 931/1870] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Sep 19 14:57:35 2022] POST /identity/v3/users => generated 298 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:57:35.170482 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bd485f-73f2-406e-8829-f694b187c309 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:35.185127 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bd485f-73f2-406e-8829-f694b187c309 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:35.213833 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 940/1871] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Sep 19 14:57:35 2022] POST /identity/v3/users => generated 298 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 14:57:35.214175 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d733442-ec49-4992-8483-00b21ff6c2e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:35.214269 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d733442-ec49-4992-8483-00b21ff6c2e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:35.215766 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beef50e-5ae4-4083-9dfe-8eefae29cefb admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:35.219743 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d733442-ec49-4992-8483-00b21ff6c2e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:35.220195 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d733442-ec49-4992-8483-00b21ff6c2e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:35.220959 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d733442-ec49-4992-8483-00b21ff6c2e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:35.225360 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d733442-ec49-4992-8483-00b21ff6c2e1 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:35.240553 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beef50e-5ae4-4083-9dfe-8eefae29cefb admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:35.253428 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c517a91-cdec-466d-a895-30daa7cf6ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:35.256199 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c517a91-cdec-466d-a895-30daa7cf6ccc admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:35.256511 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c517a91-cdec-466d-a895-30daa7cf6ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:35.256784 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c517a91-cdec-466d-a895-30daa7cf6ccc admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:35.257616 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 932/1872] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:57:35 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:57:35.257816 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c517a91-cdec-466d-a895-30daa7cf6ccc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:35.258947 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d733442-ec49-4992-8483-00b21ff6c2e1 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:35.264361 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c517a91-cdec-466d-a895-30daa7cf6ccc admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:35.282277 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d733442-ec49-4992-8483-00b21ff6c2e1 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:35.286490 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 941/1873] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:57:35 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:57:35.291238 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c517a91-cdec-466d-a895-30daa7cf6ccc admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:35.295026 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea94950-5287-456b-93d5-01fd4c48ca93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:35.297663 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea94950-5287-456b-93d5-01fd4c48ca93 admin admin] REQUEST_METHOD: `PUT` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:35.297950 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea94950-5287-456b-93d5-01fd4c48ca93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:35.298223 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea94950-5287-456b-93d5-01fd4c48ca93 admin admin] PATH_INFO: `/v3/projects/bf980e4bedc44afb8bdddcb32d6cb9c4/users/e5af9899011d41c1912c272506e2f6bd/roles/ddb643577b2e4e478100ec370decfaeb` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:35.322539 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c517a91-cdec-466d-a895-30daa7cf6ccc admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:35.324184 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:35.348763 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f1a088-e372-4bbc-9049-0d4dbbc68618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:35.349874 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f1a088-e372-4bbc-9049-0d4dbbc68618 admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:35.350574 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f1a088-e372-4bbc-9049-0d4dbbc68618 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:35.351410 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f1a088-e372-4bbc-9049-0d4dbbc68618 admin admin] PATH_INFO: `/v3/projects/cfa2330e4c9545838c0b053192302f89/users/6a662817aca44904b1e7f0c5cc8f9d79/roles/ddb643577b2e4e478100ec370decfaeb` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:35.355935 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea94950-5287-456b-93d5-01fd4c48ca93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf980e4bedc44afb8bdddcb32d6cb9c4, user_id=e5af9899011d41c1912c272506e2f6bd, role_id=ddb643577b2e4e478100ec370decfaeb)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:35.360351 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea94950-5287-456b-93d5-01fd4c48ca93 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:35.391066 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 933/1874] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 14:57:35 2022] PUT /identity/v3/projects/bf980e4bedc44afb8bdddcb32d6cb9c4/users/e5af9899011d41c1912c272506e2f6bd/roles/ddb643577b2e4e478100ec370decfaeb => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:35.391204 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f1a088-e372-4bbc-9049-0d4dbbc68618 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfa2330e4c9545838c0b053192302f89, user_id=6a662817aca44904b1e7f0c5cc8f9d79, role_id=ddb643577b2e4e478100ec370decfaeb)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:35.392854 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea94950-5287-456b-93d5-01fd4c48ca93 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:35.397235 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f1a088-e372-4bbc-9049-0d4dbbc68618 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:35.410767 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:35.419076 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 942/1875] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 14:57:35 2022] PUT /identity/v3/projects/cfa2330e4c9545838c0b053192302f89/users/6a662817aca44904b1e7f0c5cc8f9d79/roles/ddb643577b2e4e478100ec370decfaeb => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:35.420014 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f1a088-e372-4bbc-9049-0d4dbbc68618 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:35.526453 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f1a088-e372-4bbc-9049-0d4dbbc68618 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:35.533919 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5461a4-8e39-4602-877c-57924499395e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:35.535719 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5461a4-8e39-4602-877c-57924499395e admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:35.536048 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5461a4-8e39-4602-877c-57924499395e admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:35.536358 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5461a4-8e39-4602-877c-57924499395e admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:35.539850 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5461a4-8e39-4602-877c-57924499395e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:35.541523 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5461a4-8e39-4602-877c-57924499395e admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:35.544472 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea94950-5287-456b-93d5-01fd4c48ca93 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:35.550389 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58da2017-bde4-487c-8148-81c8b8f372ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:35.551087 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da2017-bde4-487c-8148-81c8b8f372ac admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:35.551433 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da2017-bde4-487c-8148-81c8b8f372ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:35.551721 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da2017-bde4-487c-8148-81c8b8f372ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:35.552385 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58da2017-bde4-487c-8148-81c8b8f372ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:35.553969 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58da2017-bde4-487c-8148-81c8b8f372ac admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:35.556712 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 943/1876] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:57:35 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:57:35.557764 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5461a4-8e39-4602-877c-57924499395e admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:35.566809 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 934/1877] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:57:35 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:57:35.567626 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58da2017-bde4-487c-8148-81c8b8f372ac admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:35.589971 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58da2017-bde4-487c-8148-81c8b8f372ac admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:35.604698 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef08197-6cfa-4387-b33f-a2cbea027864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:35.605678 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef08197-6cfa-4387-b33f-a2cbea027864 admin admin] REQUEST_METHOD: `PUT` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:35.606012 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef08197-6cfa-4387-b33f-a2cbea027864 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:35.606420 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef08197-6cfa-4387-b33f-a2cbea027864 admin admin] PATH_INFO: `/v3/projects/cfa2330e4c9545838c0b053192302f89/users/6a662817aca44904b1e7f0c5cc8f9d79/roles/ddb643577b2e4e478100ec370decfaeb` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:35.613222 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef08197-6cfa-4387-b33f-a2cbea027864 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfa2330e4c9545838c0b053192302f89, user_id=6a662817aca44904b1e7f0c5cc8f9d79, role_id=ddb643577b2e4e478100ec370decfaeb)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:35.617750 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef08197-6cfa-4387-b33f-a2cbea027864 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:35.632161 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5461a4-8e39-4602-877c-57924499395e admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:35.638266 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 935/1878] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 14:57:35 2022] PUT /identity/v3/projects/cfa2330e4c9545838c0b053192302f89/users/6a662817aca44904b1e7f0c5cc8f9d79/roles/ddb643577b2e4e478100ec370decfaeb => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:35.649023 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef08197-6cfa-4387-b33f-a2cbea027864 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:35.725144 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc02913-61b4-4858-9b92-ea46be2b37b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139dc7a4f1dc48fe8faea848bd1ac0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:35.725912 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc02913-61b4-4858-9b92-ea46be2b37b6 service cinder] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:35.726261 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc02913-61b4-4858-9b92-ea46be2b37b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:35.726629 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc02913-61b4-4858-9b92-ea46be2b37b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:35.728716 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-adc02913-61b4-4858-9b92-ea46be2b37b6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:35.741260 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef08197-6cfa-4387-b33f-a2cbea027864 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:35.761974 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b1973e-9080-45bc-b252-94049640ea5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:35.763926 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b1973e-9080-45bc-b252-94049640ea5d admin admin] REQUEST_METHOD: `PUT` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:35.764629 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b1973e-9080-45bc-b252-94049640ea5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:35.765125 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b1973e-9080-45bc-b252-94049640ea5d admin admin] PATH_INFO: `/v3/projects/bf980e4bedc44afb8bdddcb32d6cb9c4/users/e5af9899011d41c1912c272506e2f6bd/roles/ddb643577b2e4e478100ec370decfaeb` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:35.770015 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b1973e-9080-45bc-b252-94049640ea5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf980e4bedc44afb8bdddcb32d6cb9c4, user_id=e5af9899011d41c1912c272506e2f6bd, role_id=ddb643577b2e4e478100ec370decfaeb)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:35.777038 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b1973e-9080-45bc-b252-94049640ea5d admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:35.797819 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 936/1879] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 14:57:35 2022] PUT /identity/v3/projects/bf980e4bedc44afb8bdddcb32d6cb9c4/users/e5af9899011d41c1912c272506e2f6bd/roles/ddb643577b2e4e478100ec370decfaeb => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:35.801511 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60d9846-fedb-43e5-be66-111dc57ff268 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:35.802127 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60d9846-fedb-43e5-be66-111dc57ff268 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:35.802576 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60d9846-fedb-43e5-be66-111dc57ff268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:35.860027 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-e60d9846-fedb-43e5-be66-111dc57ff268 None None] MFA Rules not processed for user `6a662817aca44904b1e7f0c5cc8f9d79`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:35.861815 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-e60d9846-fedb-43e5-be66-111dc57ff268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:35.866686 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc02913-61b4-4858-9b92-ea46be2b37b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:35.868370 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc02913-61b4-4858-9b92-ea46be2b37b6 service cinder] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:35.880787 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 944/1880] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:57:35 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:57:35.882775 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6046fadd-5c34-4b69-8c9c-7a7490f8d3f7 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:35.883105 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6046fadd-5c34-4b69-8c9c-7a7490f8d3f7 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:35.883490 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6046fadd-5c34-4b69-8c9c-7a7490f8d3f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:35.898932 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:35.937984 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-6046fadd-5c34-4b69-8c9c-7a7490f8d3f7 None None] MFA Rules not processed for user `e5af9899011d41c1912c272506e2f6bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:35.941172 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-6046fadd-5c34-4b69-8c9c-7a7490f8d3f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:36.030767 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:36.131857 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 937/1881] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:57:35 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:36.172103 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60d9846-fedb-43e5-be66-111dc57ff268 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:36.174072 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-e60d9846-fedb-43e5-be66-111dc57ff268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:36.175016 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 945/1882] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:57:35 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:36.299324 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60d9846-fedb-43e5-be66-111dc57ff268 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:36.308982 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d773d71-5d64-4b7f-9692-85eaf06a2881 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139dc7a4f1dc48fe8faea848bd1ac0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:36.309816 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d773d71-5d64-4b7f-9692-85eaf06a2881 service cinder] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:36.310217 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d773d71-5d64-4b7f-9692-85eaf06a2881 service cinder] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:36.310499 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d773d71-5d64-4b7f-9692-85eaf06a2881 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:36.422690 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d773d71-5d64-4b7f-9692-85eaf06a2881 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:36.425081 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d773d71-5d64-4b7f-9692-85eaf06a2881 service cinder] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:36.436357 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 938/1883] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:57:36 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:57:36.486483 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6046fadd-5c34-4b69-8c9c-7a7490f8d3f7 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:36.508548 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6046fadd-5c34-4b69-8c9c-7a7490f8d3f7 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:36.526970 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65641e35-c1c7-4cf9-acb2-2e1bf944329d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139dc7a4f1dc48fe8faea848bd1ac0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:36.527847 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65641e35-c1c7-4cf9-acb2-2e1bf944329d service cinder] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:36.528133 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65641e35-c1c7-4cf9-acb2-2e1bf944329d service cinder] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:36.528564 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65641e35-c1c7-4cf9-acb2-2e1bf944329d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:36.546494 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65641e35-c1c7-4cf9-acb2-2e1bf944329d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:36.548890 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65641e35-c1c7-4cf9-acb2-2e1bf944329d service cinder] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:36.574811 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 946/1884] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:57:36 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:57:36.743833 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d773d71-5d64-4b7f-9692-85eaf06a2881 service cinder] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:36.757498 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d773d71-5d64-4b7f-9692-85eaf06a2881 service cinder] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:36.762538 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996362ab-1cfb-4f03-aa25-c8c74dae313b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139dc7a4f1dc48fe8faea848bd1ac0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:36.763166 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996362ab-1cfb-4f03-aa25-c8c74dae313b service cinder] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:36.763447 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996362ab-1cfb-4f03-aa25-c8c74dae313b service cinder] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:36.763718 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996362ab-1cfb-4f03-aa25-c8c74dae313b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:36.852017 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996362ab-1cfb-4f03-aa25-c8c74dae313b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:36.854076 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996362ab-1cfb-4f03-aa25-c8c74dae313b service cinder] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:36.872540 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 939/1885] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:57:36 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:57:37.577368 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65641e35-c1c7-4cf9-acb2-2e1bf944329d service cinder] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:37.680674 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65641e35-c1c7-4cf9-acb2-2e1bf944329d service cinder] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:37.688199 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c463e5d5-add4-4674-9bc1-c817050692f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:37.689009 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c463e5d5-add4-4674-9bc1-c817050692f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:37.689321 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c463e5d5-add4-4674-9bc1-c817050692f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:37.689618 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c463e5d5-add4-4674-9bc1-c817050692f6 admin admin] PATH_INFO: `/v3/users/e7f5f5ede98a4d71b841d30ebd8be230` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:37.691448 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c463e5d5-add4-4674-9bc1-c817050692f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7f5f5ede98a4d71b841d30ebd8be230)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:37.693372 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c463e5d5-add4-4674-9bc1-c817050692f6 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:37.775253 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-c463e5d5-add4-4674-9bc1-c817050692f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7f5f5ede98a4d71b841d30ebd8be230'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:37.803480 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-c463e5d5-add4-4674-9bc1-c817050692f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7f5f5ede98a4d71b841d30ebd8be230'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:37.815057 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-c463e5d5-add4-4674-9bc1-c817050692f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7f5f5ede98a4d71b841d30ebd8be230'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:37.826462 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-c463e5d5-add4-4674-9bc1-c817050692f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7f5f5ede98a4d71b841d30ebd8be230'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:37.827494 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-c463e5d5-add4-4674-9bc1-c817050692f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7f5f5ede98a4d71b841d30ebd8be230'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:37.831490 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:37.849633 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 947/1886] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Sep 19 14:57:37 2022] DELETE /identity/v3/users/e7f5f5ede98a4d71b841d30ebd8be230 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:37.854536 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46017d75-6b5c-4b35-8e14-0b41af0235c8 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:37.855006 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46017d75-6b5c-4b35-8e14-0b41af0235c8 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:37.855099 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46017d75-6b5c-4b35-8e14-0b41af0235c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:37.889201 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-46017d75-6b5c-4b35-8e14-0b41af0235c8 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:37.891911 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-46017d75-6b5c-4b35-8e14-0b41af0235c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:37.941367 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:37.969962 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 940/1887] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:57:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:37.981958 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c463e5d5-add4-4674-9bc1-c817050692f6 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:37.983516 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-c463e5d5-add4-4674-9bc1-c817050692f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:38.048291 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c463e5d5-add4-4674-9bc1-c817050692f6 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:38.053315 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0044d1-ac91-4b3e-9751-5de1d67b9005 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c2b78646374cb79ded4b7b59ba49c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:38.053902 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0044d1-ac91-4b3e-9751-5de1d67b9005 service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:38.054592 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0044d1-ac91-4b3e-9751-5de1d67b9005 service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:38.054592 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0044d1-ac91-4b3e-9751-5de1d67b9005 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:38.064748 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0044d1-ac91-4b3e-9751-5de1d67b9005 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:38.066253 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0044d1-ac91-4b3e-9751-5de1d67b9005 service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:38.077125 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 948/1888] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:57:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:57:38.910080 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46017d75-6b5c-4b35-8e14-0b41af0235c8 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:38.915744 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-46017d75-6b5c-4b35-8e14-0b41af0235c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:38.939540 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46017d75-6b5c-4b35-8e14-0b41af0235c8 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:38.947841 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7bd97b-097a-44ca-a25d-2ffb032083f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:38.948786 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7bd97b-097a-44ca-a25d-2ffb032083f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:38.949099 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7bd97b-097a-44ca-a25d-2ffb032083f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:38.949518 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7bd97b-097a-44ca-a25d-2ffb032083f8 admin admin] PATH_INFO: `/v3/projects/1c00b1073322444f9e8d9f28d400f2e0` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:38.951984 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7bd97b-097a-44ca-a25d-2ffb032083f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c00b1073322444f9e8d9f28d400f2e0)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:38.954819 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7bd97b-097a-44ca-a25d-2ffb032083f8 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:39.068189 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-db7bd97b-097a-44ca-a25d-2ffb032083f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c00b1073322444f9e8d9f28d400f2e0', 'request_id': 'req-db7bd97b-097a-44ca-a25d-2ffb032083f8'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:39.081138 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-db7bd97b-097a-44ca-a25d-2ffb032083f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c00b1073322444f9e8d9f28d400f2e0', 'request_id': 'req-db7bd97b-097a-44ca-a25d-2ffb032083f8'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:39.093093 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-db7bd97b-097a-44ca-a25d-2ffb032083f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c00b1073322444f9e8d9f28d400f2e0', 'request_id': 'req-db7bd97b-097a-44ca-a25d-2ffb032083f8'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:39.108548 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-db7bd97b-097a-44ca-a25d-2ffb032083f8 admin admin] The token cache is being invalidate because project 1c00b1073322444f9e8d9f28d400f2e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 14:57:39.109038 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-db7bd97b-097a-44ca-a25d-2ffb032083f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:39.110666 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-db7bd97b-097a-44ca-a25d-2ffb032083f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:39.113394 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 941/1889] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Sep 19 14:57:38 2022] DELETE /identity/v3/projects/1c00b1073322444f9e8d9f28d400f2e0 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:39.117655 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0044d1-ac91-4b3e-9751-5de1d67b9005 service neutron] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:39.133565 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0044d1-ac91-4b3e-9751-5de1d67b9005 service neutron] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:39.152590 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6056f8e1-6e5a-4e8f-8830-3db697164454 None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:39.152590 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6056f8e1-6e5a-4e8f-8830-3db697164454 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:39.153600 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6056f8e1-6e5a-4e8f-8830-3db697164454 None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:39.159768 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 942/1890] 10.222.0.72 () {54 vars in 921 bytes} [Mon Sep 19 14:57:39 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:57:39.210543 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e4d24-d820-4b5b-b6ce-7cb004c7c7b4 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:39.212473 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e4d24-d820-4b5b-b6ce-7cb004c7c7b4 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:39.214693 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e4d24-d820-4b5b-b6ce-7cb004c7c7b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:39.264795 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-af6e4d24-d820-4b5b-b6ce-7cb004c7c7b4 None None] MFA Rules not processed for user `055439dc35e946f4a82535c684f9b60d`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:39.269322 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5332eaa3-b43b-455b-9c26-d97782dc1eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:39.270286 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5332eaa3-b43b-455b-9c26-d97782dc1eee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:39.270718 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5332eaa3-b43b-455b-9c26-d97782dc1eee admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:39.271067 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-af6e4d24-d820-4b5b-b6ce-7cb004c7c7b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:39.271308 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5332eaa3-b43b-455b-9c26-d97782dc1eee admin admin] PATH_INFO: `/v3/users/e5af9899011d41c1912c272506e2f6bd` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:39.273890 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5332eaa3-b43b-455b-9c26-d97782dc1eee admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5af9899011d41c1912c272506e2f6bd)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:39.276056 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5332eaa3-b43b-455b-9c26-d97782dc1eee admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:39.383320 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-5332eaa3-b43b-455b-9c26-d97782dc1eee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5af9899011d41c1912c272506e2f6bd'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:39.397891 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 943/1891] 10.222.0.72 () {58 vars in 1018 bytes} [Mon Sep 19 14:57:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 14:57:39.401173 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-5332eaa3-b43b-455b-9c26-d97782dc1eee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5af9899011d41c1912c272506e2f6bd'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:39.411146 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-5332eaa3-b43b-455b-9c26-d97782dc1eee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5af9899011d41c1912c272506e2f6bd'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:39.416365 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6e4d24-d820-4b5b-b6ce-7cb004c7c7b4 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:39.418315 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-af6e4d24-d820-4b5b-b6ce-7cb004c7c7b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:39.439574 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-5332eaa3-b43b-455b-9c26-d97782dc1eee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5af9899011d41c1912c272506e2f6bd'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:39.440616 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-5332eaa3-b43b-455b-9c26-d97782dc1eee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5af9899011d41c1912c272506e2f6bd'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:39.455716 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6e4d24-d820-4b5b-b6ce-7cb004c7c7b4 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:39.456385 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 949/1892] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Sep 19 14:57:39 2022] DELETE /identity/v3/users/e5af9899011d41c1912c272506e2f6bd => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:39.541134 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:39.564870 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a923d15c-37ca-47bc-9c93-10272fae46fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055439dc35e946f4a82535c684f9b60d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:39.565462 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a923d15c-37ca-47bc-9c93-10272fae46fc service nova] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:39.565845 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a923d15c-37ca-47bc-9c93-10272fae46fc service nova] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:39.566000 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a923d15c-37ca-47bc-9c93-10272fae46fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:39.571852 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-a923d15c-37ca-47bc-9c93-10272fae46fc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:39.602891 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a923d15c-37ca-47bc-9c93-10272fae46fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:39.607351 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a923d15c-37ca-47bc-9c93-10272fae46fc service nova] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:39.627225 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 944/1893] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:57:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 14:57:39.869370 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5332eaa3-b43b-455b-9c26-d97782dc1eee admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:39.870707 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-5332eaa3-b43b-455b-9c26-d97782dc1eee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:39.917278 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:39.974967 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5332eaa3-b43b-455b-9c26-d97782dc1eee admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:39.983184 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad5fc77-d962-4193-8a49-207141cac4ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:39.983828 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad5fc77-d962-4193-8a49-207141cac4ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:39.984879 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad5fc77-d962-4193-8a49-207141cac4ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:39.985206 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad5fc77-d962-4193-8a49-207141cac4ac admin admin] PATH_INFO: `/v3/projects/bf980e4bedc44afb8bdddcb32d6cb9c4` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:39.986668 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad5fc77-d962-4193-8a49-207141cac4ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf980e4bedc44afb8bdddcb32d6cb9c4)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:39.988908 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad5fc77-d962-4193-8a49-207141cac4ac admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:40.062207 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-bad5fc77-d962-4193-8a49-207141cac4ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf980e4bedc44afb8bdddcb32d6cb9c4', 'request_id': 'req-bad5fc77-d962-4193-8a49-207141cac4ac'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:40.073777 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-bad5fc77-d962-4193-8a49-207141cac4ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf980e4bedc44afb8bdddcb32d6cb9c4', 'request_id': 'req-bad5fc77-d962-4193-8a49-207141cac4ac'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:40.083203 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-bad5fc77-d962-4193-8a49-207141cac4ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf980e4bedc44afb8bdddcb32d6cb9c4', 'request_id': 'req-bad5fc77-d962-4193-8a49-207141cac4ac'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:40.102320 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-bad5fc77-d962-4193-8a49-207141cac4ac admin admin] The token cache is being invalidate because project bf980e4bedc44afb8bdddcb32d6cb9c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 14:57:40.102663 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-bad5fc77-d962-4193-8a49-207141cac4ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:40.103406 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-bad5fc77-d962-4193-8a49-207141cac4ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:40.105703 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 950/1894] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Sep 19 14:57:39 2022] DELETE /identity/v3/projects/bf980e4bedc44afb8bdddcb32d6cb9c4 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 14:57:40.113368 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a70a08-856a-47b0-b2b0-e344e8c3c21c None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:40.114337 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a70a08-856a-47b0-b2b0-e344e8c3c21c None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:40.114774 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a70a08-856a-47b0-b2b0-e344e8c3c21c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:40.155233 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-50a70a08-856a-47b0-b2b0-e344e8c3c21c None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:40.158049 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-50a70a08-856a-47b0-b2b0-e344e8c3c21c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:40.360742 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 945/1895] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:57:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:40.372104 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2565bd61-f6af-4b18-8fb2-fdeb57be61be None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:40.372644 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2565bd61-f6af-4b18-8fb2-fdeb57be61be None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:40.373103 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2565bd61-f6af-4b18-8fb2-fdeb57be61be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:40.405436 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-2565bd61-f6af-4b18-8fb2-fdeb57be61be None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:40.407827 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-2565bd61-f6af-4b18-8fb2-fdeb57be61be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:40.421857 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 951/1896] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:57:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:40.427381 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a70a08-856a-47b0-b2b0-e344e8c3c21c None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:40.446273 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a70a08-856a-47b0-b2b0-e344e8c3c21c None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:40.461247 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55de0980-5e3a-4b30-b18a-99f480359880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:40.461932 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de0980-5e3a-4b30-b18a-99f480359880 admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:40.462212 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de0980-5e3a-4b30-b18a-99f480359880 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:40.464674 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de0980-5e3a-4b30-b18a-99f480359880 admin admin] PATH_INFO: `/v3/domains` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:40.468378 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55de0980-5e3a-4b30-b18a-99f480359880 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:57:40.468378 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55de0980-5e3a-4b30-b18a-99f480359880 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:40.473459 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55de0980-5e3a-4b30-b18a-99f480359880 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:40.536042 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 946/1897] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Sep 19 14:57:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:57:40.537274 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2565bd61-f6af-4b18-8fb2-fdeb57be61be None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:40.554769 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2565bd61-f6af-4b18-8fb2-fdeb57be61be None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:40.566626 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026a4d15-4918-463f-87b1-725ca1d8c7bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:40.569257 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a4d15-4918-463f-87b1-725ca1d8c7bf admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:40.569537 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a4d15-4918-463f-87b1-725ca1d8c7bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:40.569807 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a4d15-4918-463f-87b1-725ca1d8c7bf admin admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:40.570458 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026a4d15-4918-463f-87b1-725ca1d8c7bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:40.574788 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026a4d15-4918-463f-87b1-725ca1d8c7bf admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:40.656758 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 952/1898] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Sep 19 14:57:40 2022] POST /identity/v3/projects => generated 375 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:57:40.660981 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55de0980-5e3a-4b30-b18a-99f480359880 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:40.678896 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55de0980-5e3a-4b30-b18a-99f480359880 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:40.803427 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965c1b01-a56e-4eb6-bc1a-bce7a8d6419c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:40.803942 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965c1b01-a56e-4eb6-bc1a-bce7a8d6419c admin admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:40.804228 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965c1b01-a56e-4eb6-bc1a-bce7a8d6419c admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:40.804538 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965c1b01-a56e-4eb6-bc1a-bce7a8d6419c admin admin] PATH_INFO: `/v3/users` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:40.805231 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965c1b01-a56e-4eb6-bc1a-bce7a8d6419c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:40.807419 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965c1b01-a56e-4eb6-bc1a-bce7a8d6419c admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:40.842744 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 947/1899] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Sep 19 14:57:40 2022] POST /identity/v3/users => generated 288 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:57:40.843665 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026a4d15-4918-463f-87b1-725ca1d8c7bf admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:40.857179 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026a4d15-4918-463f-87b1-725ca1d8c7bf admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:40.881623 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32b4284-5b9b-4e94-8c62-d4197e3bff20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:40.882261 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32b4284-5b9b-4e94-8c62-d4197e3bff20 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:40.882540 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32b4284-5b9b-4e94-8c62-d4197e3bff20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:40.882840 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32b4284-5b9b-4e94-8c62-d4197e3bff20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:40.883501 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32b4284-5b9b-4e94-8c62-d4197e3bff20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:40.886813 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32b4284-5b9b-4e94-8c62-d4197e3bff20 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:40.912653 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 953/1900] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:57:40 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 14:57:40.914660 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965c1b01-a56e-4eb6-bc1a-bce7a8d6419c admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:40.946728 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965c1b01-a56e-4eb6-bc1a-bce7a8d6419c admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:40.963812 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f2d86a-b504-4a5c-aa69-1fe93a972886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:40.964954 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f2d86a-b504-4a5c-aa69-1fe93a972886 admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:40.965311 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f2d86a-b504-4a5c-aa69-1fe93a972886 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:40.965691 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f2d86a-b504-4a5c-aa69-1fe93a972886 admin admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:40.966559 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f2d86a-b504-4a5c-aa69-1fe93a972886 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:40.969966 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f2d86a-b504-4a5c-aa69-1fe93a972886 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:40.996826 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32b4284-5b9b-4e94-8c62-d4197e3bff20 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:40.998551 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-c32b4284-5b9b-4e94-8c62-d4197e3bff20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:41.016099 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 948/1901] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:57:40 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:57:41.017533 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f2d86a-b504-4a5c-aa69-1fe93a972886 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:41.027819 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f2d86a-b504-4a5c-aa69-1fe93a972886 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:41.038415 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1eb381-fede-4b29-b73a-bb84a1a8c3cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:41.039215 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1eb381-fede-4b29-b73a-bb84a1a8c3cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:41.039588 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1eb381-fede-4b29-b73a-bb84a1a8c3cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:41.039944 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1eb381-fede-4b29-b73a-bb84a1a8c3cd admin admin] PATH_INFO: `/v3/projects/a2c920d417da4391a0dc8889e5105e2e/users/6abade4a3a4d458e839b3dfb0ea0b452/roles/efa0e5b3413748dc828a89b12d67df79` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:41.060381 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1eb381-fede-4b29-b73a-bb84a1a8c3cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2c920d417da4391a0dc8889e5105e2e, user_id=6abade4a3a4d458e839b3dfb0ea0b452, role_id=efa0e5b3413748dc828a89b12d67df79)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:41.064372 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1eb381-fede-4b29-b73a-bb84a1a8c3cd admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:41.081005 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 949/1902] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 14:57:41 2022] PUT /identity/v3/projects/a2c920d417da4391a0dc8889e5105e2e/users/6abade4a3a4d458e839b3dfb0ea0b452/roles/efa0e5b3413748dc828a89b12d67df79 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:41.091470 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d64f15-bcb3-4f74-ac5b-b1067d060efc None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:41.091828 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d64f15-bcb3-4f74-ac5b-b1067d060efc None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:41.092240 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d64f15-bcb3-4f74-ac5b-b1067d060efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:41.116434 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32b4284-5b9b-4e94-8c62-d4197e3bff20 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:41.134126 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-29d64f15-bcb3-4f74-ac5b-b1067d060efc None None] MFA Rules not processed for user `6abade4a3a4d458e839b3dfb0ea0b452`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:41.135678 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-29d64f15-bcb3-4f74-ac5b-b1067d060efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:41.149087 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:41.157927 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:41.189044 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3477d19b-3ee7-4f7d-b66f-ef09c370b3e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139dc7a4f1dc48fe8faea848bd1ac0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:41.189748 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3477d19b-3ee7-4f7d-b66f-ef09c370b3e8 service cinder] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:41.190023 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3477d19b-3ee7-4f7d-b66f-ef09c370b3e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:41.190289 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3477d19b-3ee7-4f7d-b66f-ef09c370b3e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:41.192010 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-3477d19b-3ee7-4f7d-b66f-ef09c370b3e8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:41.207189 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 950/1903] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:57:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:41.211577 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d64f15-bcb3-4f74-ac5b-b1067d060efc None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:41.251871 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3477d19b-3ee7-4f7d-b66f-ef09c370b3e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:41.253378 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3477d19b-3ee7-4f7d-b66f-ef09c370b3e8 service cinder] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:41.262544 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 954/1904] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:57:40 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 14:57:41.274060 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d64f15-bcb3-4f74-ac5b-b1067d060efc None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:41.278650 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e46425-01ce-4a6d-8856-45952b6f005c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:41.279271 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e46425-01ce-4a6d-8856-45952b6f005c admin admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:41.279555 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e46425-01ce-4a6d-8856-45952b6f005c admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:41.279831 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e46425-01ce-4a6d-8856-45952b6f005c admin admin] PATH_INFO: `/v3/projects` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:41.280499 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e46425-01ce-4a6d-8856-45952b6f005c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:41.282429 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e46425-01ce-4a6d-8856-45952b6f005c admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:41.314811 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 951/1905] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Sep 19 14:57:41 2022] POST /identity/v3/projects => generated 373 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 14:57:41.319093 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3477d19b-3ee7-4f7d-b66f-ef09c370b3e8 service cinder] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:41.333353 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3477d19b-3ee7-4f7d-b66f-ef09c370b3e8 service cinder] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:41.418809 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d9a2fe-5875-421c-936c-50533714a7f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:41.419622 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d9a2fe-5875-421c-936c-50533714a7f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:41.420063 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d9a2fe-5875-421c-936c-50533714a7f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:41.420480 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d9a2fe-5875-421c-936c-50533714a7f4 admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:41.421543 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d9a2fe-5875-421c-936c-50533714a7f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:41.425272 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d9a2fe-5875-421c-936c-50533714a7f4 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:41.470079 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 955/1906] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Sep 19 14:57:41 2022] POST /identity/v3/users => generated 293 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 14:57:41.474109 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e46425-01ce-4a6d-8856-45952b6f005c admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:41.485920 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e46425-01ce-4a6d-8856-45952b6f005c admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:41.491437 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac1c777-742b-471e-8787-cb0537e48364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:41.492360 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac1c777-742b-471e-8787-cb0537e48364 admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:41.492724 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac1c777-742b-471e-8787-cb0537e48364 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:41.493031 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac1c777-742b-471e-8787-cb0537e48364 admin admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:41.493838 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac1c777-742b-471e-8787-cb0537e48364 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:41.495723 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac1c777-742b-471e-8787-cb0537e48364 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:41.512807 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 952/1907] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:57:41 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:57:41.517960 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d9a2fe-5875-421c-936c-50533714a7f4 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:41.532701 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d9a2fe-5875-421c-936c-50533714a7f4 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:41.540876 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8973e8-45e2-498e-8250-138cd2e97690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:41.542381 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8973e8-45e2-498e-8250-138cd2e97690 admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:41.542675 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8973e8-45e2-498e-8250-138cd2e97690 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:41.542989 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8973e8-45e2-498e-8250-138cd2e97690 admin admin] PATH_INFO: `/v3/projects/5f8ab33a96cf4c178722ee0f062c3523/users/39613d80cc5e44caab7c96b63a232a7a/roles/ddb643577b2e4e478100ec370decfaeb` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:41.563542 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8973e8-45e2-498e-8250-138cd2e97690 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f8ab33a96cf4c178722ee0f062c3523, user_id=39613d80cc5e44caab7c96b63a232a7a, role_id=ddb643577b2e4e478100ec370decfaeb)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:41.566572 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8973e8-45e2-498e-8250-138cd2e97690 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:41.585993 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 956/1908] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 14:57:41 2022] PUT /identity/v3/projects/5f8ab33a96cf4c178722ee0f062c3523/users/39613d80cc5e44caab7c96b63a232a7a/roles/ddb643577b2e4e478100ec370decfaeb => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:41.595267 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac1c777-742b-471e-8787-cb0537e48364 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:41.607110 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac1c777-742b-471e-8787-cb0537e48364 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:41.684747 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6943e9dc-5ea7-464a-ac88-5afdfdc68b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:41.685348 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6943e9dc-5ea7-464a-ac88-5afdfdc68b08 admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:41.685784 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6943e9dc-5ea7-464a-ac88-5afdfdc68b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:41.688703 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6943e9dc-5ea7-464a-ac88-5afdfdc68b08 admin admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:41.689609 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6943e9dc-5ea7-464a-ac88-5afdfdc68b08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:41.691437 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6943e9dc-5ea7-464a-ac88-5afdfdc68b08 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:41.712406 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 953/1909] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:57:41 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:57:41.713543 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8973e8-45e2-498e-8250-138cd2e97690 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:41.732087 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8973e8-45e2-498e-8250-138cd2e97690 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:41.745491 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa11868-12ec-43f7-8e4f-6e2453ff6fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:41.746187 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa11868-12ec-43f7-8e4f-6e2453ff6fa3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:41.746447 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa11868-12ec-43f7-8e4f-6e2453ff6fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:41.746696 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa11868-12ec-43f7-8e4f-6e2453ff6fa3 admin admin] PATH_INFO: `/v3/projects/5f8ab33a96cf4c178722ee0f062c3523/users/39613d80cc5e44caab7c96b63a232a7a/roles/ddb643577b2e4e478100ec370decfaeb` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:41.751375 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa11868-12ec-43f7-8e4f-6e2453ff6fa3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f8ab33a96cf4c178722ee0f062c3523, user_id=39613d80cc5e44caab7c96b63a232a7a, role_id=ddb643577b2e4e478100ec370decfaeb)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:41.754252 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa11868-12ec-43f7-8e4f-6e2453ff6fa3 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:41.806081 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 957/1910] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 14:57:41 2022] PUT /identity/v3/projects/5f8ab33a96cf4c178722ee0f062c3523/users/39613d80cc5e44caab7c96b63a232a7a/roles/ddb643577b2e4e478100ec370decfaeb => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:41.818815 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7123cdb9-da42-44cd-b620-7128ba3262e3 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:41.819339 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7123cdb9-da42-44cd-b620-7128ba3262e3 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:41.819619 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7123cdb9-da42-44cd-b620-7128ba3262e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:41.883276 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-7123cdb9-da42-44cd-b620-7128ba3262e3 None None] MFA Rules not processed for user `39613d80cc5e44caab7c96b63a232a7a`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:41.894344 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-7123cdb9-da42-44cd-b620-7128ba3262e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:41.923457 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:41.973331 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa11868-12ec-43f7-8e4f-6e2453ff6fa3 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:41.976359 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-faa11868-12ec-43f7-8e4f-6e2453ff6fa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:42.056050 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:42.070752 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 954/1911] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:57:41 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:42.071758 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7123cdb9-da42-44cd-b620-7128ba3262e3 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:42.135705 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa11868-12ec-43f7-8e4f-6e2453ff6fa3 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:42.140988 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8dc1ac-af6c-44fb-b4ac-200054b408cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:42.141735 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8dc1ac-af6c-44fb-b4ac-200054b408cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:42.142086 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8dc1ac-af6c-44fb-b4ac-200054b408cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:42.142429 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8dc1ac-af6c-44fb-b4ac-200054b408cc admin admin] PATH_INFO: `/v3/users/f4549c964ac14292ab3b0bd0f5569134` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:42.143798 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8dc1ac-af6c-44fb-b4ac-200054b408cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4549c964ac14292ab3b0bd0f5569134)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:42.145912 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8dc1ac-af6c-44fb-b4ac-200054b408cc admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:42.157602 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7123cdb9-da42-44cd-b620-7128ba3262e3 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:42.165452 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f870280-e342-4da8-9b3d-5a3b9210a424 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139dc7a4f1dc48fe8faea848bd1ac0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:42.166311 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f870280-e342-4da8-9b3d-5a3b9210a424 service cinder] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:42.166753 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f870280-e342-4da8-9b3d-5a3b9210a424 service cinder] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:42.168009 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f870280-e342-4da8-9b3d-5a3b9210a424 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:42.170045 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-9f870280-e342-4da8-9b3d-5a3b9210a424 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:42.214909 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-6b8dc1ac-af6c-44fb-b4ac-200054b408cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4549c964ac14292ab3b0bd0f5569134'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:42.232093 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-6b8dc1ac-af6c-44fb-b4ac-200054b408cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4549c964ac14292ab3b0bd0f5569134'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:42.242455 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-6b8dc1ac-af6c-44fb-b4ac-200054b408cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4549c964ac14292ab3b0bd0f5569134'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:42.255038 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-6b8dc1ac-af6c-44fb-b4ac-200054b408cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4549c964ac14292ab3b0bd0f5569134'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:42.256449 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-6b8dc1ac-af6c-44fb-b4ac-200054b408cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4549c964ac14292ab3b0bd0f5569134'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:42.270348 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 958/1912] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Sep 19 14:57:41 2022] DELETE /identity/v3/users/f4549c964ac14292ab3b0bd0f5569134 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 14:57:42.270348 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8dc1ac-af6c-44fb-b4ac-200054b408cc admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:42.273873 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-6b8dc1ac-af6c-44fb-b4ac-200054b408cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:42.305051 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f870280-e342-4da8-9b3d-5a3b9210a424 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:42.306500 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f870280-e342-4da8-9b3d-5a3b9210a424 service cinder] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:42.330612 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 955/1913] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:57:42 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:57:42.332196 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5f6a13-8957-455f-a5d8-8c38b3e87a92 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:42.332660 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5f6a13-8957-455f-a5d8-8c38b3e87a92 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:42.333151 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5f6a13-8957-455f-a5d8-8c38b3e87a92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:42.365994 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-3f5f6a13-8957-455f-a5d8-8c38b3e87a92 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:42.367387 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-3f5f6a13-8957-455f-a5d8-8c38b3e87a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:42.405159 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8dc1ac-af6c-44fb-b4ac-200054b408cc admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:42.409534 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0c2b35-8ed9-4e25-9f77-c2d2fe44b39e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139dc7a4f1dc48fe8faea848bd1ac0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:42.410158 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c2b35-8ed9-4e25-9f77-c2d2fe44b39e service cinder] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:42.410452 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c2b35-8ed9-4e25-9f77-c2d2fe44b39e service cinder] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:42.410729 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c2b35-8ed9-4e25-9f77-c2d2fe44b39e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:42.412660 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-ea0c2b35-8ed9-4e25-9f77-c2d2fe44b39e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:42.456347 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:42.472208 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 956/1914] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:57:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:42.482782 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5f6a13-8957-455f-a5d8-8c38b3e87a92 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:42.484650 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-3f5f6a13-8957-455f-a5d8-8c38b3e87a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:42.490778 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0c2b35-8ed9-4e25-9f77-c2d2fe44b39e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:42.492225 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0c2b35-8ed9-4e25-9f77-c2d2fe44b39e service cinder] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:42.502547 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 959/1915] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:57:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:57:42.563693 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5f6a13-8957-455f-a5d8-8c38b3e87a92 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:42.568750 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9de310-14bf-4a3c-81e3-6f14d6f1a29b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c2b78646374cb79ded4b7b59ba49c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:42.569456 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9de310-14bf-4a3c-81e3-6f14d6f1a29b service neutron] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:42.569742 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9de310-14bf-4a3c-81e3-6f14d6f1a29b service neutron] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:42.570086 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9de310-14bf-4a3c-81e3-6f14d6f1a29b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:42.581426 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9de310-14bf-4a3c-81e3-6f14d6f1a29b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:42.583605 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9de310-14bf-4a3c-81e3-6f14d6f1a29b service neutron] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:42.598480 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 957/1916] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:57:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 14:57:43.005009 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0c2b35-8ed9-4e25-9f77-c2d2fe44b39e service cinder] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:43.006487 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-ea0c2b35-8ed9-4e25-9f77-c2d2fe44b39e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:43.043644 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0c2b35-8ed9-4e25-9f77-c2d2fe44b39e service cinder] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:43.062789 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8e01a8-ce07-4e83-93ae-70a036465a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:43.063618 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8e01a8-ce07-4e83-93ae-70a036465a45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:43.063743 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8e01a8-ce07-4e83-93ae-70a036465a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:43.063971 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8e01a8-ce07-4e83-93ae-70a036465a45 admin admin] PATH_INFO: `/v3/projects/0d75db32de404780bcbd2c02dddd5447` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:43.068973 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8e01a8-ce07-4e83-93ae-70a036465a45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d75db32de404780bcbd2c02dddd5447)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:43.077937 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8e01a8-ce07-4e83-93ae-70a036465a45 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:43.082855 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:43.188429 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-da8e01a8-ce07-4e83-93ae-70a036465a45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d75db32de404780bcbd2c02dddd5447', 'request_id': 'req-da8e01a8-ce07-4e83-93ae-70a036465a45'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:43.198622 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-da8e01a8-ce07-4e83-93ae-70a036465a45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d75db32de404780bcbd2c02dddd5447', 'request_id': 'req-da8e01a8-ce07-4e83-93ae-70a036465a45'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:43.214902 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-da8e01a8-ce07-4e83-93ae-70a036465a45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d75db32de404780bcbd2c02dddd5447', 'request_id': 'req-da8e01a8-ce07-4e83-93ae-70a036465a45'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:43.229463 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-da8e01a8-ce07-4e83-93ae-70a036465a45 admin admin] The token cache is being invalidate because project 0d75db32de404780bcbd2c02dddd5447 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 14:57:43.230064 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-da8e01a8-ce07-4e83-93ae-70a036465a45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:43.230526 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-da8e01a8-ce07-4e83-93ae-70a036465a45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:43.233352 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 960/1917] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Sep 19 14:57:43 2022] DELETE /identity/v3/projects/0d75db32de404780bcbd2c02dddd5447 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:43.237641 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9de310-14bf-4a3c-81e3-6f14d6f1a29b service neutron] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:43.250822 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9de310-14bf-4a3c-81e3-6f14d6f1a29b service neutron] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:43.336315 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ddadf0-7683-4ce6-88fe-388aa803feaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:43.337846 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ddadf0-7683-4ce6-88fe-388aa803feaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:43.338144 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ddadf0-7683-4ce6-88fe-388aa803feaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:43.338471 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ddadf0-7683-4ce6-88fe-388aa803feaa admin admin] PATH_INFO: `/v3/users/cfca28aa4486400ea96e9db5abfda6f3` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:43.339711 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ddadf0-7683-4ce6-88fe-388aa803feaa admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfca28aa4486400ea96e9db5abfda6f3)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:43.341910 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ddadf0-7683-4ce6-88fe-388aa803feaa admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:43.408654 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-68ddadf0-7683-4ce6-88fe-388aa803feaa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfca28aa4486400ea96e9db5abfda6f3'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:43.446709 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-68ddadf0-7683-4ce6-88fe-388aa803feaa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfca28aa4486400ea96e9db5abfda6f3'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:43.465244 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-68ddadf0-7683-4ce6-88fe-388aa803feaa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfca28aa4486400ea96e9db5abfda6f3'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:43.466423 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-68ddadf0-7683-4ce6-88fe-388aa803feaa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfca28aa4486400ea96e9db5abfda6f3'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:43.477781 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-68ddadf0-7683-4ce6-88fe-388aa803feaa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfca28aa4486400ea96e9db5abfda6f3'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:43.486386 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 958/1918] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Sep 19 14:57:43 2022] DELETE /identity/v3/users/cfca28aa4486400ea96e9db5abfda6f3 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:43.777268 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8e01a8-ce07-4e83-93ae-70a036465a45 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:43.778747 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-da8e01a8-ce07-4e83-93ae-70a036465a45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:43.792773 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8e01a8-ce07-4e83-93ae-70a036465a45 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:43.849174 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91b646f-3200-416f-b2b2-877f68a97f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:43.849855 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b646f-3200-416f-b2b2-877f68a97f69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:43.850136 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b646f-3200-416f-b2b2-877f68a97f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:43.850411 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b646f-3200-416f-b2b2-877f68a97f69 admin admin] PATH_INFO: `/v3/projects/10131a286c71442d905d68a2cc9e8ff8` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:43.851530 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91b646f-3200-416f-b2b2-877f68a97f69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10131a286c71442d905d68a2cc9e8ff8)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:43.853475 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91b646f-3200-416f-b2b2-877f68a97f69 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:43.900130 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-d91b646f-3200-416f-b2b2-877f68a97f69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10131a286c71442d905d68a2cc9e8ff8', 'request_id': 'req-d91b646f-3200-416f-b2b2-877f68a97f69'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:43.908403 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-d91b646f-3200-416f-b2b2-877f68a97f69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10131a286c71442d905d68a2cc9e8ff8', 'request_id': 'req-d91b646f-3200-416f-b2b2-877f68a97f69'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:43.914392 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-d91b646f-3200-416f-b2b2-877f68a97f69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10131a286c71442d905d68a2cc9e8ff8', 'request_id': 'req-d91b646f-3200-416f-b2b2-877f68a97f69'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:43.926638 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-d91b646f-3200-416f-b2b2-877f68a97f69 admin admin] The token cache is being invalidate because project 10131a286c71442d905d68a2cc9e8ff8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 14:57:43.926776 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-d91b646f-3200-416f-b2b2-877f68a97f69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:43.927475 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-d91b646f-3200-416f-b2b2-877f68a97f69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:43.928919 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 961/1919] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Sep 19 14:57:43 2022] DELETE /identity/v3/projects/10131a286c71442d905d68a2cc9e8ff8 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:43.933767 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97249693-785a-4d12-84d9-ad43da1ae5b8 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:43.934046 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97249693-785a-4d12-84d9-ad43da1ae5b8 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:43.934313 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97249693-785a-4d12-84d9-ad43da1ae5b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:43.954762 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-97249693-785a-4d12-84d9-ad43da1ae5b8 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:43.955891 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-97249693-785a-4d12-84d9-ad43da1ae5b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:43.976479 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:44.062585 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 959/1920] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:57:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 14:57:44.064625 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f9fee3-a859-48c6-bfdc-606c97477b75 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:44.064912 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f9fee3-a859-48c6-bfdc-606c97477b75 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:44.065182 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f9fee3-a859-48c6-bfdc-606c97477b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:44.086690 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-a6f9fee3-a859-48c6-bfdc-606c97477b75 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:44.087885 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-a6f9fee3-a859-48c6-bfdc-606c97477b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:44.101466 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 962/1921] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:57:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:44.102986 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97249693-785a-4d12-84d9-ad43da1ae5b8 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:44.116570 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97249693-785a-4d12-84d9-ad43da1ae5b8 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:44.126784 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f622ea-eda4-4156-81a8-30c0e7769faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:44.127464 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f622ea-eda4-4156-81a8-30c0e7769faa admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:44.127749 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f622ea-eda4-4156-81a8-30c0e7769faa admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:44.128008 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f622ea-eda4-4156-81a8-30c0e7769faa admin admin] PATH_INFO: `/v3/domains` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:44.128733 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f622ea-eda4-4156-81a8-30c0e7769faa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:57:44.129031 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f622ea-eda4-4156-81a8-30c0e7769faa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:44.130680 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f622ea-eda4-4156-81a8-30c0e7769faa admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:44.152496 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 960/1922] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Sep 19 14:57:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:57:44.157451 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f9fee3-a859-48c6-bfdc-606c97477b75 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:44.173245 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f9fee3-a859-48c6-bfdc-606c97477b75 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:44.180560 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f6823d-7450-4ce6-a724-487de5966cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:44.181182 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f6823d-7450-4ce6-a724-487de5966cf6 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:44.181602 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f6823d-7450-4ce6-a724-487de5966cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:44.181875 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f6823d-7450-4ce6-a724-487de5966cf6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:44.182708 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f6823d-7450-4ce6-a724-487de5966cf6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:44.185896 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f6823d-7450-4ce6-a724-487de5966cf6 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:44.198268 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:44.219645 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 963/1923] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Sep 19 14:57:44 2022] POST /identity/v3/projects => generated 391 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:57:44.223821 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f622ea-eda4-4156-81a8-30c0e7769faa admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:44.239116 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f622ea-eda4-4156-81a8-30c0e7769faa admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:44.340046 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbda4c6-7529-4554-9b71-c852b55b56d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:44.340720 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbda4c6-7529-4554-9b71-c852b55b56d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:44.341031 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbda4c6-7529-4554-9b71-c852b55b56d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:44.341316 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbda4c6-7529-4554-9b71-c852b55b56d9 admin admin] PATH_INFO: `/v3/users` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:44.342011 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbda4c6-7529-4554-9b71-c852b55b56d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:44.344195 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbda4c6-7529-4554-9b71-c852b55b56d9 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:44.396662 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 961/1924] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Sep 19 14:57:44 2022] POST /identity/v3/users => generated 296 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 14:57:44.401286 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f6823d-7450-4ce6-a724-487de5966cf6 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:44.420050 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f6823d-7450-4ce6-a724-487de5966cf6 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:44.426065 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad516a2-b96c-4073-8393-051da3226b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:44.426677 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad516a2-b96c-4073-8393-051da3226b8f admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:44.426958 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad516a2-b96c-4073-8393-051da3226b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:44.427245 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad516a2-b96c-4073-8393-051da3226b8f admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:44.427928 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad516a2-b96c-4073-8393-051da3226b8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:44.430486 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad516a2-b96c-4073-8393-051da3226b8f admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:44.453366 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 964/1925] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:57:44 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:57:44.455012 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbda4c6-7529-4554-9b71-c852b55b56d9 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:44.471372 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbda4c6-7529-4554-9b71-c852b55b56d9 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:44.479323 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a4dda1-42e8-4403-a126-395c3b781d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:44.481860 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a4dda1-42e8-4403-a126-395c3b781d6a admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:44.482361 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a4dda1-42e8-4403-a126-395c3b781d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:44.485279 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a4dda1-42e8-4403-a126-395c3b781d6a admin admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:44.486300 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a4dda1-42e8-4403-a126-395c3b781d6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:44.491063 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a4dda1-42e8-4403-a126-395c3b781d6a admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:44.514784 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 962/1926] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:57:44 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:57:44.533181 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad516a2-b96c-4073-8393-051da3226b8f admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:44.555776 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad516a2-b96c-4073-8393-051da3226b8f admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:44.571188 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162437ce-c750-4be5-b690-73fb30aef9d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:44.574349 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162437ce-c750-4be5-b690-73fb30aef9d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:44.575880 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162437ce-c750-4be5-b690-73fb30aef9d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:44.591960 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162437ce-c750-4be5-b690-73fb30aef9d6 admin admin] PATH_INFO: `/v3/projects/18cc674891594994ad1897b3687a7960/users/2f100987ffa54edd89b8c6e8f639f130/roles/efa0e5b3413748dc828a89b12d67df79` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:44.652003 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162437ce-c750-4be5-b690-73fb30aef9d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18cc674891594994ad1897b3687a7960, user_id=2f100987ffa54edd89b8c6e8f639f130, role_id=efa0e5b3413748dc828a89b12d67df79)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:44.658937 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162437ce-c750-4be5-b690-73fb30aef9d6 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:44.684146 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 965/1927] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 14:57:44 2022] PUT /identity/v3/projects/18cc674891594994ad1897b3687a7960/users/2f100987ffa54edd89b8c6e8f639f130/roles/efa0e5b3413748dc828a89b12d67df79 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:44.701765 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6339127a-5273-4a6e-b785-0abdf0125786 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:44.702137 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6339127a-5273-4a6e-b785-0abdf0125786 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:44.702444 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6339127a-5273-4a6e-b785-0abdf0125786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:44.762232 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-6339127a-5273-4a6e-b785-0abdf0125786 None None] MFA Rules not processed for user `2f100987ffa54edd89b8c6e8f639f130`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:44.764381 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-6339127a-5273-4a6e-b785-0abdf0125786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:44.857069 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 963/1928] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:57:44 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:44.862519 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162437ce-c750-4be5-b690-73fb30aef9d6 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:44.957996 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162437ce-c750-4be5-b690-73fb30aef9d6 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:44.963285 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59c9162-ddaa-4b02-ae42-c055b3114cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:44.964046 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59c9162-ddaa-4b02-ae42-c055b3114cbe admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:44.964430 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59c9162-ddaa-4b02-ae42-c055b3114cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:44.964776 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59c9162-ddaa-4b02-ae42-c055b3114cbe admin admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:44.965487 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59c9162-ddaa-4b02-ae42-c055b3114cbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:44.967535 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59c9162-ddaa-4b02-ae42-c055b3114cbe admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:44.976913 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6339127a-5273-4a6e-b785-0abdf0125786 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:44.978551 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-6339127a-5273-4a6e-b785-0abdf0125786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:44.996412 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 966/1929] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Sep 19 14:57:44 2022] POST /identity/v3/projects => generated 391 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:57:44.996880 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6339127a-5273-4a6e-b785-0abdf0125786 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:45.000912 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59c9162-ddaa-4b02-ae42-c055b3114cbe admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:45.017198 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:45.090688 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59c9162-ddaa-4b02-ae42-c055b3114cbe admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:45.091762 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fba0218-44c2-4ae3-9a44-4ff51984a8fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:45.092554 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba0218-44c2-4ae3-9a44-4ff51984a8fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:45.092995 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba0218-44c2-4ae3-9a44-4ff51984a8fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:45.094079 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba0218-44c2-4ae3-9a44-4ff51984a8fb admin admin] PATH_INFO: `/v3/users/018aaacc64224e238604b846f3f0557c` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:45.096088 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fba0218-44c2-4ae3-9a44-4ff51984a8fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=018aaacc64224e238604b846f3f0557c)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:45.099157 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ed3f23-a7e7-4993-8633-f10dce2265f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:45.099418 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fba0218-44c2-4ae3-9a44-4ff51984a8fb admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:45.099958 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ed3f23-a7e7-4993-8633-f10dce2265f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:45.100379 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ed3f23-a7e7-4993-8633-f10dce2265f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:45.100852 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ed3f23-a7e7-4993-8633-f10dce2265f2 admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:45.101993 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ed3f23-a7e7-4993-8633-f10dce2265f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:45.104468 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ed3f23-a7e7-4993-8633-f10dce2265f2 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:45.135465 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 967/1930] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Sep 19 14:57:44 2022] POST /identity/v3/users => generated 302 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 14:57:45.139645 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ed3f23-a7e7-4993-8633-f10dce2265f2 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:45.160568 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-4fba0218-44c2-4ae3-9a44-4ff51984a8fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '018aaacc64224e238604b846f3f0557c'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:45.165890 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ed3f23-a7e7-4993-8633-f10dce2265f2 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:45.171523 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a631df2-202a-41c1-8407-8525d98d8606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:45.173026 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a631df2-202a-41c1-8407-8525d98d8606 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:45.173384 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a631df2-202a-41c1-8407-8525d98d8606 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:45.173734 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a631df2-202a-41c1-8407-8525d98d8606 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:45.175756 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a631df2-202a-41c1-8407-8525d98d8606 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:45.178653 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a631df2-202a-41c1-8407-8525d98d8606 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:45.194786 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 968/1931] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:57:45 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:57:45.198127 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-4fba0218-44c2-4ae3-9a44-4ff51984a8fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '018aaacc64224e238604b846f3f0557c'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:45.199842 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a631df2-202a-41c1-8407-8525d98d8606 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:45.211556 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-4fba0218-44c2-4ae3-9a44-4ff51984a8fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '018aaacc64224e238604b846f3f0557c'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:45.212386 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-4fba0218-44c2-4ae3-9a44-4ff51984a8fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '018aaacc64224e238604b846f3f0557c'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:45.226289 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-4fba0218-44c2-4ae3-9a44-4ff51984a8fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '018aaacc64224e238604b846f3f0557c'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:45.226605 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a631df2-202a-41c1-8407-8525d98d8606 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:45.235307 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 964/1932] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Sep 19 14:57:44 2022] DELETE /identity/v3/users/018aaacc64224e238604b846f3f0557c => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 14:57:45.239183 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cef3fb-cc87-43b0-92d0-395b2230ab75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:45.239870 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cef3fb-cc87-43b0-92d0-395b2230ab75 admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:45.240032 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c74feb-33a4-45b3-90a1-66bb9d121bfa None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:45.240490 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cef3fb-cc87-43b0-92d0-395b2230ab75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:45.240490 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cef3fb-cc87-43b0-92d0-395b2230ab75 admin admin] PATH_INFO: `/v3/projects/d303400f6ac64a80b7d6bc1a8431fee8/users/04170c204e8b4ab09c1f21b18e8d7919/roles/ddb643577b2e4e478100ec370decfaeb` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:45.240620 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c74feb-33a4-45b3-90a1-66bb9d121bfa None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:45.240907 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c74feb-33a4-45b3-90a1-66bb9d121bfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:45.258244 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cef3fb-cc87-43b0-92d0-395b2230ab75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d303400f6ac64a80b7d6bc1a8431fee8, user_id=04170c204e8b4ab09c1f21b18e8d7919, role_id=ddb643577b2e4e478100ec370decfaeb)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:45.261504 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cef3fb-cc87-43b0-92d0-395b2230ab75 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:45.265670 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:45.270275 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-d0c74feb-33a4-45b3-90a1-66bb9d121bfa None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:45.271862 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-d0c74feb-33a4-45b3-90a1-66bb9d121bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:45.286023 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 969/1933] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 14:57:45 2022] PUT /identity/v3/projects/d303400f6ac64a80b7d6bc1a8431fee8/users/04170c204e8b4ab09c1f21b18e8d7919/roles/ddb643577b2e4e478100ec370decfaeb => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:45.287324 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cef3fb-cc87-43b0-92d0-395b2230ab75 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:45.291037 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-65cef3fb-cc87-43b0-92d0-395b2230ab75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:45.365672 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 965/1934] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:57:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:45.377648 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c74feb-33a4-45b3-90a1-66bb9d121bfa None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:45.379999 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-d0c74feb-33a4-45b3-90a1-66bb9d121bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:45.397433 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cef3fb-cc87-43b0-92d0-395b2230ab75 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:45.402672 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5648adb4-042c-40ec-9790-87ccfa4eca63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:45.403301 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5648adb4-042c-40ec-9790-87ccfa4eca63 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:45.403809 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5648adb4-042c-40ec-9790-87ccfa4eca63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:45.404146 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5648adb4-042c-40ec-9790-87ccfa4eca63 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:45.404939 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5648adb4-042c-40ec-9790-87ccfa4eca63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:45.406674 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5648adb4-042c-40ec-9790-87ccfa4eca63 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:45.418631 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 970/1935] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:57:45 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:57:45.433518 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5648adb4-042c-40ec-9790-87ccfa4eca63 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:45.443992 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:45.454793 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5648adb4-042c-40ec-9790-87ccfa4eca63 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:45.461821 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d83213-a14d-47d3-a7e5-c27eefeee452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:45.462526 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d83213-a14d-47d3-a7e5-c27eefeee452 admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:45.462806 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d83213-a14d-47d3-a7e5-c27eefeee452 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:45.463089 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d83213-a14d-47d3-a7e5-c27eefeee452 admin admin] PATH_INFO: `/v3/projects/d303400f6ac64a80b7d6bc1a8431fee8/users/04170c204e8b4ab09c1f21b18e8d7919/roles/ddb643577b2e4e478100ec370decfaeb` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:45.471102 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d83213-a14d-47d3-a7e5-c27eefeee452 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d303400f6ac64a80b7d6bc1a8431fee8, user_id=04170c204e8b4ab09c1f21b18e8d7919, role_id=ddb643577b2e4e478100ec370decfaeb)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:45.474179 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c74feb-33a4-45b3-90a1-66bb9d121bfa None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:45.474324 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d83213-a14d-47d3-a7e5-c27eefeee452 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:45.479032 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d5a6b9-509d-45e3-aa81-fc30bb7a1b24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c2b78646374cb79ded4b7b59ba49c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:45.479913 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d5a6b9-509d-45e3-aa81-fc30bb7a1b24 service neutron] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:45.480891 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d5a6b9-509d-45e3-aa81-fc30bb7a1b24 service neutron] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:45.481396 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d5a6b9-509d-45e3-aa81-fc30bb7a1b24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:45.499030 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 971/1936] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 14:57:45 2022] PUT /identity/v3/projects/d303400f6ac64a80b7d6bc1a8431fee8/users/04170c204e8b4ab09c1f21b18e8d7919/roles/ddb643577b2e4e478100ec370decfaeb => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:45.500423 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d5a6b9-509d-45e3-aa81-fc30bb7a1b24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:45.500423 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d5a6b9-509d-45e3-aa81-fc30bb7a1b24 service neutron] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:45.503038 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60262cad-c570-4da2-93a4-9dd7483c7830 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:45.503701 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60262cad-c570-4da2-93a4-9dd7483c7830 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:45.503975 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60262cad-c570-4da2-93a4-9dd7483c7830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:45.524968 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 966/1937] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:57:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:57:45.548919 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-60262cad-c570-4da2-93a4-9dd7483c7830 None None] MFA Rules not processed for user `04170c204e8b4ab09c1f21b18e8d7919`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:45.553778 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-60262cad-c570-4da2-93a4-9dd7483c7830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:45.554830 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d5a6b9-509d-45e3-aa81-fc30bb7a1b24 service neutron] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:45.556292 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-d6d5a6b9-509d-45e3-aa81-fc30bb7a1b24 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:45.570923 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d5a6b9-509d-45e3-aa81-fc30bb7a1b24 service neutron] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:45.660128 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b914c5-7740-461e-ad05-db9f772b66fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:45.660946 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b914c5-7740-461e-ad05-db9f772b66fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:45.661231 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b914c5-7740-461e-ad05-db9f772b66fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:45.661505 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b914c5-7740-461e-ad05-db9f772b66fc admin admin] PATH_INFO: `/v3/users/6abade4a3a4d458e839b3dfb0ea0b452` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:45.662892 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b914c5-7740-461e-ad05-db9f772b66fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=6abade4a3a4d458e839b3dfb0ea0b452)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:45.665171 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b914c5-7740-461e-ad05-db9f772b66fc admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:45.699961 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 972/1938] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:57:45 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:45.701592 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60262cad-c570-4da2-93a4-9dd7483c7830 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:45.704321 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-60262cad-c570-4da2-93a4-9dd7483c7830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:45.751467 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-b7b914c5-7740-461e-ad05-db9f772b66fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6abade4a3a4d458e839b3dfb0ea0b452'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:45.769911 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-b7b914c5-7740-461e-ad05-db9f772b66fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6abade4a3a4d458e839b3dfb0ea0b452'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:45.778703 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-b7b914c5-7740-461e-ad05-db9f772b66fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6abade4a3a4d458e839b3dfb0ea0b452'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:45.779436 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-b7b914c5-7740-461e-ad05-db9f772b66fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6abade4a3a4d458e839b3dfb0ea0b452'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:45.789868 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-b7b914c5-7740-461e-ad05-db9f772b66fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6abade4a3a4d458e839b3dfb0ea0b452'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:45.790467 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60262cad-c570-4da2-93a4-9dd7483c7830 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:45.799328 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339d56b4-d701-4a8d-9799-129facd67e99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139dc7a4f1dc48fe8faea848bd1ac0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:45.800076 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d56b4-d701-4a8d-9799-129facd67e99 service cinder] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:45.800401 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 967/1939] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Sep 19 14:57:45 2022] DELETE /identity/v3/users/6abade4a3a4d458e839b3dfb0ea0b452 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 14:57:45.803312 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d56b4-d701-4a8d-9799-129facd67e99 service cinder] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:45.803693 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d56b4-d701-4a8d-9799-129facd67e99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:45.805663 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-339d56b4-d701-4a8d-9799-129facd67e99 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:45.805775 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb754aa7-3b57-428e-9abb-86b584c2235a None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:45.805944 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb754aa7-3b57-428e-9abb-86b584c2235a None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:45.806447 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb754aa7-3b57-428e-9abb-86b584c2235a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:45.820153 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339d56b4-d701-4a8d-9799-129facd67e99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:45.821815 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339d56b4-d701-4a8d-9799-129facd67e99 service cinder] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:45.834530 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 973/1940] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:57:45 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:57:45.844037 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-eb754aa7-3b57-428e-9abb-86b584c2235a None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:45.847409 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-eb754aa7-3b57-428e-9abb-86b584c2235a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:45.924058 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339d56b4-d701-4a8d-9799-129facd67e99 service cinder] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:45.925600 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-339d56b4-d701-4a8d-9799-129facd67e99 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:45.939064 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339d56b4-d701-4a8d-9799-129facd67e99 service cinder] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:45.944886 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:46.001693 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:46.021523 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 968/1941] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:57:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:46.028466 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abec025-10c1-4c86-be74-cf762b6f70ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139dc7a4f1dc48fe8faea848bd1ac0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:46.029248 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abec025-10c1-4c86-be74-cf762b6f70ba service cinder] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:46.029677 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abec025-10c1-4c86-be74-cf762b6f70ba service cinder] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:46.030050 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abec025-10c1-4c86-be74-cf762b6f70ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:46.032828 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-1abec025-10c1-4c86-be74-cf762b6f70ba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:46.049094 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb754aa7-3b57-428e-9abb-86b584c2235a None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:46.050930 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-eb754aa7-3b57-428e-9abb-86b584c2235a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:46.162914 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb754aa7-3b57-428e-9abb-86b584c2235a None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:46.167299 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28e63ea-f599-460c-8e71-0ada73644044 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c2b78646374cb79ded4b7b59ba49c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:46.168303 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e63ea-f599-460c-8e71-0ada73644044 service neutron] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:46.168761 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e63ea-f599-460c-8e71-0ada73644044 service neutron] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:46.169253 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e63ea-f599-460c-8e71-0ada73644044 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:46.170197 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abec025-10c1-4c86-be74-cf762b6f70ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:46.172619 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abec025-10c1-4c86-be74-cf762b6f70ba service cinder] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:46.181757 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28e63ea-f599-460c-8e71-0ada73644044 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:46.183710 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 974/1942] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:57:45 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 14:57:46.184257 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28e63ea-f599-460c-8e71-0ada73644044 service neutron] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:46.184399 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abec025-10c1-4c86-be74-cf762b6f70ba service cinder] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:46.186372 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-1abec025-10c1-4c86-be74-cf762b6f70ba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:46.200603 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 969/1943] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:57:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:57:46.204954 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abec025-10c1-4c86-be74-cf762b6f70ba service cinder] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:46.210505 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80448411-ce57-45ca-b4f4-4363be2ff326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:46.211155 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80448411-ce57-45ca-b4f4-4363be2ff326 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:46.211436 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80448411-ce57-45ca-b4f4-4363be2ff326 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:46.211774 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80448411-ce57-45ca-b4f4-4363be2ff326 admin admin] PATH_INFO: `/v3/projects/9948c2e3008d4bae81a65c08412d35bf` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:46.212956 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80448411-ce57-45ca-b4f4-4363be2ff326 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9948c2e3008d4bae81a65c08412d35bf)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:46.215738 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80448411-ce57-45ca-b4f4-4363be2ff326 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:46.341390 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-80448411-ce57-45ca-b4f4-4363be2ff326 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9948c2e3008d4bae81a65c08412d35bf', 'request_id': 'req-80448411-ce57-45ca-b4f4-4363be2ff326'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:46.355022 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-80448411-ce57-45ca-b4f4-4363be2ff326 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9948c2e3008d4bae81a65c08412d35bf', 'request_id': 'req-80448411-ce57-45ca-b4f4-4363be2ff326'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:46.366729 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-80448411-ce57-45ca-b4f4-4363be2ff326 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9948c2e3008d4bae81a65c08412d35bf', 'request_id': 'req-80448411-ce57-45ca-b4f4-4363be2ff326'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:46.393073 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-80448411-ce57-45ca-b4f4-4363be2ff326 admin admin] The token cache is being invalidate because project 9948c2e3008d4bae81a65c08412d35bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 14:57:46.393629 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-80448411-ce57-45ca-b4f4-4363be2ff326 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:46.394794 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-80448411-ce57-45ca-b4f4-4363be2ff326 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:46.398391 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 975/1944] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Sep 19 14:57:46 2022] DELETE /identity/v3/projects/9948c2e3008d4bae81a65c08412d35bf => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:46.402988 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28e63ea-f599-460c-8e71-0ada73644044 service neutron] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:46.414610 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28e63ea-f599-460c-8e71-0ada73644044 service neutron] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:46.589699 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02e027b-6a20-4932-8f30-2b4309ef0ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:46.590499 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e027b-6a20-4932-8f30-2b4309ef0ab5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:46.591347 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e027b-6a20-4932-8f30-2b4309ef0ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:46.592157 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e027b-6a20-4932-8f30-2b4309ef0ab5 admin admin] PATH_INFO: `/v3/users/22b75085af354164b4d7ab62d218277c` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:46.595267 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02e027b-6a20-4932-8f30-2b4309ef0ab5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22b75085af354164b4d7ab62d218277c)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:46.599573 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02e027b-6a20-4932-8f30-2b4309ef0ab5 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:46.740977 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-d02e027b-6a20-4932-8f30-2b4309ef0ab5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22b75085af354164b4d7ab62d218277c'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:46.768539 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-d02e027b-6a20-4932-8f30-2b4309ef0ab5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22b75085af354164b4d7ab62d218277c'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:46.789314 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-d02e027b-6a20-4932-8f30-2b4309ef0ab5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22b75085af354164b4d7ab62d218277c'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:46.790137 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-d02e027b-6a20-4932-8f30-2b4309ef0ab5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22b75085af354164b4d7ab62d218277c'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:46.799990 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-d02e027b-6a20-4932-8f30-2b4309ef0ab5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22b75085af354164b4d7ab62d218277c'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:46.810237 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 970/1945] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Sep 19 14:57:46 2022] DELETE /identity/v3/users/22b75085af354164b4d7ab62d218277c => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 14:57:47.001859 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80448411-ce57-45ca-b4f4-4363be2ff326 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:47.004089 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-80448411-ce57-45ca-b4f4-4363be2ff326 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:47.062011 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80448411-ce57-45ca-b4f4-4363be2ff326 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:47.143109 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:47.174532 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53bd39b-4b76-4e4b-b94e-1d7be4faa0a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:47.175349 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53bd39b-4b76-4e4b-b94e-1d7be4faa0a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:47.183639 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53bd39b-4b76-4e4b-b94e-1d7be4faa0a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:47.183639 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53bd39b-4b76-4e4b-b94e-1d7be4faa0a5 admin admin] PATH_INFO: `/v3/projects/a2c920d417da4391a0dc8889e5105e2e` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:47.183639 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53bd39b-4b76-4e4b-b94e-1d7be4faa0a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2c920d417da4391a0dc8889e5105e2e)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:47.183639 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53bd39b-4b76-4e4b-b94e-1d7be4faa0a5 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:47.256505 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-e53bd39b-4b76-4e4b-b94e-1d7be4faa0a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2c920d417da4391a0dc8889e5105e2e', 'request_id': 'req-e53bd39b-4b76-4e4b-b94e-1d7be4faa0a5'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:47.266927 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-e53bd39b-4b76-4e4b-b94e-1d7be4faa0a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2c920d417da4391a0dc8889e5105e2e', 'request_id': 'req-e53bd39b-4b76-4e4b-b94e-1d7be4faa0a5'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:47.273347 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-e53bd39b-4b76-4e4b-b94e-1d7be4faa0a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2c920d417da4391a0dc8889e5105e2e', 'request_id': 'req-e53bd39b-4b76-4e4b-b94e-1d7be4faa0a5'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:47.288780 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-e53bd39b-4b76-4e4b-b94e-1d7be4faa0a5 admin admin] The token cache is being invalidate because project a2c920d417da4391a0dc8889e5105e2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 14:57:47.289070 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-e53bd39b-4b76-4e4b-b94e-1d7be4faa0a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:47.289739 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-e53bd39b-4b76-4e4b-b94e-1d7be4faa0a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:47.291250 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 976/1946] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Sep 19 14:57:46 2022] DELETE /identity/v3/projects/a2c920d417da4391a0dc8889e5105e2e => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:47.295280 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02e027b-6a20-4932-8f30-2b4309ef0ab5 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:47.297271 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-d02e027b-6a20-4932-8f30-2b4309ef0ab5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:47.309817 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02e027b-6a20-4932-8f30-2b4309ef0ab5 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:47.332218 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:47.362491 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53bd39b-4b76-4e4b-b94e-1d7be4faa0a5 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:47.363927 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-e53bd39b-4b76-4e4b-b94e-1d7be4faa0a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:47.389058 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5bce7c-b718-40c6-ab0b-0a71fcc5788d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:47.389794 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5bce7c-b718-40c6-ab0b-0a71fcc5788d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:47.390114 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5bce7c-b718-40c6-ab0b-0a71fcc5788d admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:47.390430 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5bce7c-b718-40c6-ab0b-0a71fcc5788d admin admin] PATH_INFO: `/v3/users/39613d80cc5e44caab7c96b63a232a7a` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:47.391586 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5bce7c-b718-40c6-ab0b-0a71fcc5788d admin admin] RBAC: Authorizing `identity:delete_user(user_id=39613d80cc5e44caab7c96b63a232a7a)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:47.393895 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5bce7c-b718-40c6-ab0b-0a71fcc5788d admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:47.443862 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-3f5bce7c-b718-40c6-ab0b-0a71fcc5788d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39613d80cc5e44caab7c96b63a232a7a'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:47.449074 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53bd39b-4b76-4e4b-b94e-1d7be4faa0a5 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:47.454096 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c8511c-a665-4e42-9cfb-4234ad881e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:47.454808 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c8511c-a665-4e42-9cfb-4234ad881e20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:47.455092 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c8511c-a665-4e42-9cfb-4234ad881e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:47.455367 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c8511c-a665-4e42-9cfb-4234ad881e20 admin admin] PATH_INFO: `/v3/projects/218b835447c64695ad431a27326dfdbf` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:47.456698 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c8511c-a665-4e42-9cfb-4234ad881e20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=218b835447c64695ad431a27326dfdbf)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:47.457730 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-3f5bce7c-b718-40c6-ab0b-0a71fcc5788d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39613d80cc5e44caab7c96b63a232a7a'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:47.458677 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c8511c-a665-4e42-9cfb-4234ad881e20 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:47.464889 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-3f5bce7c-b718-40c6-ab0b-0a71fcc5788d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39613d80cc5e44caab7c96b63a232a7a'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:47.465576 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-3f5bce7c-b718-40c6-ab0b-0a71fcc5788d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39613d80cc5e44caab7c96b63a232a7a'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:47.474427 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-3f5bce7c-b718-40c6-ab0b-0a71fcc5788d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39613d80cc5e44caab7c96b63a232a7a'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:47.481230 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 971/1947] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Sep 19 14:57:47 2022] DELETE /identity/v3/users/39613d80cc5e44caab7c96b63a232a7a => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:47.508869 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-49c8511c-a665-4e42-9cfb-4234ad881e20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '218b835447c64695ad431a27326dfdbf', 'request_id': 'req-49c8511c-a665-4e42-9cfb-4234ad881e20'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:47.517114 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-49c8511c-a665-4e42-9cfb-4234ad881e20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '218b835447c64695ad431a27326dfdbf', 'request_id': 'req-49c8511c-a665-4e42-9cfb-4234ad881e20'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:47.523622 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-49c8511c-a665-4e42-9cfb-4234ad881e20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '218b835447c64695ad431a27326dfdbf', 'request_id': 'req-49c8511c-a665-4e42-9cfb-4234ad881e20'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:47.536296 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-49c8511c-a665-4e42-9cfb-4234ad881e20 admin admin] The token cache is being invalidate because project 218b835447c64695ad431a27326dfdbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 14:57:47.536656 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-49c8511c-a665-4e42-9cfb-4234ad881e20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:47.537442 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-49c8511c-a665-4e42-9cfb-4234ad881e20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:47.539260 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 977/1948] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Sep 19 14:57:47 2022] DELETE /identity/v3/projects/218b835447c64695ad431a27326dfdbf => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 14:57:47.543470 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5bce7c-b718-40c6-ab0b-0a71fcc5788d admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:47.545005 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-3f5bce7c-b718-40c6-ab0b-0a71fcc5788d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:47.626596 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5bce7c-b718-40c6-ab0b-0a71fcc5788d admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:47.677108 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:47.692123 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e232ca3-6a32-4e60-afee-5c2657851783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:47.692868 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e232ca3-6a32-4e60-afee-5c2657851783 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:47.693148 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e232ca3-6a32-4e60-afee-5c2657851783 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:47.693417 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e232ca3-6a32-4e60-afee-5c2657851783 admin admin] PATH_INFO: `/v3/users/a5d8dd21def44e9799b9afa5c6d51a6f` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:47.694822 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e232ca3-6a32-4e60-afee-5c2657851783 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5d8dd21def44e9799b9afa5c6d51a6f)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:47.696845 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e232ca3-6a32-4e60-afee-5c2657851783 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:47.748192 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-0e232ca3-6a32-4e60-afee-5c2657851783 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5d8dd21def44e9799b9afa5c6d51a6f'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:47.764443 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c8511c-a665-4e42-9cfb-4234ad881e20 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:47.765962 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-0e232ca3-6a32-4e60-afee-5c2657851783 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5d8dd21def44e9799b9afa5c6d51a6f'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:47.767236 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-49c8511c-a665-4e42-9cfb-4234ad881e20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:47.777520 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-0e232ca3-6a32-4e60-afee-5c2657851783 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5d8dd21def44e9799b9afa5c6d51a6f'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:47.778517 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-0e232ca3-6a32-4e60-afee-5c2657851783 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5d8dd21def44e9799b9afa5c6d51a6f'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:47.788292 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:47.789251 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-0e232ca3-6a32-4e60-afee-5c2657851783 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5d8dd21def44e9799b9afa5c6d51a6f'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:47.793840 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c8511c-a665-4e42-9cfb-4234ad881e20 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:47.796978 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 972/1949] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Sep 19 14:57:47 2022] DELETE /identity/v3/users/a5d8dd21def44e9799b9afa5c6d51a6f => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 14:57:47.803464 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21313361-8d09-4c35-9f4f-128e8f336962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:47.804137 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21313361-8d09-4c35-9f4f-128e8f336962 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:47.804432 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21313361-8d09-4c35-9f4f-128e8f336962 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:47.804708 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21313361-8d09-4c35-9f4f-128e8f336962 admin admin] PATH_INFO: `/v3/projects/5f8ab33a96cf4c178722ee0f062c3523` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:47.805845 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21313361-8d09-4c35-9f4f-128e8f336962 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f8ab33a96cf4c178722ee0f062c3523)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:47.807949 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21313361-8d09-4c35-9f4f-128e8f336962 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:47.874223 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-21313361-8d09-4c35-9f4f-128e8f336962 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f8ab33a96cf4c178722ee0f062c3523', 'request_id': 'req-21313361-8d09-4c35-9f4f-128e8f336962'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:47.882735 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-21313361-8d09-4c35-9f4f-128e8f336962 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f8ab33a96cf4c178722ee0f062c3523', 'request_id': 'req-21313361-8d09-4c35-9f4f-128e8f336962'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:47.889542 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-21313361-8d09-4c35-9f4f-128e8f336962 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f8ab33a96cf4c178722ee0f062c3523', 'request_id': 'req-21313361-8d09-4c35-9f4f-128e8f336962'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:47.902481 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-21313361-8d09-4c35-9f4f-128e8f336962 admin admin] The token cache is being invalidate because project 5f8ab33a96cf4c178722ee0f062c3523 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 14:57:47.902785 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-21313361-8d09-4c35-9f4f-128e8f336962 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:47.903873 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-21313361-8d09-4c35-9f4f-128e8f336962 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:47.908433 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 978/1950] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Sep 19 14:57:47 2022] DELETE /identity/v3/projects/5f8ab33a96cf4c178722ee0f062c3523 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 14:57:47.911712 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92271162-b307-4d43-b819-fdbd036752b4 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:47.912028 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92271162-b307-4d43-b819-fdbd036752b4 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:47.912309 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92271162-b307-4d43-b819-fdbd036752b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:47.933664 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-92271162-b307-4d43-b819-fdbd036752b4 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:47.935441 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-92271162-b307-4d43-b819-fdbd036752b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:48.113238 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 973/1951] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:57:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:48.122347 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19579812-0ccd-4438-916c-9acd1802bfd9 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:48.122847 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19579812-0ccd-4438-916c-9acd1802bfd9 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:48.122925 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19579812-0ccd-4438-916c-9acd1802bfd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:48.135741 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92271162-b307-4d43-b819-fdbd036752b4 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:48.137292 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-92271162-b307-4d43-b819-fdbd036752b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:48.156553 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92271162-b307-4d43-b819-fdbd036752b4 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:48.159782 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-19579812-0ccd-4438-916c-9acd1802bfd9 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:48.161350 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-19579812-0ccd-4438-916c-9acd1802bfd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:48.162065 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eea1091-5a1a-4a89-8307-375c07fe4dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:48.162907 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eea1091-5a1a-4a89-8307-375c07fe4dd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:48.163283 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eea1091-5a1a-4a89-8307-375c07fe4dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:48.163673 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eea1091-5a1a-4a89-8307-375c07fe4dd3 admin admin] PATH_INFO: `/v3/users/81112735676f477280bc3f5c25b3c8f7` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:48.165367 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eea1091-5a1a-4a89-8307-375c07fe4dd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81112735676f477280bc3f5c25b3c8f7)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:48.169470 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eea1091-5a1a-4a89-8307-375c07fe4dd3 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:48.185970 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 979/1952] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:57:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:48.186418 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19579812-0ccd-4438-916c-9acd1802bfd9 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:48.213152 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19579812-0ccd-4438-916c-9acd1802bfd9 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:48.220254 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4007fc0a-2b24-4a26-a9f2-7267915897e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:48.221200 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4007fc0a-2b24-4a26-a9f2-7267915897e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:48.221682 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4007fc0a-2b24-4a26-a9f2-7267915897e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:48.222743 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4007fc0a-2b24-4a26-a9f2-7267915897e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:48.223666 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4007fc0a-2b24-4a26-a9f2-7267915897e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:57:48.224644 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4007fc0a-2b24-4a26-a9f2-7267915897e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:48.228302 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4007fc0a-2b24-4a26-a9f2-7267915897e3 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:48.251191 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 980/1953] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Sep 19 14:57:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:57:48.252297 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4007fc0a-2b24-4a26-a9f2-7267915897e3 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:48.254484 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-4007fc0a-2b24-4a26-a9f2-7267915897e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:48.288395 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-4eea1091-5a1a-4a89-8307-375c07fe4dd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81112735676f477280bc3f5c25b3c8f7'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:48.291463 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4007fc0a-2b24-4a26-a9f2-7267915897e3 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:48.298410 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df072f5-30c7-4690-9c19-858778904673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:48.299421 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df072f5-30c7-4690-9c19-858778904673 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:48.299910 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df072f5-30c7-4690-9c19-858778904673 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:48.300369 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df072f5-30c7-4690-9c19-858778904673 admin admin] PATH_INFO: `/v3/projects/80f7ee330d5b43d5998856e607a1d3c2` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:48.301904 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df072f5-30c7-4690-9c19-858778904673 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80f7ee330d5b43d5998856e607a1d3c2)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:48.303406 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:48.304849 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df072f5-30c7-4690-9c19-858778904673 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:48.305638 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-4eea1091-5a1a-4a89-8307-375c07fe4dd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81112735676f477280bc3f5c25b3c8f7'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:48.321634 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-4eea1091-5a1a-4a89-8307-375c07fe4dd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81112735676f477280bc3f5c25b3c8f7'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:48.322655 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-4eea1091-5a1a-4a89-8307-375c07fe4dd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81112735676f477280bc3f5c25b3c8f7'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:48.335231 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-4eea1091-5a1a-4a89-8307-375c07fe4dd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81112735676f477280bc3f5c25b3c8f7'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:48.344543 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 974/1954] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Sep 19 14:57:48 2022] DELETE /identity/v3/users/81112735676f477280bc3f5c25b3c8f7 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 14:57:48.345820 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eea1091-5a1a-4a89-8307-375c07fe4dd3 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:48.348682 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-4eea1091-5a1a-4a89-8307-375c07fe4dd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:48.398871 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-8df072f5-30c7-4690-9c19-858778904673 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80f7ee330d5b43d5998856e607a1d3c2', 'request_id': 'req-8df072f5-30c7-4690-9c19-858778904673'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:48.411986 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-8df072f5-30c7-4690-9c19-858778904673 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80f7ee330d5b43d5998856e607a1d3c2', 'request_id': 'req-8df072f5-30c7-4690-9c19-858778904673'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:48.426894 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-8df072f5-30c7-4690-9c19-858778904673 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80f7ee330d5b43d5998856e607a1d3c2', 'request_id': 'req-8df072f5-30c7-4690-9c19-858778904673'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:48.452283 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-8df072f5-30c7-4690-9c19-858778904673 admin admin] The token cache is being invalidate because project 80f7ee330d5b43d5998856e607a1d3c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 14:57:48.453310 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-8df072f5-30c7-4690-9c19-858778904673 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:48.456293 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-8df072f5-30c7-4690-9c19-858778904673 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:48.459929 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 981/1955] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Sep 19 14:57:48 2022] DELETE /identity/v3/projects/80f7ee330d5b43d5998856e607a1d3c2 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:48.461186 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187d37bb-232e-4c8a-b35a-34b9d45fdfe6 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:48.461887 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187d37bb-232e-4c8a-b35a-34b9d45fdfe6 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:48.461887 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187d37bb-232e-4c8a-b35a-34b9d45fdfe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:48.464193 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eea1091-5a1a-4a89-8307-375c07fe4dd3 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:48.521536 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-187d37bb-232e-4c8a-b35a-34b9d45fdfe6 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:48.522735 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-187d37bb-232e-4c8a-b35a-34b9d45fdfe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:48.553468 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3abe86-3516-4d68-8078-10db635b98d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:48.554089 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3abe86-3516-4d68-8078-10db635b98d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:48.554379 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3abe86-3516-4d68-8078-10db635b98d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:48.554644 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3abe86-3516-4d68-8078-10db635b98d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:48.555280 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3abe86-3516-4d68-8078-10db635b98d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:48.557631 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3abe86-3516-4d68-8078-10db635b98d4 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:48.610732 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 975/1956] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Sep 19 14:57:48 2022] POST /identity/v3/projects => generated 371 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:57:48.613577 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077bf820-1be5-4b57-8fae-aa183ca64e72 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:48.613873 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077bf820-1be5-4b57-8fae-aa183ca64e72 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:48.614147 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077bf820-1be5-4b57-8fae-aa183ca64e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:48.619462 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:48.643615 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-077bf820-1be5-4b57-8fae-aa183ca64e72 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:48.644869 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-077bf820-1be5-4b57-8fae-aa183ca64e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:48.663011 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 982/1957] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:57:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:48.665352 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187d37bb-232e-4c8a-b35a-34b9d45fdfe6 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:48.677215 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-187d37bb-232e-4c8a-b35a-34b9d45fdfe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:48.702156 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187d37bb-232e-4c8a-b35a-34b9d45fdfe6 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:48.747376 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 976/1958] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:57:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:48.748567 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077bf820-1be5-4b57-8fae-aa183ca64e72 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:48.750630 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-077bf820-1be5-4b57-8fae-aa183ca64e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:48.779281 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:48.824978 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69703c6a-d527-4a26-92f0-7f932dd96bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:48.825853 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69703c6a-d527-4a26-92f0-7f932dd96bc7 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:48.826411 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69703c6a-d527-4a26-92f0-7f932dd96bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:48.826911 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69703c6a-d527-4a26-92f0-7f932dd96bc7 admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:48.828556 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69703c6a-d527-4a26-92f0-7f932dd96bc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:48.831076 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69703c6a-d527-4a26-92f0-7f932dd96bc7 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:48.850786 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077bf820-1be5-4b57-8fae-aa183ca64e72 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:48.858977 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691536ac-a6ed-46c2-9e7c-827c43834db8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c2b78646374cb79ded4b7b59ba49c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:48.859608 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691536ac-a6ed-46c2-9e7c-827c43834db8 service neutron] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:48.859894 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691536ac-a6ed-46c2-9e7c-827c43834db8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:48.860145 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691536ac-a6ed-46c2-9e7c-827c43834db8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:48.860735 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 983/1959] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Sep 19 14:57:48 2022] POST /identity/v3/users => generated 286 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:57:48.862908 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b38716d-d440-4dfc-a177-af36846a8f85 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:48.863384 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b38716d-d440-4dfc-a177-af36846a8f85 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:48.863867 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b38716d-d440-4dfc-a177-af36846a8f85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:48.887412 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691536ac-a6ed-46c2-9e7c-827c43834db8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:48.889118 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691536ac-a6ed-46c2-9e7c-827c43834db8 service neutron] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:48.892843 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-1b38716d-d440-4dfc-a177-af36846a8f85 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:48.894145 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-1b38716d-d440-4dfc-a177-af36846a8f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:48.913936 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 977/1960] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:57:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:57:48.916084 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 984/1961] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:57:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:48.917296 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b38716d-d440-4dfc-a177-af36846a8f85 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:48.918640 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691536ac-a6ed-46c2-9e7c-827c43834db8 service neutron] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:48.933071 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b38716d-d440-4dfc-a177-af36846a8f85 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:48.940748 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc5992a-cb2b-4ef1-bfc8-c28d89db7696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:48.940932 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691536ac-a6ed-46c2-9e7c-827c43834db8 service neutron] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:48.941576 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc5992a-cb2b-4ef1-bfc8-c28d89db7696 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:48.942041 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc5992a-cb2b-4ef1-bfc8-c28d89db7696 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:48.942322 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc5992a-cb2b-4ef1-bfc8-c28d89db7696 admin admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:48.943446 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc5992a-cb2b-4ef1-bfc8-c28d89db7696 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:57:48.944236 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc5992a-cb2b-4ef1-bfc8-c28d89db7696 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:48.946938 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc5992a-cb2b-4ef1-bfc8-c28d89db7696 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:48.952214 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c511e8c-2360-440e-b074-3d392cac68ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:48.953745 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c511e8c-2360-440e-b074-3d392cac68ca admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:48.954029 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c511e8c-2360-440e-b074-3d392cac68ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:48.954302 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c511e8c-2360-440e-b074-3d392cac68ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:48.954950 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c511e8c-2360-440e-b074-3d392cac68ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:48.957276 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c511e8c-2360-440e-b074-3d392cac68ca admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:48.969282 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 978/1962] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:57:48 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:57:48.973876 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c511e8c-2360-440e-b074-3d392cac68ca admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:48.991144 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 985/1963] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Sep 19 14:57:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:57:48.997364 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc5992a-cb2b-4ef1-bfc8-c28d89db7696 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:48.998245 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c511e8c-2360-440e-b074-3d392cac68ca admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:49.005196 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcbf540-3383-42f1-b953-88c2ed4e14bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:49.006194 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcbf540-3383-42f1-b953-88c2ed4e14bb admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:49.006480 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcbf540-3383-42f1-b953-88c2ed4e14bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:49.006756 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcbf540-3383-42f1-b953-88c2ed4e14bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:49.007518 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcbf540-3383-42f1-b953-88c2ed4e14bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:49.009367 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcbf540-3383-42f1-b953-88c2ed4e14bb admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:49.022533 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc5992a-cb2b-4ef1-bfc8-c28d89db7696 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:49.025119 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 979/1964] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:57:48 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:57:49.029247 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcbf540-3383-42f1-b953-88c2ed4e14bb admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:49.041516 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcbf540-3383-42f1-b953-88c2ed4e14bb admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:49.043312 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc5b485-1a9a-464e-be13-0f56e8106a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:49.044472 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc5b485-1a9a-464e-be13-0f56e8106a6e admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:49.044831 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc5b485-1a9a-464e-be13-0f56e8106a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:49.045117 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc5b485-1a9a-464e-be13-0f56e8106a6e admin admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:49.046189 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc5b485-1a9a-464e-be13-0f56e8106a6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:49.049326 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693df36c-5d19-4a77-bb88-820b5285802e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:49.049492 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc5b485-1a9a-464e-be13-0f56e8106a6e admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:49.050508 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693df36c-5d19-4a77-bb88-820b5285802e admin admin] REQUEST_METHOD: `PUT` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:49.051002 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693df36c-5d19-4a77-bb88-820b5285802e admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:49.051542 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693df36c-5d19-4a77-bb88-820b5285802e admin admin] PATH_INFO: `/v3/projects/61ccb9e83fc24e25981eef71f5991db3/users/57fbe36bca234ea485749b218935cf0f/roles/efa0e5b3413748dc828a89b12d67df79` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:49.077791 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693df36c-5d19-4a77-bb88-820b5285802e admin admin] RBAC: Authorizing `identity:create_grant(project_id=61ccb9e83fc24e25981eef71f5991db3, user_id=57fbe36bca234ea485749b218935cf0f, role_id=efa0e5b3413748dc828a89b12d67df79)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:49.082548 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693df36c-5d19-4a77-bb88-820b5285802e admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:49.107822 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 980/1965] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 14:57:49 2022] PUT /identity/v3/projects/61ccb9e83fc24e25981eef71f5991db3/users/57fbe36bca234ea485749b218935cf0f/roles/efa0e5b3413748dc828a89b12d67df79 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 14:57:49.116404 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 986/1966] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Sep 19 14:57:48 2022] POST /identity/v3/projects => generated 381 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:57:49.119515 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc5b485-1a9a-464e-be13-0f56e8106a6e admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:49.119821 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f9e8fe-0aff-43d0-ba4d-e858854a83df None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:49.120112 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f9e8fe-0aff-43d0-ba4d-e858854a83df None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:49.120415 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f9e8fe-0aff-43d0-ba4d-e858854a83df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:49.181934 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-99f9e8fe-0aff-43d0-ba4d-e858854a83df None None] MFA Rules not processed for user `57fbe36bca234ea485749b218935cf0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:49.184452 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-99f9e8fe-0aff-43d0-ba4d-e858854a83df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:49.251043 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc5b485-1a9a-464e-be13-0f56e8106a6e admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:49.261548 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb460c7-e39b-44e0-a5f9-db26403f8e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:49.262250 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb460c7-e39b-44e0-a5f9-db26403f8e88 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:49.262602 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb460c7-e39b-44e0-a5f9-db26403f8e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:49.262991 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb460c7-e39b-44e0-a5f9-db26403f8e88 admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:49.263697 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb460c7-e39b-44e0-a5f9-db26403f8e88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:49.265928 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb460c7-e39b-44e0-a5f9-db26403f8e88 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:49.295227 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 987/1967] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Sep 19 14:57:49 2022] POST /identity/v3/users => generated 291 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:57:49.296089 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb460c7-e39b-44e0-a5f9-db26403f8e88 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:49.307930 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb460c7-e39b-44e0-a5f9-db26403f8e88 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:49.314741 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fc1064-d893-4c52-a1be-99d88f2b6c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:49.315371 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fc1064-d893-4c52-a1be-99d88f2b6c9b admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:49.315661 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fc1064-d893-4c52-a1be-99d88f2b6c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:49.315934 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fc1064-d893-4c52-a1be-99d88f2b6c9b admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:49.316615 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fc1064-d893-4c52-a1be-99d88f2b6c9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:49.318868 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fc1064-d893-4c52-a1be-99d88f2b6c9b admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:49.321366 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 981/1968] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:57:49 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:49.330252 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f9e8fe-0aff-43d0-ba4d-e858854a83df None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:49.332519 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-99f9e8fe-0aff-43d0-ba4d-e858854a83df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:49.345371 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 988/1969] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:57:49 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:57:49.347003 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fc1064-d893-4c52-a1be-99d88f2b6c9b admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:49.379293 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fc1064-d893-4c52-a1be-99d88f2b6c9b admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:49.389373 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320f6e29-e418-4b19-9364-e54e72e3c9e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:49.390523 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320f6e29-e418-4b19-9364-e54e72e3c9e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:49.390816 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320f6e29-e418-4b19-9364-e54e72e3c9e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:49.391088 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320f6e29-e418-4b19-9364-e54e72e3c9e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:49.391744 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320f6e29-e418-4b19-9364-e54e72e3c9e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:49.393383 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320f6e29-e418-4b19-9364-e54e72e3c9e9 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:49.440870 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 989/1970] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:57:49 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:57:49.444156 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320f6e29-e418-4b19-9364-e54e72e3c9e9 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:49.467253 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320f6e29-e418-4b19-9364-e54e72e3c9e9 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:49.476866 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:49.481430 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2af342-fe3e-4bef-90fd-a0b1a70b88a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:49.482089 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2af342-fe3e-4bef-90fd-a0b1a70b88a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:49.482557 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2af342-fe3e-4bef-90fd-a0b1a70b88a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:49.482921 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2af342-fe3e-4bef-90fd-a0b1a70b88a0 admin admin] PATH_INFO: `/v3/projects/49ed68264f4c4dd19ff837c4336c1ce4/users/244338f29b284421bef622fee067a1c3/roles/efa0e5b3413748dc828a89b12d67df79` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:49.487030 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:49.495282 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f9e8fe-0aff-43d0-ba4d-e858854a83df None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:49.499233 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa9feb9-cf31-4e54-9d98-0fb4205382af service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d6d4ecf8f4849939d6510a6228b29dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:49.500042 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa9feb9-cf31-4e54-9d98-0fb4205382af service glance] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:49.500469 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa9feb9-cf31-4e54-9d98-0fb4205382af service glance] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:49.500668 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa9feb9-cf31-4e54-9d98-0fb4205382af service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:49.510455 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2af342-fe3e-4bef-90fd-a0b1a70b88a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49ed68264f4c4dd19ff837c4336c1ce4, user_id=244338f29b284421bef622fee067a1c3, role_id=efa0e5b3413748dc828a89b12d67df79)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:49.515856 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2af342-fe3e-4bef-90fd-a0b1a70b88a0 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:49.517977 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa9feb9-cf31-4e54-9d98-0fb4205382af service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:49.519815 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa9feb9-cf31-4e54-9d98-0fb4205382af service glance] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:49.531463 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 982/1971] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:57:49 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 14:57:49.534378 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 990/1972] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 14:57:49 2022] PUT /identity/v3/projects/49ed68264f4c4dd19ff837c4336c1ce4/users/244338f29b284421bef622fee067a1c3/roles/efa0e5b3413748dc828a89b12d67df79 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:49.547318 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5567f571-68c8-40d7-86ef-8ad67fa448a1 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:49.548073 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5567f571-68c8-40d7-86ef-8ad67fa448a1 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:49.548588 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5567f571-68c8-40d7-86ef-8ad67fa448a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:49.591135 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-5567f571-68c8-40d7-86ef-8ad67fa448a1 None None] MFA Rules not processed for user `244338f29b284421bef622fee067a1c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:49.592613 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-5567f571-68c8-40d7-86ef-8ad67fa448a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:49.697970 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 983/1973] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:57:49 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:49.699479 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2af342-fe3e-4bef-90fd-a0b1a70b88a0 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:49.768130 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5567f571-68c8-40d7-86ef-8ad67fa448a1 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:49.771907 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-5567f571-68c8-40d7-86ef-8ad67fa448a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:49.818861 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2af342-fe3e-4bef-90fd-a0b1a70b88a0 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:49.830995 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b55241-d909-4041-a34e-5c6ed726fb0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:49.831542 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b55241-d909-4041-a34e-5c6ed726fb0f admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:49.831823 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b55241-d909-4041-a34e-5c6ed726fb0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:49.832101 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b55241-d909-4041-a34e-5c6ed726fb0f admin admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:49.833172 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b55241-d909-4041-a34e-5c6ed726fb0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:49.835028 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b55241-d909-4041-a34e-5c6ed726fb0f admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:49.899810 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 991/1974] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Sep 19 14:57:49 2022] POST /identity/v3/projects => generated 379 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:57:49.901428 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b55241-d909-4041-a34e-5c6ed726fb0f admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:49.934052 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5567f571-68c8-40d7-86ef-8ad67fa448a1 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:50.008565 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af83f832-3211-4feb-a48c-5853ae9e3365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:50.009700 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af83f832-3211-4feb-a48c-5853ae9e3365 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:50.010450 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af83f832-3211-4feb-a48c-5853ae9e3365 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:50.010729 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af83f832-3211-4feb-a48c-5853ae9e3365 admin admin] PATH_INFO: `/v3/projects/b670cd40bdf24e478beeffaa5b07242d` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:50.012507 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af83f832-3211-4feb-a48c-5853ae9e3365 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b670cd40bdf24e478beeffaa5b07242d)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:50.015570 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af83f832-3211-4feb-a48c-5853ae9e3365 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:50.043913 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b55241-d909-4041-a34e-5c6ed726fb0f admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:50.051995 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7720a637-4ca0-489c-bf59-753180afeb84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:50.053753 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:50.063524 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7720a637-4ca0-489c-bf59-753180afeb84 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:50.063933 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7720a637-4ca0-489c-bf59-753180afeb84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:50.064211 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7720a637-4ca0-489c-bf59-753180afeb84 admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:50.065007 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7720a637-4ca0-489c-bf59-753180afeb84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:50.066988 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7720a637-4ca0-489c-bf59-753180afeb84 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:50.099313 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 992/1975] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Sep 19 14:57:49 2022] POST /identity/v3/users => generated 296 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 14:57:50.102330 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-af83f832-3211-4feb-a48c-5853ae9e3365 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b670cd40bdf24e478beeffaa5b07242d', 'request_id': 'req-af83f832-3211-4feb-a48c-5853ae9e3365'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:50.104990 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7720a637-4ca0-489c-bf59-753180afeb84 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:50.119227 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7720a637-4ca0-489c-bf59-753180afeb84 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:50.120112 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-af83f832-3211-4feb-a48c-5853ae9e3365 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b670cd40bdf24e478beeffaa5b07242d', 'request_id': 'req-af83f832-3211-4feb-a48c-5853ae9e3365'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:50.132806 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-af83f832-3211-4feb-a48c-5853ae9e3365 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b670cd40bdf24e478beeffaa5b07242d', 'request_id': 'req-af83f832-3211-4feb-a48c-5853ae9e3365'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:50.160162 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-af83f832-3211-4feb-a48c-5853ae9e3365 admin admin] The token cache is being invalidate because project b670cd40bdf24e478beeffaa5b07242d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 14:57:50.160917 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-af83f832-3211-4feb-a48c-5853ae9e3365 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:50.163864 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-af83f832-3211-4feb-a48c-5853ae9e3365 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:50.170979 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 984/1976] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Sep 19 14:57:49 2022] DELETE /identity/v3/projects/b670cd40bdf24e478beeffaa5b07242d => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:50.173034 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af83f832-3211-4feb-a48c-5853ae9e3365 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:50.177533 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-af83f832-3211-4feb-a48c-5853ae9e3365 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:50.222332 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:50.241069 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eae20c1-7b5a-4a3e-a52e-fa382711fa33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:50.241820 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eae20c1-7b5a-4a3e-a52e-fa382711fa33 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:50.242204 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eae20c1-7b5a-4a3e-a52e-fa382711fa33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:50.242580 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eae20c1-7b5a-4a3e-a52e-fa382711fa33 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:50.243338 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eae20c1-7b5a-4a3e-a52e-fa382711fa33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:50.246008 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eae20c1-7b5a-4a3e-a52e-fa382711fa33 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:50.274776 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 993/1977] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:57:50 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:57:50.293029 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eae20c1-7b5a-4a3e-a52e-fa382711fa33 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:50.302170 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-1eae20c1-7b5a-4a3e-a52e-fa382711fa33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:50.333017 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eae20c1-7b5a-4a3e-a52e-fa382711fa33 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:50.349375 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5c9d86-64f0-4400-8fde-6b149c50821a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:50.350158 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c9d86-64f0-4400-8fde-6b149c50821a admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:50.350649 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c9d86-64f0-4400-8fde-6b149c50821a admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:50.350931 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c9d86-64f0-4400-8fde-6b149c50821a admin admin] PATH_INFO: `/v3/projects/924be0ee37524c69bb0c32bd02fcd799/users/c3013f2fee1f4a20bbf4f55a52dd84e6/roles/ddb643577b2e4e478100ec370decfaeb` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:50.366752 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af83f832-3211-4feb-a48c-5853ae9e3365 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:50.385240 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5c9d86-64f0-4400-8fde-6b149c50821a admin admin] RBAC: Authorizing `identity:create_grant(project_id=924be0ee37524c69bb0c32bd02fcd799, user_id=c3013f2fee1f4a20bbf4f55a52dd84e6, role_id=ddb643577b2e4e478100ec370decfaeb)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:50.385610 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59804b3d-3ece-4aa1-84bd-0edc13c88fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:50.385988 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59804b3d-3ece-4aa1-84bd-0edc13c88fe8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:50.386277 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59804b3d-3ece-4aa1-84bd-0edc13c88fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:50.387633 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59804b3d-3ece-4aa1-84bd-0edc13c88fe8 admin admin] PATH_INFO: `/v3/users/6a662817aca44904b1e7f0c5cc8f9d79` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:50.388627 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5c9d86-64f0-4400-8fde-6b149c50821a admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:50.402122 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59804b3d-3ece-4aa1-84bd-0edc13c88fe8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a662817aca44904b1e7f0c5cc8f9d79)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:50.404703 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 994/1978] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 14:57:50 2022] PUT /identity/v3/projects/924be0ee37524c69bb0c32bd02fcd799/users/c3013f2fee1f4a20bbf4f55a52dd84e6/roles/ddb643577b2e4e478100ec370decfaeb => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:50.411118 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5c9d86-64f0-4400-8fde-6b149c50821a admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:50.413891 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59804b3d-3ece-4aa1-84bd-0edc13c88fe8 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:50.492353 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-59804b3d-3ece-4aa1-84bd-0edc13c88fe8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a662817aca44904b1e7f0c5cc8f9d79'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:50.510116 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-59804b3d-3ece-4aa1-84bd-0edc13c88fe8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a662817aca44904b1e7f0c5cc8f9d79'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:50.515855 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5c9d86-64f0-4400-8fde-6b149c50821a admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:50.521702 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-59804b3d-3ece-4aa1-84bd-0edc13c88fe8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a662817aca44904b1e7f0c5cc8f9d79'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:50.522569 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-59804b3d-3ece-4aa1-84bd-0edc13c88fe8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a662817aca44904b1e7f0c5cc8f9d79'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:50.524643 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eb7321-f906-4c20-a6ac-8af0ee6082cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:50.534229 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-59804b3d-3ece-4aa1-84bd-0edc13c88fe8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a662817aca44904b1e7f0c5cc8f9d79'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:50.536160 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb7321-f906-4c20-a6ac-8af0ee6082cb admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:50.536812 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb7321-f906-4c20-a6ac-8af0ee6082cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:50.537928 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb7321-f906-4c20-a6ac-8af0ee6082cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:50.538942 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eb7321-f906-4c20-a6ac-8af0ee6082cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:50.543471 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eb7321-f906-4c20-a6ac-8af0ee6082cb admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:50.564407 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 995/1979] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:57:50 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:57:50.569798 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eb7321-f906-4c20-a6ac-8af0ee6082cb admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:50.572037 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-b6eb7321-f906-4c20-a6ac-8af0ee6082cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:50.578594 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 985/1980] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Sep 19 14:57:50 2022] DELETE /identity/v3/users/6a662817aca44904b1e7f0c5cc8f9d79 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:50.589761 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eb7321-f906-4c20-a6ac-8af0ee6082cb admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:50.675530 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59804b3d-3ece-4aa1-84bd-0edc13c88fe8 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:50.677112 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-59804b3d-3ece-4aa1-84bd-0edc13c88fe8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:50.727418 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:50.732351 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7436dc-e923-498d-acf6-1cc56018631f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:50.733110 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7436dc-e923-498d-acf6-1cc56018631f admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:50.733325 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7436dc-e923-498d-acf6-1cc56018631f admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:50.733600 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7436dc-e923-498d-acf6-1cc56018631f admin admin] PATH_INFO: `/v3/projects/924be0ee37524c69bb0c32bd02fcd799/users/c3013f2fee1f4a20bbf4f55a52dd84e6/roles/ddb643577b2e4e478100ec370decfaeb` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:50.740918 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7436dc-e923-498d-acf6-1cc56018631f admin admin] RBAC: Authorizing `identity:create_grant(project_id=924be0ee37524c69bb0c32bd02fcd799, user_id=c3013f2fee1f4a20bbf4f55a52dd84e6, role_id=ddb643577b2e4e478100ec370decfaeb)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:50.743351 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7436dc-e923-498d-acf6-1cc56018631f admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:50.807526 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 996/1981] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 14:57:50 2022] PUT /identity/v3/projects/924be0ee37524c69bb0c32bd02fcd799/users/c3013f2fee1f4a20bbf4f55a52dd84e6/roles/ddb643577b2e4e478100ec370decfaeb => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:50.818913 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3822629f-1189-4882-9473-7a07fdc83ca1 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:50.819423 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3822629f-1189-4882-9473-7a07fdc83ca1 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:50.820031 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3822629f-1189-4882-9473-7a07fdc83ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:50.827326 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59804b3d-3ece-4aa1-84bd-0edc13c88fe8 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:50.901350 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-3822629f-1189-4882-9473-7a07fdc83ca1 None None] MFA Rules not processed for user `c3013f2fee1f4a20bbf4f55a52dd84e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:50.912728 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-3822629f-1189-4882-9473-7a07fdc83ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:51.024275 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd76f18b-09a2-4515-a44b-010b63da1916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:51.024980 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd76f18b-09a2-4515-a44b-010b63da1916 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:51.025265 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd76f18b-09a2-4515-a44b-010b63da1916 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:51.030170 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd76f18b-09a2-4515-a44b-010b63da1916 admin admin] PATH_INFO: `/v3/users/2f100987ffa54edd89b8c6e8f639f130` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:51.032914 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd76f18b-09a2-4515-a44b-010b63da1916 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f100987ffa54edd89b8c6e8f639f130)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:51.039341 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd76f18b-09a2-4515-a44b-010b63da1916 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:51.114370 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:51.163601 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 997/1982] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:57:50 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 14:57:51.176833 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3822629f-1189-4882-9473-7a07fdc83ca1 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:51.179057 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-3822629f-1189-4882-9473-7a07fdc83ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:51.217015 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-dd76f18b-09a2-4515-a44b-010b63da1916 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f100987ffa54edd89b8c6e8f639f130'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:51.240431 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-dd76f18b-09a2-4515-a44b-010b63da1916 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f100987ffa54edd89b8c6e8f639f130'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:51.251039 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-dd76f18b-09a2-4515-a44b-010b63da1916 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f100987ffa54edd89b8c6e8f639f130'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:51.251955 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-dd76f18b-09a2-4515-a44b-010b63da1916 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f100987ffa54edd89b8c6e8f639f130'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:51.266599 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-dd76f18b-09a2-4515-a44b-010b63da1916 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f100987ffa54edd89b8c6e8f639f130'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:51.287113 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 986/1983] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Sep 19 14:57:50 2022] DELETE /identity/v3/users/2f100987ffa54edd89b8c6e8f639f130 => generated 0 bytes in 612 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:51.292282 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292fe40d-ce56-4f51-a3c7-01b911ffebe5 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:51.294669 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292fe40d-ce56-4f51-a3c7-01b911ffebe5 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:51.294669 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292fe40d-ce56-4f51-a3c7-01b911ffebe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:51.294878 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3822629f-1189-4882-9473-7a07fdc83ca1 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:51.350964 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-292fe40d-ce56-4f51-a3c7-01b911ffebe5 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:51.373566 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa3caf6-9b17-46bc-9b27-80f2bd93bae2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139dc7a4f1dc48fe8faea848bd1ac0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:51.374290 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa3caf6-9b17-46bc-9b27-80f2bd93bae2 service cinder] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:51.374529 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa3caf6-9b17-46bc-9b27-80f2bd93bae2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:51.375454 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa3caf6-9b17-46bc-9b27-80f2bd93bae2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:51.377145 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-292fe40d-ce56-4f51-a3c7-01b911ffebe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:51.378013 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-4aa3caf6-9b17-46bc-9b27-80f2bd93bae2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:51.520545 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:51.530505 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa3caf6-9b17-46bc-9b27-80f2bd93bae2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:51.532901 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa3caf6-9b17-46bc-9b27-80f2bd93bae2 service cinder] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:51.539402 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 987/1984] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:57:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:51.540286 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292fe40d-ce56-4f51-a3c7-01b911ffebe5 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:51.541739 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-292fe40d-ce56-4f51-a3c7-01b911ffebe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:51.556206 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292fe40d-ce56-4f51-a3c7-01b911ffebe5 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:51.572194 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b74751d-0738-4d2c-87b3-7c5fbe294387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:51.574678 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b74751d-0738-4d2c-87b3-7c5fbe294387 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:51.578634 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b74751d-0738-4d2c-87b3-7c5fbe294387 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:51.579249 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b74751d-0738-4d2c-87b3-7c5fbe294387 admin admin] PATH_INFO: `/v3/projects/cfa2330e4c9545838c0b053192302f89` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:51.581478 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b74751d-0738-4d2c-87b3-7c5fbe294387 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfa2330e4c9545838c0b053192302f89)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:51.584633 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 998/1985] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:57:51 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:57:51.585652 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa3caf6-9b17-46bc-9b27-80f2bd93bae2 service cinder] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:51.587786 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-4aa3caf6-9b17-46bc-9b27-80f2bd93bae2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:51.588020 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b74751d-0738-4d2c-87b3-7c5fbe294387 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:51.693339 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-4b74751d-0738-4d2c-87b3-7c5fbe294387 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfa2330e4c9545838c0b053192302f89', 'request_id': 'req-4b74751d-0738-4d2c-87b3-7c5fbe294387'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:51.712959 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-4b74751d-0738-4d2c-87b3-7c5fbe294387 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfa2330e4c9545838c0b053192302f89', 'request_id': 'req-4b74751d-0738-4d2c-87b3-7c5fbe294387'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:51.723763 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-4b74751d-0738-4d2c-87b3-7c5fbe294387 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfa2330e4c9545838c0b053192302f89', 'request_id': 'req-4b74751d-0738-4d2c-87b3-7c5fbe294387'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:51.736982 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-4b74751d-0738-4d2c-87b3-7c5fbe294387 admin admin] The token cache is being invalidate because project cfa2330e4c9545838c0b053192302f89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 14:57:51.737332 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-4b74751d-0738-4d2c-87b3-7c5fbe294387 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:51.737959 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-4b74751d-0738-4d2c-87b3-7c5fbe294387 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:51.740100 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 988/1986] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Sep 19 14:57:51 2022] DELETE /identity/v3/projects/cfa2330e4c9545838c0b053192302f89 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:51.745691 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9728c448-61d6-4d58-b421-d0725bd97296 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:51.746294 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9728c448-61d6-4d58-b421-d0725bd97296 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:51.746689 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9728c448-61d6-4d58-b421-d0725bd97296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:51.773870 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa3caf6-9b17-46bc-9b27-80f2bd93bae2 service cinder] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:51.787591 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:51.790861 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-9728c448-61d6-4d58-b421-d0725bd97296 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:51.794617 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-9728c448-61d6-4d58-b421-d0725bd97296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:51.892296 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b3d21e-2239-4ee5-b26b-22fe1d129988 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c2b78646374cb79ded4b7b59ba49c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:51.893123 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b3d21e-2239-4ee5-b26b-22fe1d129988 service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:51.893406 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b3d21e-2239-4ee5-b26b-22fe1d129988 service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:51.893677 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b3d21e-2239-4ee5-b26b-22fe1d129988 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:51.902506 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-c6b3d21e-2239-4ee5-b26b-22fe1d129988 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:51.965949 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 989/1987] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:57:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:51.971952 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0620631-cfea-4bac-a5e8-a27d2652166b None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:51.972245 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0620631-cfea-4bac-a5e8-a27d2652166b None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:51.972553 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0620631-cfea-4bac-a5e8-a27d2652166b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:52.011836 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-b0620631-cfea-4bac-a5e8-a27d2652166b None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:52.013115 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-b0620631-cfea-4bac-a5e8-a27d2652166b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:52.036441 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 990/1988] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:57:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:52.040395 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0620631-cfea-4bac-a5e8-a27d2652166b None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:52.048150 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b3d21e-2239-4ee5-b26b-22fe1d129988 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:52.050573 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b3d21e-2239-4ee5-b26b-22fe1d129988 service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:52.059222 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0620631-cfea-4bac-a5e8-a27d2652166b None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:52.073159 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa7d98d-1549-4b68-be26-efa7435cfc3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:52.074079 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa7d98d-1549-4b68-be26-efa7435cfc3d admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:52.074516 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa7d98d-1549-4b68-be26-efa7435cfc3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:52.075217 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa7d98d-1549-4b68-be26-efa7435cfc3d admin admin] PATH_INFO: `/v3/domains` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:52.076715 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa7d98d-1549-4b68-be26-efa7435cfc3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:57:52.078436 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa7d98d-1549-4b68-be26-efa7435cfc3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:52.083834 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa7d98d-1549-4b68-be26-efa7435cfc3d admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:52.088562 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 999/1989] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:57:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:57:52.136408 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 991/1990] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Sep 19 14:57:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:57:52.141452 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b3d21e-2239-4ee5-b26b-22fe1d129988 service neutron] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:52.152414 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b3d21e-2239-4ee5-b26b-22fe1d129988 service neutron] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:52.160052 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d674aa3-8865-482d-befe-260d09938849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:52.160904 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d674aa3-8865-482d-befe-260d09938849 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:52.161182 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d674aa3-8865-482d-befe-260d09938849 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:52.161457 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d674aa3-8865-482d-befe-260d09938849 admin admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:52.162102 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d674aa3-8865-482d-befe-260d09938849 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:52.164456 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d674aa3-8865-482d-befe-260d09938849 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:52.228198 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1000/1991] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Sep 19 14:57:52 2022] POST /identity/v3/projects => generated 383 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 14:57:52.233224 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa7d98d-1549-4b68-be26-efa7435cfc3d admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:52.245357 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa7d98d-1549-4b68-be26-efa7435cfc3d admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:52.418195 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2fb92f-8dc7-4802-be5f-f780387a4e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:52.419162 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2fb92f-8dc7-4802-be5f-f780387a4e0b admin admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:52.419493 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2fb92f-8dc7-4802-be5f-f780387a4e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:52.419717 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2fb92f-8dc7-4802-be5f-f780387a4e0b admin admin] PATH_INFO: `/v3/users` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:52.420572 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2fb92f-8dc7-4802-be5f-f780387a4e0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:52.423694 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2fb92f-8dc7-4802-be5f-f780387a4e0b admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:52.437883 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:52.458168 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 992/1992] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Sep 19 14:57:52 2022] POST /identity/v3/users => generated 292 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 14:57:52.462919 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d674aa3-8865-482d-befe-260d09938849 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:52.477905 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d674aa3-8865-482d-befe-260d09938849 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:52.529987 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9725d319-badb-40ee-b740-041d96c86fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:52.531888 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9725d319-badb-40ee-b740-041d96c86fd8 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:52.532626 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9725d319-badb-40ee-b740-041d96c86fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:52.532962 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9725d319-badb-40ee-b740-041d96c86fd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:52.533649 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9725d319-badb-40ee-b740-041d96c86fd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:52.537925 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9725d319-badb-40ee-b740-041d96c86fd8 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:52.540088 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2fb92f-8dc7-4802-be5f-f780387a4e0b admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:52.542298 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-6f2fb92f-8dc7-4802-be5f-f780387a4e0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:52.560394 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1001/1993] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:57:52 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:57:52.568302 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2fb92f-8dc7-4802-be5f-f780387a4e0b admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:52.574873 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cce706-da53-48d7-9a17-078480314794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:52.575543 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cce706-da53-48d7-9a17-078480314794 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:52.575822 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cce706-da53-48d7-9a17-078480314794 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:52.576125 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cce706-da53-48d7-9a17-078480314794 admin admin] PATH_INFO: `/v3/users/244338f29b284421bef622fee067a1c3` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:52.578350 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cce706-da53-48d7-9a17-078480314794 admin admin] RBAC: Authorizing `identity:delete_user(user_id=244338f29b284421bef622fee067a1c3)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:52.580383 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9725d319-badb-40ee-b740-041d96c86fd8 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:52.580702 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cce706-da53-48d7-9a17-078480314794 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:52.599163 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9725d319-badb-40ee-b740-041d96c86fd8 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:52.613340 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab40a5ae-fa3a-4fcb-a7a7-3a5de6805585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:52.614246 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab40a5ae-fa3a-4fcb-a7a7-3a5de6805585 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:52.614690 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab40a5ae-fa3a-4fcb-a7a7-3a5de6805585 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:52.615055 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab40a5ae-fa3a-4fcb-a7a7-3a5de6805585 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:52.615819 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab40a5ae-fa3a-4fcb-a7a7-3a5de6805585 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:52.618433 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab40a5ae-fa3a-4fcb-a7a7-3a5de6805585 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:52.633371 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1002/1994] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:57:52 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 14:57:52.639804 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab40a5ae-fa3a-4fcb-a7a7-3a5de6805585 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:52.658496 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab40a5ae-fa3a-4fcb-a7a7-3a5de6805585 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:52.663654 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85edadc5-588e-4bf4-8332-5706714e38d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:52.664405 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85edadc5-588e-4bf4-8332-5706714e38d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:52.664884 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85edadc5-588e-4bf4-8332-5706714e38d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:52.665192 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85edadc5-588e-4bf4-8332-5706714e38d7 admin admin] PATH_INFO: `/v3/projects/3c3ae9ec3d424762a2400e2f54e59f05/users/ff9d34b6be0245b4b4e0c41a7a77e4c6/roles/efa0e5b3413748dc828a89b12d67df79` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:52.686319 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-97cce706-da53-48d7-9a17-078480314794 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '244338f29b284421bef622fee067a1c3'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:52.691727 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85edadc5-588e-4bf4-8332-5706714e38d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c3ae9ec3d424762a2400e2f54e59f05, user_id=ff9d34b6be0245b4b4e0c41a7a77e4c6, role_id=efa0e5b3413748dc828a89b12d67df79)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:52.702159 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85edadc5-588e-4bf4-8332-5706714e38d7 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:52.725355 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-97cce706-da53-48d7-9a17-078480314794 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '244338f29b284421bef622fee067a1c3'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:52.728946 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1003/1995] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 14:57:52 2022] PUT /identity/v3/projects/3c3ae9ec3d424762a2400e2f54e59f05/users/ff9d34b6be0245b4b4e0c41a7a77e4c6/roles/efa0e5b3413748dc828a89b12d67df79 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:52.730086 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85edadc5-588e-4bf4-8332-5706714e38d7 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:52.732387 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-85edadc5-588e-4bf4-8332-5706714e38d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:52.752050 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-97cce706-da53-48d7-9a17-078480314794 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '244338f29b284421bef622fee067a1c3'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:52.752980 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-97cce706-da53-48d7-9a17-078480314794 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '244338f29b284421bef622fee067a1c3'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:52.761511 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-97cce706-da53-48d7-9a17-078480314794 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '244338f29b284421bef622fee067a1c3'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:52.772826 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 993/1996] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Sep 19 14:57:52 2022] DELETE /identity/v3/users/244338f29b284421bef622fee067a1c3 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 14:57:52.772826 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9195a5f4-ee41-4710-939d-f2f92069eede None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:52.772826 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9195a5f4-ee41-4710-939d-f2f92069eede None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:52.772826 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9195a5f4-ee41-4710-939d-f2f92069eede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:52.818269 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-9195a5f4-ee41-4710-939d-f2f92069eede None None] MFA Rules not processed for user `ff9d34b6be0245b4b4e0c41a7a77e4c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:52.819756 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-9195a5f4-ee41-4710-939d-f2f92069eede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:52.830706 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:52.848850 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85edadc5-588e-4bf4-8332-5706714e38d7 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:52.904577 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 994/1997] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:57:52 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:52.904577 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfd75dd-be61-4ae4-8dc0-07b93996c153 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:52.904577 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfd75dd-be61-4ae4-8dc0-07b93996c153 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:52.904577 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfd75dd-be61-4ae4-8dc0-07b93996c153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:52.923417 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68183d0-7e70-43b3-9121-800f50d260ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:52.924063 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68183d0-7e70-43b3-9121-800f50d260ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:52.924395 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68183d0-7e70-43b3-9121-800f50d260ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:52.924647 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68183d0-7e70-43b3-9121-800f50d260ad admin admin] PATH_INFO: `/v3/projects/18cc674891594994ad1897b3687a7960` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:52.925318 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-6bfd75dd-be61-4ae4-8dc0-07b93996c153 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:52.925768 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68183d0-7e70-43b3-9121-800f50d260ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=18cc674891594994ad1897b3687a7960)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:52.926524 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-6bfd75dd-be61-4ae4-8dc0-07b93996c153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:52.928735 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68183d0-7e70-43b3-9121-800f50d260ad admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:52.937959 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 995/1998] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:57:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:52.941434 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfd75dd-be61-4ae4-8dc0-07b93996c153 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:52.943039 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-6bfd75dd-be61-4ae4-8dc0-07b93996c153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:52.995005 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-f68183d0-7e70-43b3-9121-800f50d260ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18cc674891594994ad1897b3687a7960', 'request_id': 'req-f68183d0-7e70-43b3-9121-800f50d260ad'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:53.002646 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:INSERT=4,keystone:SELECT=86,keystone:DELETE=10 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:53.003040 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-f68183d0-7e70-43b3-9121-800f50d260ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18cc674891594994ad1897b3687a7960', 'request_id': 'req-f68183d0-7e70-43b3-9121-800f50d260ad'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:53.012595 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-f68183d0-7e70-43b3-9121-800f50d260ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18cc674891594994ad1897b3687a7960', 'request_id': 'req-f68183d0-7e70-43b3-9121-800f50d260ad'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:53.018574 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfd75dd-be61-4ae4-8dc0-07b93996c153 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:53.026803 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-f68183d0-7e70-43b3-9121-800f50d260ad admin admin] The token cache is being invalidate because project 18cc674891594994ad1897b3687a7960 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 14:57:53.027093 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-f68183d0-7e70-43b3-9121-800f50d260ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:53.027935 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-f68183d0-7e70-43b3-9121-800f50d260ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:53.029479 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1004/1999] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Sep 19 14:57:52 2022] DELETE /identity/v3/projects/18cc674891594994ad1897b3687a7960 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:53.030234 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68183d0-7e70-43b3-9121-800f50d260ad admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:53.032727 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-f68183d0-7e70-43b3-9121-800f50d260ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:53.075871 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5777b72d-db90-4b16-b5ac-8ae0ea8fa47d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139dc7a4f1dc48fe8faea848bd1ac0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:53.076532 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5777b72d-db90-4b16-b5ac-8ae0ea8fa47d service cinder] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:53.076816 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5777b72d-db90-4b16-b5ac-8ae0ea8fa47d service cinder] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:53.078241 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5777b72d-db90-4b16-b5ac-8ae0ea8fa47d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:53.080727 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-5777b72d-db90-4b16-b5ac-8ae0ea8fa47d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:53.099515 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68183d0-7e70-43b3-9121-800f50d260ad admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:53.104993 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0accd0c1-9c96-4154-90bd-e989c42cd2ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c2b78646374cb79ded4b7b59ba49c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:53.105618 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0accd0c1-9c96-4154-90bd-e989c42cd2ed service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:53.106367 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0accd0c1-9c96-4154-90bd-e989c42cd2ed service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:53.106648 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0accd0c1-9c96-4154-90bd-e989c42cd2ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:53.108880 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-0accd0c1-9c96-4154-90bd-e989c42cd2ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:53.148124 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5777b72d-db90-4b16-b5ac-8ae0ea8fa47d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:53.149510 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5777b72d-db90-4b16-b5ac-8ae0ea8fa47d service cinder] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:53.158416 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:53.159553 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 996/2000] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:57:52 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:57:53.160662 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5777b72d-db90-4b16-b5ac-8ae0ea8fa47d service cinder] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:53.162288 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-5777b72d-db90-4b16-b5ac-8ae0ea8fa47d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:53.186102 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0accd0c1-9c96-4154-90bd-e989c42cd2ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:53.187595 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0accd0c1-9c96-4154-90bd-e989c42cd2ed service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:53.199019 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1005/2001] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:57:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:57:53.199901 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0accd0c1-9c96-4154-90bd-e989c42cd2ed service neutron] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:53.201306 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-0accd0c1-9c96-4154-90bd-e989c42cd2ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:53.214876 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0accd0c1-9c96-4154-90bd-e989c42cd2ed service neutron] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:53.220868 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33472e87-3625-45d7-a9d0-c19d2b0b4c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:53.221619 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33472e87-3625-45d7-a9d0-c19d2b0b4c6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:53.221908 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33472e87-3625-45d7-a9d0-c19d2b0b4c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:53.222226 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33472e87-3625-45d7-a9d0-c19d2b0b4c6c admin admin] PATH_INFO: `/v3/users/ff9d34b6be0245b4b4e0c41a7a77e4c6` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:53.223446 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33472e87-3625-45d7-a9d0-c19d2b0b4c6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff9d34b6be0245b4b4e0c41a7a77e4c6)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:53.226098 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33472e87-3625-45d7-a9d0-c19d2b0b4c6c admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:53.236787 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5777b72d-db90-4b16-b5ac-8ae0ea8fa47d service cinder] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:53.242332 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51a599b-775e-4de0-88e4-613e98f84753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:53.242982 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51a599b-775e-4de0-88e4-613e98f84753 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:53.243272 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51a599b-775e-4de0-88e4-613e98f84753 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:53.243808 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51a599b-775e-4de0-88e4-613e98f84753 admin admin] PATH_INFO: `/v3/users/04170c204e8b4ab09c1f21b18e8d7919` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:53.245081 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51a599b-775e-4de0-88e4-613e98f84753 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04170c204e8b4ab09c1f21b18e8d7919)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:53.247894 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51a599b-775e-4de0-88e4-613e98f84753 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:53.291082 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-33472e87-3625-45d7-a9d0-c19d2b0b4c6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff9d34b6be0245b4b4e0c41a7a77e4c6'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:53.305436 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-33472e87-3625-45d7-a9d0-c19d2b0b4c6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff9d34b6be0245b4b4e0c41a7a77e4c6'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:53.310540 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-e51a599b-775e-4de0-88e4-613e98f84753 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04170c204e8b4ab09c1f21b18e8d7919'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:53.313467 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-33472e87-3625-45d7-a9d0-c19d2b0b4c6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff9d34b6be0245b4b4e0c41a7a77e4c6'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:53.319621 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:53.322171 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-33472e87-3625-45d7-a9d0-c19d2b0b4c6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff9d34b6be0245b4b4e0c41a7a77e4c6'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:53.322835 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-33472e87-3625-45d7-a9d0-c19d2b0b4c6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff9d34b6be0245b4b4e0c41a7a77e4c6'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:53.327339 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-e51a599b-775e-4de0-88e4-613e98f84753 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04170c204e8b4ab09c1f21b18e8d7919'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:53.330471 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1006/2002] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Sep 19 14:57:53 2022] DELETE /identity/v3/users/ff9d34b6be0245b4b4e0c41a7a77e4c6 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:53.334540 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49da31b3-c449-4b4d-b6d1-806676214bc2 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:53.334840 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49da31b3-c449-4b4d-b6d1-806676214bc2 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:53.335227 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49da31b3-c449-4b4d-b6d1-806676214bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:53.339137 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-e51a599b-775e-4de0-88e4-613e98f84753 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04170c204e8b4ab09c1f21b18e8d7919'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:53.340236 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-e51a599b-775e-4de0-88e4-613e98f84753 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04170c204e8b4ab09c1f21b18e8d7919'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:53.362703 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-e51a599b-775e-4de0-88e4-613e98f84753 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04170c204e8b4ab09c1f21b18e8d7919'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:53.373458 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 997/2003] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Sep 19 14:57:53 2022] DELETE /identity/v3/users/04170c204e8b4ab09c1f21b18e8d7919 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:53.377435 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-49da31b3-c449-4b4d-b6d1-806676214bc2 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:53.379002 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-49da31b3-c449-4b4d-b6d1-806676214bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:53.516745 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1007/2004] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:57:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 14:57:53.541392 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51a599b-775e-4de0-88e4-613e98f84753 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:53.543010 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-e51a599b-775e-4de0-88e4-613e98f84753 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:53.621074 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51a599b-775e-4de0-88e4-613e98f84753 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:53.625385 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df98f7bc-5b87-42b3-bd58-513d252cdeb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c2b78646374cb79ded4b7b59ba49c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:53.626117 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df98f7bc-5b87-42b3-bd58-513d252cdeb1 service neutron] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:53.626397 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df98f7bc-5b87-42b3-bd58-513d252cdeb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:53.626669 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df98f7bc-5b87-42b3-bd58-513d252cdeb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:53.639390 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df98f7bc-5b87-42b3-bd58-513d252cdeb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:53.641911 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df98f7bc-5b87-42b3-bd58-513d252cdeb1 service neutron] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:53.653910 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 998/2005] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:57:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:57:53.792460 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49da31b3-c449-4b4d-b6d1-806676214bc2 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:53.793891 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-49da31b3-c449-4b4d-b6d1-806676214bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:53.807228 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49da31b3-c449-4b4d-b6d1-806676214bc2 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:53.825239 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2874bc45-dcb5-4d95-a537-0d809e4603e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:53.826228 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2874bc45-dcb5-4d95-a537-0d809e4603e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:53.826704 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2874bc45-dcb5-4d95-a537-0d809e4603e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:53.827197 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2874bc45-dcb5-4d95-a537-0d809e4603e7 admin admin] PATH_INFO: `/v3/projects/49ed68264f4c4dd19ff837c4336c1ce4` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:53.828773 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2874bc45-dcb5-4d95-a537-0d809e4603e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49ed68264f4c4dd19ff837c4336c1ce4)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:53.831236 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2874bc45-dcb5-4d95-a537-0d809e4603e7 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:53.909743 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:53.926540 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-2874bc45-dcb5-4d95-a537-0d809e4603e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49ed68264f4c4dd19ff837c4336c1ce4', 'request_id': 'req-2874bc45-dcb5-4d95-a537-0d809e4603e7'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:53.939261 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-2874bc45-dcb5-4d95-a537-0d809e4603e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49ed68264f4c4dd19ff837c4336c1ce4', 'request_id': 'req-2874bc45-dcb5-4d95-a537-0d809e4603e7'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:53.958126 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-2874bc45-dcb5-4d95-a537-0d809e4603e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49ed68264f4c4dd19ff837c4336c1ce4', 'request_id': 'req-2874bc45-dcb5-4d95-a537-0d809e4603e7'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:53.973073 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-2874bc45-dcb5-4d95-a537-0d809e4603e7 admin admin] The token cache is being invalidate because project 49ed68264f4c4dd19ff837c4336c1ce4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 14:57:53.973429 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-2874bc45-dcb5-4d95-a537-0d809e4603e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:53.974066 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-2874bc45-dcb5-4d95-a537-0d809e4603e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:53.975853 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1008/2006] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Sep 19 14:57:53 2022] DELETE /identity/v3/projects/49ed68264f4c4dd19ff837c4336c1ce4 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:53.981338 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df98f7bc-5b87-42b3-bd58-513d252cdeb1 service neutron] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:53.994099 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df98f7bc-5b87-42b3-bd58-513d252cdeb1 service neutron] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:54.059481 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467ffa2e-e7ea-482b-8ae7-29874af2cac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:54.060152 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ffa2e-e7ea-482b-8ae7-29874af2cac9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:54.060476 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ffa2e-e7ea-482b-8ae7-29874af2cac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:54.060753 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ffa2e-e7ea-482b-8ae7-29874af2cac9 admin admin] PATH_INFO: `/v3/users/c3013f2fee1f4a20bbf4f55a52dd84e6` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:54.063055 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467ffa2e-e7ea-482b-8ae7-29874af2cac9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3013f2fee1f4a20bbf4f55a52dd84e6)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:54.065213 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467ffa2e-e7ea-482b-8ae7-29874af2cac9 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:54.124676 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-467ffa2e-e7ea-482b-8ae7-29874af2cac9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3013f2fee1f4a20bbf4f55a52dd84e6'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:54.140475 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-467ffa2e-e7ea-482b-8ae7-29874af2cac9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3013f2fee1f4a20bbf4f55a52dd84e6'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:54.147620 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-467ffa2e-e7ea-482b-8ae7-29874af2cac9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3013f2fee1f4a20bbf4f55a52dd84e6'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:54.148507 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-467ffa2e-e7ea-482b-8ae7-29874af2cac9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3013f2fee1f4a20bbf4f55a52dd84e6'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:54.152248 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:54.161947 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-467ffa2e-e7ea-482b-8ae7-29874af2cac9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3013f2fee1f4a20bbf4f55a52dd84e6'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:54.174337 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 999/2007] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Sep 19 14:57:53 2022] DELETE /identity/v3/users/c3013f2fee1f4a20bbf4f55a52dd84e6 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:54.185949 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2874bc45-dcb5-4d95-a537-0d809e4603e7 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:54.194676 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-2874bc45-dcb5-4d95-a537-0d809e4603e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:54.252066 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2874bc45-dcb5-4d95-a537-0d809e4603e7 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:54.337243 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5262a324-a148-411b-94a5-44b8c5aefc5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:54.338036 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5262a324-a148-411b-94a5-44b8c5aefc5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:54.338327 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5262a324-a148-411b-94a5-44b8c5aefc5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:54.338600 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5262a324-a148-411b-94a5-44b8c5aefc5b admin admin] PATH_INFO: `/v3/projects/d303400f6ac64a80b7d6bc1a8431fee8` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:54.339757 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5262a324-a148-411b-94a5-44b8c5aefc5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d303400f6ac64a80b7d6bc1a8431fee8)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:54.341746 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5262a324-a148-411b-94a5-44b8c5aefc5b admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:54.414234 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-5262a324-a148-411b-94a5-44b8c5aefc5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd303400f6ac64a80b7d6bc1a8431fee8', 'request_id': 'req-5262a324-a148-411b-94a5-44b8c5aefc5b'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:54.418169 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467ffa2e-e7ea-482b-8ae7-29874af2cac9 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:54.419639 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-467ffa2e-e7ea-482b-8ae7-29874af2cac9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:54.429751 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-5262a324-a148-411b-94a5-44b8c5aefc5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd303400f6ac64a80b7d6bc1a8431fee8', 'request_id': 'req-5262a324-a148-411b-94a5-44b8c5aefc5b'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:54.436402 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467ffa2e-e7ea-482b-8ae7-29874af2cac9 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:54.437512 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-5262a324-a148-411b-94a5-44b8c5aefc5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd303400f6ac64a80b7d6bc1a8431fee8', 'request_id': 'req-5262a324-a148-411b-94a5-44b8c5aefc5b'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:54.492295 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-5262a324-a148-411b-94a5-44b8c5aefc5b admin admin] The token cache is being invalidate because project d303400f6ac64a80b7d6bc1a8431fee8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 14:57:54.492690 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-5262a324-a148-411b-94a5-44b8c5aefc5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:54.493561 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-5262a324-a148-411b-94a5-44b8c5aefc5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:54.495830 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1009/2008] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Sep 19 14:57:54 2022] DELETE /identity/v3/projects/d303400f6ac64a80b7d6bc1a8431fee8 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:54.502045 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b569631-fd08-44da-89fe-25fbbed4e9ed None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:54.505357 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b569631-fd08-44da-89fe-25fbbed4e9ed None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:54.505357 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b569631-fd08-44da-89fe-25fbbed4e9ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:54.532318 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f71002-de04-476f-8f36-e0707c46b123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:54.533102 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f71002-de04-476f-8f36-e0707c46b123 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:54.533456 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f71002-de04-476f-8f36-e0707c46b123 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:54.533841 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f71002-de04-476f-8f36-e0707c46b123 admin admin] PATH_INFO: `/v3/projects/3c3ae9ec3d424762a2400e2f54e59f05` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:54.535257 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f71002-de04-476f-8f36-e0707c46b123 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c3ae9ec3d424762a2400e2f54e59f05)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:54.535650 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-9b569631-fd08-44da-89fe-25fbbed4e9ed None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:54.537319 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-9b569631-fd08-44da-89fe-25fbbed4e9ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:54.537447 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f71002-de04-476f-8f36-e0707c46b123 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:54.551085 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1010/2009] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:57:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:54.558576 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f160dc-e138-4274-8db4-cc8ef6ac047f None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:54.558864 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f160dc-e138-4274-8db4-cc8ef6ac047f None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:54.559143 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f160dc-e138-4274-8db4-cc8ef6ac047f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:54.581212 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-57f160dc-e138-4274-8db4-cc8ef6ac047f None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:54.582512 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-57f160dc-e138-4274-8db4-cc8ef6ac047f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:54.598739 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1011/2010] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:57:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 14:57:54.606757 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f160dc-e138-4274-8db4-cc8ef6ac047f None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:54.610394 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-a8f71002-de04-476f-8f36-e0707c46b123 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c3ae9ec3d424762a2400e2f54e59f05', 'request_id': 'req-a8f71002-de04-476f-8f36-e0707c46b123'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:54.619753 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-a8f71002-de04-476f-8f36-e0707c46b123 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c3ae9ec3d424762a2400e2f54e59f05', 'request_id': 'req-a8f71002-de04-476f-8f36-e0707c46b123'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:54.626382 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f160dc-e138-4274-8db4-cc8ef6ac047f None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:54.633125 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-a8f71002-de04-476f-8f36-e0707c46b123 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c3ae9ec3d424762a2400e2f54e59f05', 'request_id': 'req-a8f71002-de04-476f-8f36-e0707c46b123'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:54.648070 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-a8f71002-de04-476f-8f36-e0707c46b123 admin admin] The token cache is being invalidate because project 3c3ae9ec3d424762a2400e2f54e59f05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 14:57:54.648575 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-a8f71002-de04-476f-8f36-e0707c46b123 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:54.649391 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-a8f71002-de04-476f-8f36-e0707c46b123 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:54.651253 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1000/2011] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Sep 19 14:57:54 2022] DELETE /identity/v3/projects/3c3ae9ec3d424762a2400e2f54e59f05 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 14:57:54.660016 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a7bed-304a-4d75-b17a-ec75cf40d203 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:54.660016 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a7bed-304a-4d75-b17a-ec75cf40d203 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:54.660016 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a7bed-304a-4d75-b17a-ec75cf40d203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:54.684785 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-440a7bed-304a-4d75-b17a-ec75cf40d203 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:54.686227 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-440a7bed-304a-4d75-b17a-ec75cf40d203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:54.727252 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:54.758314 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85de3bc6-3e58-474d-80ed-750596d9676a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:54.758994 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85de3bc6-3e58-474d-80ed-750596d9676a admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:54.761951 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85de3bc6-3e58-474d-80ed-750596d9676a admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:54.762247 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85de3bc6-3e58-474d-80ed-750596d9676a admin admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:54.766512 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85de3bc6-3e58-474d-80ed-750596d9676a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:57:54.768732 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85de3bc6-3e58-474d-80ed-750596d9676a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:54.771372 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85de3bc6-3e58-474d-80ed-750596d9676a admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:54.787418 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1012/2012] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Sep 19 14:57:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:57:54.788529 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85de3bc6-3e58-474d-80ed-750596d9676a admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:54.790691 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-85de3bc6-3e58-474d-80ed-750596d9676a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:54.819956 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85de3bc6-3e58-474d-80ed-750596d9676a admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:54.836922 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3bbaac-d797-4805-a922-73b40db38422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:54.837583 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3bbaac-d797-4805-a922-73b40db38422 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:54.837867 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3bbaac-d797-4805-a922-73b40db38422 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:54.838165 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3bbaac-d797-4805-a922-73b40db38422 admin admin] PATH_INFO: `/v3/projects/924be0ee37524c69bb0c32bd02fcd799` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:54.839536 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3bbaac-d797-4805-a922-73b40db38422 admin admin] RBAC: Authorizing `identity:delete_project(project_id=924be0ee37524c69bb0c32bd02fcd799)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:54.841517 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3bbaac-d797-4805-a922-73b40db38422 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:54.863980 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1001/2013] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:57:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:54.865243 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440a7bed-304a-4d75-b17a-ec75cf40d203 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:54.872620 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-440a7bed-304a-4d75-b17a-ec75cf40d203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:54.892470 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440a7bed-304a-4d75-b17a-ec75cf40d203 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:54.897952 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e86db1-41ae-448b-81e5-abcc6d6ec1bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:54.899315 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e86db1-41ae-448b-81e5-abcc6d6ec1bb admin admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:54.902101 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e86db1-41ae-448b-81e5-abcc6d6ec1bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:54.902370 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e86db1-41ae-448b-81e5-abcc6d6ec1bb admin admin] PATH_INFO: `/v3/projects` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:54.903040 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e86db1-41ae-448b-81e5-abcc6d6ec1bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:54.905244 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e86db1-41ae-448b-81e5-abcc6d6ec1bb admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:54.981389 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1002/2014] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Sep 19 14:57:54 2022] POST /identity/v3/projects => generated 389 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:57:54.982748 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99839e7f-88ac-475b-8c81-b58f5b2d2a05 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:54.983102 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99839e7f-88ac-475b-8c81-b58f5b2d2a05 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:54.983452 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99839e7f-88ac-475b-8c81-b58f5b2d2a05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:54.993763 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:54.996781 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-0d3bbaac-d797-4805-a922-73b40db38422 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '924be0ee37524c69bb0c32bd02fcd799', 'request_id': 'req-0d3bbaac-d797-4805-a922-73b40db38422'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:55.009842 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-0d3bbaac-d797-4805-a922-73b40db38422 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '924be0ee37524c69bb0c32bd02fcd799', 'request_id': 'req-0d3bbaac-d797-4805-a922-73b40db38422'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:55.017534 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-0d3bbaac-d797-4805-a922-73b40db38422 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '924be0ee37524c69bb0c32bd02fcd799', 'request_id': 'req-0d3bbaac-d797-4805-a922-73b40db38422'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:55.031025 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-99839e7f-88ac-475b-8c81-b58f5b2d2a05 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:55.032179 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-99839e7f-88ac-475b-8c81-b58f5b2d2a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:55.047765 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-0d3bbaac-d797-4805-a922-73b40db38422 admin admin] The token cache is being invalidate because project 924be0ee37524c69bb0c32bd02fcd799 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 14:57:55.048282 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-0d3bbaac-d797-4805-a922-73b40db38422 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:55.049609 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-0d3bbaac-d797-4805-a922-73b40db38422 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:55.053083 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1013/2015] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Sep 19 14:57:54 2022] DELETE /identity/v3/projects/924be0ee37524c69bb0c32bd02fcd799 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:55.053935 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3bbaac-d797-4805-a922-73b40db38422 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:55.055371 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-0d3bbaac-d797-4805-a922-73b40db38422 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:55.149903 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3bbaac-d797-4805-a922-73b40db38422 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:55.158803 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f923ee0-5a12-44d9-942e-bf00d1010201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:55.159434 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f923ee0-5a12-44d9-942e-bf00d1010201 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:55.159711 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f923ee0-5a12-44d9-942e-bf00d1010201 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:55.160016 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f923ee0-5a12-44d9-942e-bf00d1010201 admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:55.160728 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f923ee0-5a12-44d9-942e-bf00d1010201 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:55.165760 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f923ee0-5a12-44d9-942e-bf00d1010201 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:55.171794 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1003/2016] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:57:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:55.174485 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb8bbf8-292c-45d7-9821-1a23e5f23d1e None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:55.174774 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb8bbf8-292c-45d7-9821-1a23e5f23d1e None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:55.175608 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb8bbf8-292c-45d7-9821-1a23e5f23d1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:55.193865 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1014/2017] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Sep 19 14:57:55 2022] POST /identity/v3/users => generated 295 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:57:55.194566 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f923ee0-5a12-44d9-942e-bf00d1010201 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:55.205146 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f923ee0-5a12-44d9-942e-bf00d1010201 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:55.206522 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-feb8bbf8-292c-45d7-9821-1a23e5f23d1e None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:55.207814 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-feb8bbf8-292c-45d7-9821-1a23e5f23d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:55.217252 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6098517-3874-4738-8b7f-3dd6b9c4b5e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:55.218356 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6098517-3874-4738-8b7f-3dd6b9c4b5e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:55.218656 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6098517-3874-4738-8b7f-3dd6b9c4b5e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:55.218916 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6098517-3874-4738-8b7f-3dd6b9c4b5e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:55.219628 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6098517-3874-4738-8b7f-3dd6b9c4b5e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:57:55.219950 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6098517-3874-4738-8b7f-3dd6b9c4b5e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:55.222691 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1004/2018] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:57:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:55.222848 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6098517-3874-4738-8b7f-3dd6b9c4b5e5 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:55.224235 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb8bbf8-292c-45d7-9821-1a23e5f23d1e None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:55.237386 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb8bbf8-292c-45d7-9821-1a23e5f23d1e None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:55.242656 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34ba2b2-7815-476b-9d94-60ff96979e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:55.243293 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ba2b2-7815-476b-9d94-60ff96979e5e admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:55.243581 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ba2b2-7815-476b-9d94-60ff96979e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:55.243857 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ba2b2-7815-476b-9d94-60ff96979e5e admin admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:55.244535 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34ba2b2-7815-476b-9d94-60ff96979e5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:55.246327 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34ba2b2-7815-476b-9d94-60ff96979e5e admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:55.253213 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1015/2019] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Sep 19 14:57:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:57:55.255271 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a289161e-4667-490f-a356-b2b81219a7f8 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:55.255893 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a289161e-4667-490f-a356-b2b81219a7f8 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:55.256441 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a289161e-4667-490f-a356-b2b81219a7f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:55.269350 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1005/2020] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:57:55 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:57:55.269350 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34ba2b2-7815-476b-9d94-60ff96979e5e admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:55.283897 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34ba2b2-7815-476b-9d94-60ff96979e5e admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:55.290335 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3156748f-313f-4c88-81e9-6658abfb147c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:55.291422 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3156748f-313f-4c88-81e9-6658abfb147c admin admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:55.291737 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3156748f-313f-4c88-81e9-6658abfb147c admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:55.292019 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3156748f-313f-4c88-81e9-6658abfb147c admin admin] PATH_INFO: `/v3/projects` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:55.292736 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3156748f-313f-4c88-81e9-6658abfb147c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:55.294993 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3156748f-313f-4c88-81e9-6658abfb147c admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:55.297926 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-a289161e-4667-490f-a356-b2b81219a7f8 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:55.299347 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-a289161e-4667-490f-a356-b2b81219a7f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:55.311204 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1016/2021] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:57:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:55.312993 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a289161e-4667-490f-a356-b2b81219a7f8 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:55.330149 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a289161e-4667-490f-a356-b2b81219a7f8 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:55.340142 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fbfbe1-e99f-4ea2-8ae1-a156950e5379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:55.340142 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fbfbe1-e99f-4ea2-8ae1-a156950e5379 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:55.340142 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fbfbe1-e99f-4ea2-8ae1-a156950e5379 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:55.340142 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fbfbe1-e99f-4ea2-8ae1-a156950e5379 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:55.340604 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fbfbe1-e99f-4ea2-8ae1-a156950e5379 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:55.340604 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fbfbe1-e99f-4ea2-8ae1-a156950e5379 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:55.344237 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1006/2022] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Sep 19 14:57:55 2022] POST /identity/v3/projects => generated 375 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:57:55.347367 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3156748f-313f-4c88-81e9-6658abfb147c admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:55.360390 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1017/2023] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:57:55 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:57:55.360390 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fbfbe1-e99f-4ea2-8ae1-a156950e5379 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:55.369882 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fbfbe1-e99f-4ea2-8ae1-a156950e5379 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:55.397272 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:55.442350 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69742820-f2a4-429a-90c6-db7696f43c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:55.442874 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69742820-f2a4-429a-90c6-db7696f43c79 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:55.443167 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69742820-f2a4-429a-90c6-db7696f43c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:55.443433 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69742820-f2a4-429a-90c6-db7696f43c79 admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:55.448986 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69742820-f2a4-429a-90c6-db7696f43c79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:55.451408 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69742820-f2a4-429a-90c6-db7696f43c79 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:55.458968 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3156748f-313f-4c88-81e9-6658abfb147c admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:55.463849 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44d7e20-3ba0-4ca3-ab0a-5f185ba64160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:55.464657 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44d7e20-3ba0-4ca3-ab0a-5f185ba64160 admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:55.465011 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44d7e20-3ba0-4ca3-ab0a-5f185ba64160 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:55.465221 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44d7e20-3ba0-4ca3-ab0a-5f185ba64160 admin admin] PATH_INFO: `/v3/domains` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:55.466042 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44d7e20-3ba0-4ca3-ab0a-5f185ba64160 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:57:55.466355 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44d7e20-3ba0-4ca3-ab0a-5f185ba64160 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:55.468124 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44d7e20-3ba0-4ca3-ab0a-5f185ba64160 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:55.485881 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1007/2024] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Sep 19 14:57:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:57:55.490091 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1018/2025] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Sep 19 14:57:55 2022] POST /identity/v3/users => generated 288 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:57:55.491798 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69742820-f2a4-429a-90c6-db7696f43c79 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:55.494261 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44d7e20-3ba0-4ca3-ab0a-5f185ba64160 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:55.503838 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69742820-f2a4-429a-90c6-db7696f43c79 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:55.508071 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44d7e20-3ba0-4ca3-ab0a-5f185ba64160 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:55.509456 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471e290f-1b6b-4d5b-b9dd-e5ba2d704e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:55.510163 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471e290f-1b6b-4d5b-b9dd-e5ba2d704e3b admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:55.510527 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471e290f-1b6b-4d5b-b9dd-e5ba2d704e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:55.510873 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471e290f-1b6b-4d5b-b9dd-e5ba2d704e3b admin admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:55.511597 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471e290f-1b6b-4d5b-b9dd-e5ba2d704e3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:55.513603 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471e290f-1b6b-4d5b-b9dd-e5ba2d704e3b admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:55.513797 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a147ab5-551d-4464-9f77-e608897c3170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:55.514614 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a147ab5-551d-4464-9f77-e608897c3170 admin admin] REQUEST_METHOD: `PUT` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:55.515081 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a147ab5-551d-4464-9f77-e608897c3170 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:55.515432 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a147ab5-551d-4464-9f77-e608897c3170 admin admin] PATH_INFO: `/v3/projects/f1021e8ba25f45fc8fa6d6043fdc09e6/users/a77db44564d5404fb238c3d3b289c151/roles/efa0e5b3413748dc828a89b12d67df79` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:55.535531 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a147ab5-551d-4464-9f77-e608897c3170 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1021e8ba25f45fc8fa6d6043fdc09e6, user_id=a77db44564d5404fb238c3d3b289c151, role_id=efa0e5b3413748dc828a89b12d67df79)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:55.538553 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a147ab5-551d-4464-9f77-e608897c3170 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:55.551627 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1019/2026] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Sep 19 14:57:55 2022] POST /identity/v3/projects => generated 359 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:57:55.552642 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471e290f-1b6b-4d5b-b9dd-e5ba2d704e3b admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:55.557290 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1008/2027] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 14:57:55 2022] PUT /identity/v3/projects/f1021e8ba25f45fc8fa6d6043fdc09e6/users/a77db44564d5404fb238c3d3b289c151/roles/efa0e5b3413748dc828a89b12d67df79 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:55.558560 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a147ab5-551d-4464-9f77-e608897c3170 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:55.616786 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:55.640835 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471e290f-1b6b-4d5b-b9dd-e5ba2d704e3b admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:55.646473 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d30e12e-36e9-4451-b582-fd4afb8237f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:55.647156 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d30e12e-36e9-4451-b582-fd4afb8237f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:55.647447 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d30e12e-36e9-4451-b582-fd4afb8237f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:55.647716 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d30e12e-36e9-4451-b582-fd4afb8237f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:55.648393 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d30e12e-36e9-4451-b582-fd4afb8237f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:55.649988 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d30e12e-36e9-4451-b582-fd4afb8237f4 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:55.651335 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a147ab5-551d-4464-9f77-e608897c3170 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:55.657794 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5d10e2-a779-4205-bfc2-8f8273842995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:55.658417 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d10e2-a779-4205-bfc2-8f8273842995 admin admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:55.658705 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d10e2-a779-4205-bfc2-8f8273842995 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:55.658980 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d10e2-a779-4205-bfc2-8f8273842995 admin admin] PATH_INFO: `/v3/users` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:55.659612 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5d10e2-a779-4205-bfc2-8f8273842995 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:55.661569 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5d10e2-a779-4205-bfc2-8f8273842995 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:55.661707 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1020/2028] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:57:55 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:57:55.665927 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa2f96c-144c-4b49-a0cd-32003b7620c5 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:55.666441 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa2f96c-144c-4b49-a0cd-32003b7620c5 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:55.666698 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa2f96c-144c-4b49-a0cd-32003b7620c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:55.687696 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1009/2029] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Sep 19 14:57:55 2022] POST /identity/v3/users => generated 280 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:57:55.688696 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5d10e2-a779-4205-bfc2-8f8273842995 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:55.701490 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5d10e2-a779-4205-bfc2-8f8273842995 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:55.707354 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edf10fc-b044-468c-b148-c4fb3753fa52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:55.708217 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf10fc-b044-468c-b148-c4fb3753fa52 admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:55.708587 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf10fc-b044-468c-b148-c4fb3753fa52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:55.708810 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf10fc-b044-468c-b148-c4fb3753fa52 admin admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:55.709511 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edf10fc-b044-468c-b148-c4fb3753fa52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:55.711265 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edf10fc-b044-468c-b148-c4fb3753fa52 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:55.714200 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-4fa2f96c-144c-4b49-a0cd-32003b7620c5 None None] MFA Rules not processed for user `a77db44564d5404fb238c3d3b289c151`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:55.715496 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-4fa2f96c-144c-4b49-a0cd-32003b7620c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:55.724045 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1010/2030] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:57:55 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:57:55.725216 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edf10fc-b044-468c-b148-c4fb3753fa52 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:55.741933 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edf10fc-b044-468c-b148-c4fb3753fa52 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:55.746635 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fef895d-76ed-4a24-8000-b4fcbbf926e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:55.747354 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef895d-76ed-4a24-8000-b4fcbbf926e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:55.747639 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef895d-76ed-4a24-8000-b4fcbbf926e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:55.747917 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef895d-76ed-4a24-8000-b4fcbbf926e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:55.748635 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fef895d-76ed-4a24-8000-b4fcbbf926e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:55.750413 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fef895d-76ed-4a24-8000-b4fcbbf926e1 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:55.762414 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1011/2031] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:57:55 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:57:55.763318 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fef895d-76ed-4a24-8000-b4fcbbf926e1 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:55.774206 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fef895d-76ed-4a24-8000-b4fcbbf926e1 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:55.779105 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1560a9-302c-4076-adf1-8351069943ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:55.779767 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1560a9-302c-4076-adf1-8351069943ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:55.780052 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1560a9-302c-4076-adf1-8351069943ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:55.780972 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1560a9-302c-4076-adf1-8351069943ba admin admin] PATH_INFO: `/v3/projects/7ffd6df0da7b459e8027e2f317cc1599/users/b5592bcf57c9486d93464e6d3362b614/roles/efa0e5b3413748dc828a89b12d67df79` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:55.797511 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1560a9-302c-4076-adf1-8351069943ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ffd6df0da7b459e8027e2f317cc1599, user_id=b5592bcf57c9486d93464e6d3362b614, role_id=efa0e5b3413748dc828a89b12d67df79)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:55.800227 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1560a9-302c-4076-adf1-8351069943ba admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:55.804140 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1021/2032] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:57:55 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:55.805529 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa2f96c-144c-4b49-a0cd-32003b7620c5 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:55.819137 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa2f96c-144c-4b49-a0cd-32003b7620c5 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:55.820561 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1012/2033] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 14:57:55 2022] PUT /identity/v3/projects/7ffd6df0da7b459e8027e2f317cc1599/users/b5592bcf57c9486d93464e6d3362b614/roles/efa0e5b3413748dc828a89b12d67df79 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:55.830172 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1560a9-302c-4076-adf1-8351069943ba admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:55.838932 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:55.907453 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1458444b-2330-4b5f-ba68-43c69ed79bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:55.908080 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1458444b-2330-4b5f-ba68-43c69ed79bad admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:55.908411 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1458444b-2330-4b5f-ba68-43c69ed79bad admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:55.908695 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1458444b-2330-4b5f-ba68-43c69ed79bad admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:55.909401 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1458444b-2330-4b5f-ba68-43c69ed79bad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:55.910956 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1458444b-2330-4b5f-ba68-43c69ed79bad admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:55.911215 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1560a9-302c-4076-adf1-8351069943ba admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:55.916023 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c7ed79-32ce-452c-a0d8-7eb764ab2520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:55.916908 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c7ed79-32ce-452c-a0d8-7eb764ab2520 admin admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:55.917191 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c7ed79-32ce-452c-a0d8-7eb764ab2520 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:55.917469 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c7ed79-32ce-452c-a0d8-7eb764ab2520 admin admin] PATH_INFO: `/v3/projects` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:55.918099 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c7ed79-32ce-452c-a0d8-7eb764ab2520 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:55.920008 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c7ed79-32ce-452c-a0d8-7eb764ab2520 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:55.923523 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1022/2034] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:57:55 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:57:55.924947 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48199f3f-7152-447e-9070-6b698e83625a None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:55.925242 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48199f3f-7152-447e-9070-6b698e83625a None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:55.925518 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48199f3f-7152-447e-9070-6b698e83625a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:55.949460 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1013/2035] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Sep 19 14:57:55 2022] POST /identity/v3/projects => generated 389 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:57:55.950252 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c7ed79-32ce-452c-a0d8-7eb764ab2520 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:55.956669 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-48199f3f-7152-447e-9070-6b698e83625a None None] MFA Rules not processed for user `b5592bcf57c9486d93464e6d3362b614`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:55.958097 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-48199f3f-7152-447e-9070-6b698e83625a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:56.037411 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c7ed79-32ce-452c-a0d8-7eb764ab2520 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:56.048514 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d4b78d-e607-4f09-bdf7-f884487d19de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:56.048514 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d4b78d-e607-4f09-bdf7-f884487d19de admin admin] REQUEST_METHOD: `PUT` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:56.048514 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d4b78d-e607-4f09-bdf7-f884487d19de admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:56.048514 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d4b78d-e607-4f09-bdf7-f884487d19de admin admin] PATH_INFO: `/v3/projects/326c01ab4f444ba988c9f7bab4f1791f/users/2f7d573e77bb45b987946fbe1e29886e/roles/efa0e5b3413748dc828a89b12d67df79` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:56.054924 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1023/2036] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:57:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:56.054924 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48199f3f-7152-447e-9070-6b698e83625a None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:56.057291 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:56.070254 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48199f3f-7152-447e-9070-6b698e83625a None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:56.071000 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d4b78d-e607-4f09-bdf7-f884487d19de admin admin] RBAC: Authorizing `identity:create_grant(project_id=326c01ab4f444ba988c9f7bab4f1791f, user_id=2f7d573e77bb45b987946fbe1e29886e, role_id=efa0e5b3413748dc828a89b12d67df79)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:56.074397 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d4b78d-e607-4f09-bdf7-f884487d19de admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:56.076898 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e82975-3462-4784-9248-414a0678d0ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:56.077741 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e82975-3462-4784-9248-414a0678d0ba admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:56.078596 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e82975-3462-4784-9248-414a0678d0ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:56.079098 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e82975-3462-4784-9248-414a0678d0ba admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:56.079911 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e82975-3462-4784-9248-414a0678d0ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:56.082427 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e82975-3462-4784-9248-414a0678d0ba admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:56.089632 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1014/2037] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 14:57:55 2022] PUT /identity/v3/projects/326c01ab4f444ba988c9f7bab4f1791f/users/2f7d573e77bb45b987946fbe1e29886e/roles/efa0e5b3413748dc828a89b12d67df79 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:56.090669 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d4b78d-e607-4f09-bdf7-f884487d19de admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:56.094158 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-00d4b78d-e607-4f09-bdf7-f884487d19de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:56.124071 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1024/2038] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Sep 19 14:57:56 2022] POST /identity/v3/users => generated 301 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:57:56.127225 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce50f24-fa7a-47b5-97fc-83bdf846c998 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:56.127711 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce50f24-fa7a-47b5-97fc-83bdf846c998 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:56.128164 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce50f24-fa7a-47b5-97fc-83bdf846c998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:56.172553 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-5ce50f24-fa7a-47b5-97fc-83bdf846c998 None None] MFA Rules not processed for user `2f7d573e77bb45b987946fbe1e29886e`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:56.172553 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-5ce50f24-fa7a-47b5-97fc-83bdf846c998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:56.172791 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d4b78d-e607-4f09-bdf7-f884487d19de admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:56.176230 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cd8c08-6ee4-46ad-8626-5ca3b27f932f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139dc7a4f1dc48fe8faea848bd1ac0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:56.177082 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd8c08-6ee4-46ad-8626-5ca3b27f932f service cinder] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:56.177364 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd8c08-6ee4-46ad-8626-5ca3b27f932f service cinder] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:56.177634 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd8c08-6ee4-46ad-8626-5ca3b27f932f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:56.264608 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cd8c08-6ee4-46ad-8626-5ca3b27f932f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:56.267229 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cd8c08-6ee4-46ad-8626-5ca3b27f932f service cinder] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:56.275940 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1025/2039] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:57:56 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:56.277567 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce50f24-fa7a-47b5-97fc-83bdf846c998 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:56.283164 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1015/2040] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:57:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:57:56.302910 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:56.374430 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce50f24-fa7a-47b5-97fc-83bdf846c998 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:56.379593 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e24973-6e4c-404a-a49e-2a1711eb1b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:56.380575 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e24973-6e4c-404a-a49e-2a1711eb1b90 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:56.381070 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e24973-6e4c-404a-a49e-2a1711eb1b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:56.381737 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e24973-6e4c-404a-a49e-2a1711eb1b90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:56.382361 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e24973-6e4c-404a-a49e-2a1711eb1b90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:56.384105 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e24973-6e4c-404a-a49e-2a1711eb1b90 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:56.400616 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1026/2041] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:57:56 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:57:56.404998 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cd8c08-6ee4-46ad-8626-5ca3b27f932f service cinder] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:56.426779 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cd8c08-6ee4-46ad-8626-5ca3b27f932f service cinder] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:56.432706 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af295e2e-d9fa-4d58-b40d-e5b4a622c4c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:56.433794 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af295e2e-d9fa-4d58-b40d-e5b4a622c4c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:56.434255 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af295e2e-d9fa-4d58-b40d-e5b4a622c4c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:56.434687 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af295e2e-d9fa-4d58-b40d-e5b4a622c4c3 admin admin] PATH_INFO: `/v3/projects/b00f1f5dd47444e9844bac4ab4e2fb60/users/885e926dd7e445958230453cbe8d8fdd/roles/ddb643577b2e4e478100ec370decfaeb` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:56.464569 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af295e2e-d9fa-4d58-b40d-e5b4a622c4c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b00f1f5dd47444e9844bac4ab4e2fb60, user_id=885e926dd7e445958230453cbe8d8fdd, role_id=ddb643577b2e4e478100ec370decfaeb)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:56.467578 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af295e2e-d9fa-4d58-b40d-e5b4a622c4c3 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:56.487625 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1016/2042] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 14:57:56 2022] PUT /identity/v3/projects/b00f1f5dd47444e9844bac4ab4e2fb60/users/885e926dd7e445958230453cbe8d8fdd/roles/ddb643577b2e4e478100ec370decfaeb => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:56.492846 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e24973-6e4c-404a-a49e-2a1711eb1b90 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:56.499759 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af295e2e-d9fa-4d58-b40d-e5b4a622c4c3 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:56.501521 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-af295e2e-d9fa-4d58-b40d-e5b4a622c4c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:56.512605 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e24973-6e4c-404a-a49e-2a1711eb1b90 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:56.571560 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af295e2e-d9fa-4d58-b40d-e5b4a622c4c3 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:56.576346 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32c9924-bfa4-4c38-b3b4-a3d9050a08d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139dc7a4f1dc48fe8faea848bd1ac0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:56.576985 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32c9924-bfa4-4c38-b3b4-a3d9050a08d7 service cinder] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:56.577591 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32c9924-bfa4-4c38-b3b4-a3d9050a08d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:56.577769 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32c9924-bfa4-4c38-b3b4-a3d9050a08d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:56.592596 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d141f-4bff-4901-9f2a-5652bc6566d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:56.593986 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d141f-4bff-4901-9f2a-5652bc6566d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:56.594134 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d141f-4bff-4901-9f2a-5652bc6566d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:56.594324 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d141f-4bff-4901-9f2a-5652bc6566d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:56.595367 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010d141f-4bff-4901-9f2a-5652bc6566d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:56.597435 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010d141f-4bff-4901-9f2a-5652bc6566d5 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:56.611185 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1027/2043] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:57:56 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:57:56.615521 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d141f-4bff-4901-9f2a-5652bc6566d5 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:56.616636 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:56.627917 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d141f-4bff-4901-9f2a-5652bc6566d5 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:56.633088 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4190151-5b2e-4d66-bf71-0adc303d1902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:56.633759 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4190151-5b2e-4d66-bf71-0adc303d1902 admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:56.634025 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4190151-5b2e-4d66-bf71-0adc303d1902 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:56.634297 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4190151-5b2e-4d66-bf71-0adc303d1902 admin admin] PATH_INFO: `/v3/projects/b00f1f5dd47444e9844bac4ab4e2fb60/users/885e926dd7e445958230453cbe8d8fdd/roles/ddb643577b2e4e478100ec370decfaeb` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:56.636397 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4190151-5b2e-4d66-bf71-0adc303d1902 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b00f1f5dd47444e9844bac4ab4e2fb60, user_id=885e926dd7e445958230453cbe8d8fdd, role_id=ddb643577b2e4e478100ec370decfaeb)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:56.639040 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4190151-5b2e-4d66-bf71-0adc303d1902 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:56.659284 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1028/2044] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 14:57:56 2022] PUT /identity/v3/projects/b00f1f5dd47444e9844bac4ab4e2fb60/users/885e926dd7e445958230453cbe8d8fdd/roles/ddb643577b2e4e478100ec370decfaeb => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:56.664844 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32c9924-bfa4-4c38-b3b4-a3d9050a08d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:56.667175 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32c9924-bfa4-4c38-b3b4-a3d9050a08d7 service cinder] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:56.671048 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990be174-8674-4870-af56-2cbe52e5a7e1 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:56.671999 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990be174-8674-4870-af56-2cbe52e5a7e1 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:56.672591 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990be174-8674-4870-af56-2cbe52e5a7e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:56.682753 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1017/2045] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:57:56 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:57:56.709471 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32c9924-bfa4-4c38-b3b4-a3d9050a08d7 service cinder] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:56.727561 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-990be174-8674-4870-af56-2cbe52e5a7e1 None None] MFA Rules not processed for user `885e926dd7e445958230453cbe8d8fdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:56.730752 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-990be174-8674-4870-af56-2cbe52e5a7e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:56.735407 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32c9924-bfa4-4c38-b3b4-a3d9050a08d7 service cinder] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:56.818474 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2caea21-df53-4f10-bd6d-44f4ec16d45a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:56.819404 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2caea21-df53-4f10-bd6d-44f4ec16d45a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:56.819709 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2caea21-df53-4f10-bd6d-44f4ec16d45a admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:56.820001 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2caea21-df53-4f10-bd6d-44f4ec16d45a admin admin] PATH_INFO: `/v3/users/2f7d573e77bb45b987946fbe1e29886e` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:56.822107 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2caea21-df53-4f10-bd6d-44f4ec16d45a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f7d573e77bb45b987946fbe1e29886e)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:56.824611 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2caea21-df53-4f10-bd6d-44f4ec16d45a admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:56.835276 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1029/2046] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:57:56 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:56.855494 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990be174-8674-4870-af56-2cbe52e5a7e1 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:56.879842 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:56.891868 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-d2caea21-df53-4f10-bd6d-44f4ec16d45a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f7d573e77bb45b987946fbe1e29886e'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:56.911595 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-d2caea21-df53-4f10-bd6d-44f4ec16d45a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f7d573e77bb45b987946fbe1e29886e'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:56.920461 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-d2caea21-df53-4f10-bd6d-44f4ec16d45a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f7d573e77bb45b987946fbe1e29886e'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:56.921362 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-d2caea21-df53-4f10-bd6d-44f4ec16d45a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f7d573e77bb45b987946fbe1e29886e'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:56.929471 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-d2caea21-df53-4f10-bd6d-44f4ec16d45a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f7d573e77bb45b987946fbe1e29886e'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:56.932157 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990be174-8674-4870-af56-2cbe52e5a7e1 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:56.936258 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a15fb6-a614-4fb6-85be-05f41d798e55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139dc7a4f1dc48fe8faea848bd1ac0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:56.937039 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1018/2047] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Sep 19 14:57:56 2022] DELETE /identity/v3/users/2f7d573e77bb45b987946fbe1e29886e => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:56.940591 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a15fb6-a614-4fb6-85be-05f41d798e55 service cinder] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:56.940980 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a15fb6-a614-4fb6-85be-05f41d798e55 service cinder] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:56.941334 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a15fb6-a614-4fb6-85be-05f41d798e55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:56.941936 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030df8c2-975b-4b32-995f-c956234e52dd None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:56.941936 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030df8c2-975b-4b32-995f-c956234e52dd None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:56.942157 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030df8c2-975b-4b32-995f-c956234e52dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:56.943614 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-97a15fb6-a614-4fb6-85be-05f41d798e55 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:56.961845 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a15fb6-a614-4fb6-85be-05f41d798e55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:56.963417 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a15fb6-a614-4fb6-85be-05f41d798e55 service cinder] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:56.967417 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-030df8c2-975b-4b32-995f-c956234e52dd None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:56.969914 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-030df8c2-975b-4b32-995f-c956234e52dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:56.978467 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1030/2048] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:57:56 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 14:57:57.040081 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:57.058834 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1019/2049] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:57:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:57.073472 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a15fb6-a614-4fb6-85be-05f41d798e55 service cinder] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:57.075729 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-97a15fb6-a614-4fb6-85be-05f41d798e55 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:57.175198 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a15fb6-a614-4fb6-85be-05f41d798e55 service cinder] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:57.188427 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030df8c2-975b-4b32-995f-c956234e52dd None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:57.190079 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-030df8c2-975b-4b32-995f-c956234e52dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:57.209679 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030df8c2-975b-4b32-995f-c956234e52dd None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:57.215767 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2fabe9-9552-4aed-9a86-f52f014ccbbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:57.216736 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2fabe9-9552-4aed-9a86-f52f014ccbbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:57.217013 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2fabe9-9552-4aed-9a86-f52f014ccbbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:57.217349 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2fabe9-9552-4aed-9a86-f52f014ccbbe admin admin] PATH_INFO: `/v3/users/a77db44564d5404fb238c3d3b289c151` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:57.219481 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2fabe9-9552-4aed-9a86-f52f014ccbbe admin admin] RBAC: Authorizing `identity:delete_user(user_id=a77db44564d5404fb238c3d3b289c151)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:57.221686 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2fabe9-9552-4aed-9a86-f52f014ccbbe admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:57.254964 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7c222f-99e6-4d09-ae2b-7e1b364baa94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c2b78646374cb79ded4b7b59ba49c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:57.255821 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c222f-99e6-4d09-ae2b-7e1b364baa94 service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:57.256117 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c222f-99e6-4d09-ae2b-7e1b364baa94 service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:57.256413 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c222f-99e6-4d09-ae2b-7e1b364baa94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:57.266219 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7c222f-99e6-4d09-ae2b-7e1b364baa94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:57.267639 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7c222f-99e6-4d09-ae2b-7e1b364baa94 service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:57.277306 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1031/2050] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:57:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:57:57.278878 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-3f2fabe9-9552-4aed-9a86-f52f014ccbbe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a77db44564d5404fb238c3d3b289c151'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:57.293417 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-3f2fabe9-9552-4aed-9a86-f52f014ccbbe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a77db44564d5404fb238c3d3b289c151'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:57.302619 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-3f2fabe9-9552-4aed-9a86-f52f014ccbbe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a77db44564d5404fb238c3d3b289c151'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:57.303435 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-3f2fabe9-9552-4aed-9a86-f52f014ccbbe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a77db44564d5404fb238c3d3b289c151'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:57.311279 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-3f2fabe9-9552-4aed-9a86-f52f014ccbbe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a77db44564d5404fb238c3d3b289c151'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:57.317885 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1020/2051] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Sep 19 14:57:57 2022] DELETE /identity/v3/users/a77db44564d5404fb238c3d3b289c151 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:57.322698 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18715a1-468f-4c45-bf5a-d87316eb0007 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:57.322981 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18715a1-468f-4c45-bf5a-d87316eb0007 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:57.323255 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18715a1-468f-4c45-bf5a-d87316eb0007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:57.344112 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-f18715a1-468f-4c45-bf5a-d87316eb0007 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:57.345389 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-f18715a1-468f-4c45-bf5a-d87316eb0007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:57.408380 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1032/2052] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:57:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:57.418798 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2fabe9-9552-4aed-9a86-f52f014ccbbe admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:57.420713 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-3f2fabe9-9552-4aed-9a86-f52f014ccbbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:57.516290 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2fabe9-9552-4aed-9a86-f52f014ccbbe admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:57.522665 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999c934a-f21d-4c06-9f0f-ab0f72652fc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c2b78646374cb79ded4b7b59ba49c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:57.523291 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999c934a-f21d-4c06-9f0f-ab0f72652fc5 service neutron] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:57.523628 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999c934a-f21d-4c06-9f0f-ab0f72652fc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:57.525353 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999c934a-f21d-4c06-9f0f-ab0f72652fc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:57.544713 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999c934a-f21d-4c06-9f0f-ab0f72652fc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:57.546662 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999c934a-f21d-4c06-9f0f-ab0f72652fc5 service neutron] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:57.594959 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1021/2053] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:57:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:57:57.610288 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18715a1-468f-4c45-bf5a-d87316eb0007 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:57.612262 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-f18715a1-468f-4c45-bf5a-d87316eb0007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:57.631471 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18715a1-468f-4c45-bf5a-d87316eb0007 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:57.653985 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c1731c-3488-4a93-9f84-547cfe832c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:57.655073 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c1731c-3488-4a93-9f84-547cfe832c43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:57.656042 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c1731c-3488-4a93-9f84-547cfe832c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:57.656515 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c1731c-3488-4a93-9f84-547cfe832c43 admin admin] PATH_INFO: `/v3/projects/326c01ab4f444ba988c9f7bab4f1791f` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:57.658513 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c1731c-3488-4a93-9f84-547cfe832c43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=326c01ab4f444ba988c9f7bab4f1791f)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:57.660532 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c1731c-3488-4a93-9f84-547cfe832c43 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:57.681397 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:57.732014 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-e4c1731c-3488-4a93-9f84-547cfe832c43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '326c01ab4f444ba988c9f7bab4f1791f', 'request_id': 'req-e4c1731c-3488-4a93-9f84-547cfe832c43'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:57.740990 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-e4c1731c-3488-4a93-9f84-547cfe832c43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '326c01ab4f444ba988c9f7bab4f1791f', 'request_id': 'req-e4c1731c-3488-4a93-9f84-547cfe832c43'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:57.748298 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-e4c1731c-3488-4a93-9f84-547cfe832c43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '326c01ab4f444ba988c9f7bab4f1791f', 'request_id': 'req-e4c1731c-3488-4a93-9f84-547cfe832c43'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:57.766709 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-e4c1731c-3488-4a93-9f84-547cfe832c43 admin admin] The token cache is being invalidate because project 326c01ab4f444ba988c9f7bab4f1791f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 14:57:57.766709 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-e4c1731c-3488-4a93-9f84-547cfe832c43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:57.767618 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-e4c1731c-3488-4a93-9f84-547cfe832c43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:57.769802 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1033/2054] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Sep 19 14:57:57 2022] DELETE /identity/v3/projects/326c01ab4f444ba988c9f7bab4f1791f => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 14:57:57.773986 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508bc56d-da14-4d21-a318-16344cb5ed68 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:57.774437 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508bc56d-da14-4d21-a318-16344cb5ed68 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:57.774512 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508bc56d-da14-4d21-a318-16344cb5ed68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:57.826897 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-508bc56d-da14-4d21-a318-16344cb5ed68 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:57.828369 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-508bc56d-da14-4d21-a318-16344cb5ed68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:57.972663 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1022/2055] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:57:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:57.977508 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f0ecaa-f597-478b-ad9f-90eca169c151 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:57.977893 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f0ecaa-f597-478b-ad9f-90eca169c151 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:57.980564 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f0ecaa-f597-478b-ad9f-90eca169c151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:58.015991 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-c1f0ecaa-f597-478b-ad9f-90eca169c151 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:58.017567 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-c1f0ecaa-f597-478b-ad9f-90eca169c151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:58.021893 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508bc56d-da14-4d21-a318-16344cb5ed68 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:58.023326 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-508bc56d-da14-4d21-a318-16344cb5ed68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:58.032136 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1034/2056] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:57:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:58.033170 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f0ecaa-f597-478b-ad9f-90eca169c151 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:58.042377 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508bc56d-da14-4d21-a318-16344cb5ed68 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:58.043734 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f0ecaa-f597-478b-ad9f-90eca169c151 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:58.053629 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f2c383-bf5e-4944-b5b9-ea8e6d8a1422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:58.054387 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f2c383-bf5e-4944-b5b9-ea8e6d8a1422 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:58.054788 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f2c383-bf5e-4944-b5b9-ea8e6d8a1422 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:58.055364 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f2c383-bf5e-4944-b5b9-ea8e6d8a1422 admin admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:58.056474 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f2c383-bf5e-4944-b5b9-ea8e6d8a1422 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:57:58.056933 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f2c383-bf5e-4944-b5b9-ea8e6d8a1422 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:58.058350 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317f0348-6543-4784-a653-33dcd9b82289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:58.059030 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317f0348-6543-4784-a653-33dcd9b82289 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:58.059314 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317f0348-6543-4784-a653-33dcd9b82289 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:58.059586 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317f0348-6543-4784-a653-33dcd9b82289 admin admin] PATH_INFO: `/v3/projects/f1021e8ba25f45fc8fa6d6043fdc09e6` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:58.062219 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f2c383-bf5e-4944-b5b9-ea8e6d8a1422 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:58.065182 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317f0348-6543-4784-a653-33dcd9b82289 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1021e8ba25f45fc8fa6d6043fdc09e6)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:58.069946 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317f0348-6543-4784-a653-33dcd9b82289 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:58.074085 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:58.103119 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1035/2057] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Sep 19 14:57:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:57:58.105016 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f2c383-bf5e-4944-b5b9-ea8e6d8a1422 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:58.116911 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f2c383-bf5e-4944-b5b9-ea8e6d8a1422 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:58.124175 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11da12a-14f5-4345-ba6f-f6eb9aa4a57a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:58.124845 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11da12a-14f5-4345-ba6f-f6eb9aa4a57a admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:58.125128 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11da12a-14f5-4345-ba6f-f6eb9aa4a57a admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:58.125402 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11da12a-14f5-4345-ba6f-f6eb9aa4a57a admin admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:58.126104 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11da12a-14f5-4345-ba6f-f6eb9aa4a57a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:58.128909 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11da12a-14f5-4345-ba6f-f6eb9aa4a57a admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:58.176236 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1036/2058] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Sep 19 14:57:58 2022] POST /identity/v3/projects => generated 365 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:57:58.176717 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-317f0348-6543-4784-a653-33dcd9b82289 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1021e8ba25f45fc8fa6d6043fdc09e6', 'request_id': 'req-317f0348-6543-4784-a653-33dcd9b82289'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:58.177160 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11da12a-14f5-4345-ba6f-f6eb9aa4a57a admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:58.188370 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-317f0348-6543-4784-a653-33dcd9b82289 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1021e8ba25f45fc8fa6d6043fdc09e6', 'request_id': 'req-317f0348-6543-4784-a653-33dcd9b82289'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:58.204309 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-317f0348-6543-4784-a653-33dcd9b82289 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1021e8ba25f45fc8fa6d6043fdc09e6', 'request_id': 'req-317f0348-6543-4784-a653-33dcd9b82289'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:58.238775 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-317f0348-6543-4784-a653-33dcd9b82289 admin admin] The token cache is being invalidate because project f1021e8ba25f45fc8fa6d6043fdc09e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 14:57:58.239144 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-317f0348-6543-4784-a653-33dcd9b82289 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:58.240024 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-317f0348-6543-4784-a653-33dcd9b82289 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:58.242035 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1023/2059] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Sep 19 14:57:58 2022] DELETE /identity/v3/projects/f1021e8ba25f45fc8fa6d6043fdc09e6 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:58.245875 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317f0348-6543-4784-a653-33dcd9b82289 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:58.247488 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-317f0348-6543-4784-a653-33dcd9b82289 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:58.270031 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11da12a-14f5-4345-ba6f-f6eb9aa4a57a admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:58.284642 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e011059-65f2-4246-8934-3c784a0b45f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:58.285418 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e011059-65f2-4246-8934-3c784a0b45f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:58.285732 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e011059-65f2-4246-8934-3c784a0b45f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:58.287240 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e011059-65f2-4246-8934-3c784a0b45f6 admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:58.287546 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e011059-65f2-4246-8934-3c784a0b45f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:58.295090 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e011059-65f2-4246-8934-3c784a0b45f6 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:58.338356 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1037/2060] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Sep 19 14:57:58 2022] POST /identity/v3/users => generated 283 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:57:58.343429 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e011059-65f2-4246-8934-3c784a0b45f6 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:58.345584 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-5e011059-65f2-4246-8934-3c784a0b45f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:58.362125 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e011059-65f2-4246-8934-3c784a0b45f6 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:58.367268 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43b9347-d269-4a40-8e0f-e685bef220c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:58.368114 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43b9347-d269-4a40-8e0f-e685bef220c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:58.368428 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43b9347-d269-4a40-8e0f-e685bef220c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:58.368726 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43b9347-d269-4a40-8e0f-e685bef220c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:58.369425 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43b9347-d269-4a40-8e0f-e685bef220c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:58.371745 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43b9347-d269-4a40-8e0f-e685bef220c6 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:58.387582 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1038/2061] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:57:58 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 14:57:58.389357 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43b9347-d269-4a40-8e0f-e685bef220c6 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:58.401355 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43b9347-d269-4a40-8e0f-e685bef220c6 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:58.407930 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17bf393-4ee3-4a66-a935-abca783556c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:58.408583 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317f0348-6543-4784-a653-33dcd9b82289 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:58.409755 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17bf393-4ee3-4a66-a935-abca783556c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:58.410050 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17bf393-4ee3-4a66-a935-abca783556c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:58.410331 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17bf393-4ee3-4a66-a935-abca783556c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:58.411021 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17bf393-4ee3-4a66-a935-abca783556c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:58.412692 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17bf393-4ee3-4a66-a935-abca783556c0 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:58.422282 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c069fb7-f317-4cf0-9d78-9e14fbe1e24e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:58.422954 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c069fb7-f317-4cf0-9d78-9e14fbe1e24e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:58.423406 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c069fb7-f317-4cf0-9d78-9e14fbe1e24e admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:58.423687 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c069fb7-f317-4cf0-9d78-9e14fbe1e24e admin admin] PATH_INFO: `/v3/users/885e926dd7e445958230453cbe8d8fdd` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:58.426723 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c069fb7-f317-4cf0-9d78-9e14fbe1e24e admin admin] RBAC: Authorizing `identity:delete_user(user_id=885e926dd7e445958230453cbe8d8fdd)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:58.430312 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c069fb7-f317-4cf0-9d78-9e14fbe1e24e admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:58.441683 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1039/2062] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:57:58 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:57:58.446543 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17bf393-4ee3-4a66-a935-abca783556c0 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:58.481309 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17bf393-4ee3-4a66-a935-abca783556c0 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:58.496407 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b71f5ff-f3bf-4957-beb0-46f12049d956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:58.497342 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b71f5ff-f3bf-4957-beb0-46f12049d956 admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:58.497848 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b71f5ff-f3bf-4957-beb0-46f12049d956 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:58.498278 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b71f5ff-f3bf-4957-beb0-46f12049d956 admin admin] PATH_INFO: `/v3/projects/23112d7a7c80480685ef03b90c6709d1/users/11405aa07bb04e7fafc092787d5b4e9a/roles/efa0e5b3413748dc828a89b12d67df79` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:58.514069 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-2c069fb7-f317-4cf0-9d78-9e14fbe1e24e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '885e926dd7e445958230453cbe8d8fdd'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:58.533191 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-2c069fb7-f317-4cf0-9d78-9e14fbe1e24e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '885e926dd7e445958230453cbe8d8fdd'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:58.541244 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b71f5ff-f3bf-4957-beb0-46f12049d956 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23112d7a7c80480685ef03b90c6709d1, user_id=11405aa07bb04e7fafc092787d5b4e9a, role_id=efa0e5b3413748dc828a89b12d67df79)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:58.544616 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b71f5ff-f3bf-4957-beb0-46f12049d956 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:58.545807 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-2c069fb7-f317-4cf0-9d78-9e14fbe1e24e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '885e926dd7e445958230453cbe8d8fdd'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:58.546743 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-2c069fb7-f317-4cf0-9d78-9e14fbe1e24e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '885e926dd7e445958230453cbe8d8fdd'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:58.561406 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-2c069fb7-f317-4cf0-9d78-9e14fbe1e24e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '885e926dd7e445958230453cbe8d8fdd'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:58.571186 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1024/2063] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Sep 19 14:57:58 2022] DELETE /identity/v3/users/885e926dd7e445958230453cbe8d8fdd => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:58.589608 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1040/2064] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 14:57:58 2022] PUT /identity/v3/projects/23112d7a7c80480685ef03b90c6709d1/users/11405aa07bb04e7fafc092787d5b4e9a/roles/efa0e5b3413748dc828a89b12d67df79 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:58.602224 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549291ca-6a7d-4347-9d1a-56c2eef3b9c1 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:58.603226 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549291ca-6a7d-4347-9d1a-56c2eef3b9c1 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:58.603514 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549291ca-6a7d-4347-9d1a-56c2eef3b9c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:58.641971 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:58.685072 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-549291ca-6a7d-4347-9d1a-56c2eef3b9c1 None None] MFA Rules not processed for user `11405aa07bb04e7fafc092787d5b4e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:58.686320 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-549291ca-6a7d-4347-9d1a-56c2eef3b9c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:58.808820 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1025/2065] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:57:58 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 14:57:58.828317 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b71f5ff-f3bf-4957-beb0-46f12049d956 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:58.831331 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-0b71f5ff-f3bf-4957-beb0-46f12049d956 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:58.842993 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:INSERT=6 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:58.917471 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b71f5ff-f3bf-4957-beb0-46f12049d956 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:58.982605 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9544323-1a2f-4940-9772-160f47a44b5c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139dc7a4f1dc48fe8faea848bd1ac0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:58.983217 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9544323-1a2f-4940-9772-160f47a44b5c service cinder] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:58.984237 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9544323-1a2f-4940-9772-160f47a44b5c service cinder] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:58.984455 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9544323-1a2f-4940-9772-160f47a44b5c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:58.993395 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9544323-1a2f-4940-9772-160f47a44b5c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:58.994920 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9544323-1a2f-4940-9772-160f47a44b5c service cinder] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:59.005649 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1041/2066] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:57:58 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:57:59.265804 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549291ca-6a7d-4347-9d1a-56c2eef3b9c1 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:59.268253 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-549291ca-6a7d-4347-9d1a-56c2eef3b9c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:59.400568 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549291ca-6a7d-4347-9d1a-56c2eef3b9c1 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:59.417035 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ea1c90-1642-40a4-999d-8e540b1c6368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:59.417854 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ea1c90-1642-40a4-999d-8e540b1c6368 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:59.418193 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ea1c90-1642-40a4-999d-8e540b1c6368 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:59.418393 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ea1c90-1642-40a4-999d-8e540b1c6368 admin admin] PATH_INFO: `/v3/projects/b00f1f5dd47444e9844bac4ab4e2fb60` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:59.419601 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ea1c90-1642-40a4-999d-8e540b1c6368 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b00f1f5dd47444e9844bac4ab4e2fb60)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:59.422363 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ea1c90-1642-40a4-999d-8e540b1c6368 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:59.481139 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-28ea1c90-1642-40a4-999d-8e540b1c6368 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b00f1f5dd47444e9844bac4ab4e2fb60', 'request_id': 'req-28ea1c90-1642-40a4-999d-8e540b1c6368'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:59.489833 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-28ea1c90-1642-40a4-999d-8e540b1c6368 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b00f1f5dd47444e9844bac4ab4e2fb60', 'request_id': 'req-28ea1c90-1642-40a4-999d-8e540b1c6368'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:59.497691 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-28ea1c90-1642-40a4-999d-8e540b1c6368 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b00f1f5dd47444e9844bac4ab4e2fb60', 'request_id': 'req-28ea1c90-1642-40a4-999d-8e540b1c6368'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:59.518930 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-28ea1c90-1642-40a4-999d-8e540b1c6368 admin admin] The token cache is being invalidate because project b00f1f5dd47444e9844bac4ab4e2fb60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 14:57:59.519229 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-28ea1c90-1642-40a4-999d-8e540b1c6368 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:59.519896 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-28ea1c90-1642-40a4-999d-8e540b1c6368 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:59.521524 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1026/2067] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Sep 19 14:57:59 2022] DELETE /identity/v3/projects/b00f1f5dd47444e9844bac4ab4e2fb60 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:59.526846 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d16e44-b4a0-49a2-b6cd-3f91f16e75e9 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:59.527137 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d16e44-b4a0-49a2-b6cd-3f91f16e75e9 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:59.527413 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d16e44-b4a0-49a2-b6cd-3f91f16e75e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:59.549377 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-94d16e44-b4a0-49a2-b6cd-3f91f16e75e9 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:59.550592 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-94d16e44-b4a0-49a2-b6cd-3f91f16e75e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:59.622682 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1042/2068] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:57:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:59.630907 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243982f6-4297-4ec9-9c7e-f6abc2f1a478 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:59.631196 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243982f6-4297-4ec9-9c7e-f6abc2f1a478 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:59.631470 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243982f6-4297-4ec9-9c7e-f6abc2f1a478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:59.655172 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-243982f6-4297-4ec9-9c7e-f6abc2f1a478 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:59.656642 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-243982f6-4297-4ec9-9c7e-f6abc2f1a478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:59.665099 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1027/2069] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:57:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:59.669303 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d16e44-b4a0-49a2-b6cd-3f91f16e75e9 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:59.682045 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d16e44-b4a0-49a2-b6cd-3f91f16e75e9 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:59.687548 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c998047-4627-47a6-8c4d-5621d9745761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:59.688161 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c998047-4627-47a6-8c4d-5621d9745761 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:59.688506 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c998047-4627-47a6-8c4d-5621d9745761 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:59.688792 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c998047-4627-47a6-8c4d-5621d9745761 admin admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:59.690051 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c998047-4627-47a6-8c4d-5621d9745761 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:57:59.690051 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c998047-4627-47a6-8c4d-5621d9745761 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:59.691364 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c998047-4627-47a6-8c4d-5621d9745761 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:59.712361 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1043/2070] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Sep 19 14:57:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:57:59.714104 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243982f6-4297-4ec9-9c7e-f6abc2f1a478 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:59.724653 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243982f6-4297-4ec9-9c7e-f6abc2f1a478 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:59.738942 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afd63c4-8c4a-469e-acbb-9887bf44fc79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:59.739568 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd63c4-8c4a-469e-acbb-9887bf44fc79 admin admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:59.739850 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd63c4-8c4a-469e-acbb-9887bf44fc79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:59.740702 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd63c4-8c4a-469e-acbb-9887bf44fc79 admin admin] PATH_INFO: `/v3/projects` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:59.741336 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afd63c4-8c4a-469e-acbb-9887bf44fc79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:59.743237 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afd63c4-8c4a-469e-acbb-9887bf44fc79 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:59.790664 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:59.799320 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1028/2071] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Sep 19 14:57:59 2022] POST /identity/v3/projects => generated 409 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 14:57:59.802765 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c998047-4627-47a6-8c4d-5621d9745761 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:59.814192 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c998047-4627-47a6-8c4d-5621d9745761 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:59.875257 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:59.889441 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05991e3f-d3ce-40d3-af9d-557dd5e82a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:59.890090 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05991e3f-d3ce-40d3-af9d-557dd5e82a54 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:59.890319 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05991e3f-d3ce-40d3-af9d-557dd5e82a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:59.890684 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05991e3f-d3ce-40d3-af9d-557dd5e82a54 admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:59.891225 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05991e3f-d3ce-40d3-af9d-557dd5e82a54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:59.893225 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05991e3f-d3ce-40d3-af9d-557dd5e82a54 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:59.930434 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1044/2072] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Sep 19 14:57:59 2022] POST /identity/v3/users => generated 305 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 14:57:59.931519 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afd63c4-8c4a-469e-acbb-9887bf44fc79 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:59.943426 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afd63c4-8c4a-469e-acbb-9887bf44fc79 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:59.951077 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c92c49-34c0-461f-b31a-9f00b607286f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:59.951696 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c92c49-34c0-461f-b31a-9f00b607286f admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:59.952266 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c92c49-34c0-461f-b31a-9f00b607286f admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:59.952266 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c92c49-34c0-461f-b31a-9f00b607286f admin admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:59.952984 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c92c49-34c0-461f-b31a-9f00b607286f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:59.954642 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c92c49-34c0-461f-b31a-9f00b607286f admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:59.970847 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05991e3f-d3ce-40d3-af9d-557dd5e82a54 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:59.972448 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-05991e3f-d3ce-40d3-af9d-557dd5e82a54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:59.976185 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1029/2073] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:57:59 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:57:59.980044 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c92c49-34c0-461f-b31a-9f00b607286f admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:59.986959 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05991e3f-d3ce-40d3-af9d-557dd5e82a54 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:59.992527 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3331c1fd-acd0-4e57-b8b7-23fc379b8faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:59.992849 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c92c49-34c0-461f-b31a-9f00b607286f admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:59.993318 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3331c1fd-acd0-4e57-b8b7-23fc379b8faa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:59.993671 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3331c1fd-acd0-4e57-b8b7-23fc379b8faa admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:59.994051 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3331c1fd-acd0-4e57-b8b7-23fc379b8faa admin admin] PATH_INFO: `/v3/users/b5592bcf57c9486d93464e6d3362b614` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:59.995379 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3331c1fd-acd0-4e57-b8b7-23fc379b8faa admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5592bcf57c9486d93464e6d3362b614)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:59.997929 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3331c1fd-acd0-4e57-b8b7-23fc379b8faa admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:00.000235 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac313d83-a2f7-4cf1-900f-623dad2654a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:00.001118 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac313d83-a2f7-4cf1-900f-623dad2654a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:00.001571 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac313d83-a2f7-4cf1-900f-623dad2654a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:00.002126 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac313d83-a2f7-4cf1-900f-623dad2654a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:00.002961 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac313d83-a2f7-4cf1-900f-623dad2654a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:00.005013 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac313d83-a2f7-4cf1-900f-623dad2654a7 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:00.027933 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1030/2074] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:57:59 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:58:00.034750 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac313d83-a2f7-4cf1-900f-623dad2654a7 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:00.048607 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac313d83-a2f7-4cf1-900f-623dad2654a7 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:00.055809 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc12a3d-3a88-4a93-a1b9-cb0ea31ea9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:00.056606 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc12a3d-3a88-4a93-a1b9-cb0ea31ea9fe admin admin] REQUEST_METHOD: `PUT` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:00.056893 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc12a3d-3a88-4a93-a1b9-cb0ea31ea9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:00.057389 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc12a3d-3a88-4a93-a1b9-cb0ea31ea9fe admin admin] PATH_INFO: `/v3/projects/b4ac6e7b3d2a4e1a82bfc416ab0436a8/users/50d5d413a5724ea298ecb47d1aff84eb/roles/efa0e5b3413748dc828a89b12d67df79` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:00.084979 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc12a3d-3a88-4a93-a1b9-cb0ea31ea9fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4ac6e7b3d2a4e1a82bfc416ab0436a8, user_id=50d5d413a5724ea298ecb47d1aff84eb, role_id=efa0e5b3413748dc828a89b12d67df79)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:00.088150 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc12a3d-3a88-4a93-a1b9-cb0ea31ea9fe admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:00.092546 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-3331c1fd-acd0-4e57-b8b7-23fc379b8faa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5592bcf57c9486d93464e6d3362b614'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:00.106021 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1031/2075] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 14:58:00 2022] PUT /identity/v3/projects/b4ac6e7b3d2a4e1a82bfc416ab0436a8/users/50d5d413a5724ea298ecb47d1aff84eb/roles/efa0e5b3413748dc828a89b12d67df79 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:58:00.121027 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb77eeca-cc2e-469b-87a4-6b91282a1c3b None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:00.121027 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb77eeca-cc2e-469b-87a4-6b91282a1c3b None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:00.121027 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb77eeca-cc2e-469b-87a4-6b91282a1c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:00.128941 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-3331c1fd-acd0-4e57-b8b7-23fc379b8faa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5592bcf57c9486d93464e6d3362b614'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:00.143030 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-3331c1fd-acd0-4e57-b8b7-23fc379b8faa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5592bcf57c9486d93464e6d3362b614'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:00.170784 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-3331c1fd-acd0-4e57-b8b7-23fc379b8faa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5592bcf57c9486d93464e6d3362b614'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:00.172732 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-3331c1fd-acd0-4e57-b8b7-23fc379b8faa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5592bcf57c9486d93464e6d3362b614'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:00.200535 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-cb77eeca-cc2e-469b-87a4-6b91282a1c3b None None] MFA Rules not processed for user `50d5d413a5724ea298ecb47d1aff84eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:58:00.201774 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-cb77eeca-cc2e-469b-87a4-6b91282a1c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:00.210292 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1045/2076] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Sep 19 14:57:59 2022] DELETE /identity/v3/users/b5592bcf57c9486d93464e6d3362b614 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 14:58:00.212806 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f27ab7-0c8f-4398-82a8-b3a82884ad9d None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:00.212806 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f27ab7-0c8f-4398-82a8-b3a82884ad9d None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:00.212806 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f27ab7-0c8f-4398-82a8-b3a82884ad9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:00.294100 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-31f27ab7-0c8f-4398-82a8-b3a82884ad9d None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:58:00.295469 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-31f27ab7-0c8f-4398-82a8-b3a82884ad9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:00.401900 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1032/2077] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:58:00 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 14:58:00.427917 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb77eeca-cc2e-469b-87a4-6b91282a1c3b None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:00.430669 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-cb77eeca-cc2e-469b-87a4-6b91282a1c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:00.447444 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1046/2078] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:58:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 14:58:00.507537 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f27ab7-0c8f-4398-82a8-b3a82884ad9d None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:00.510165 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-31f27ab7-0c8f-4398-82a8-b3a82884ad9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:00.586259 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb77eeca-cc2e-469b-87a4-6b91282a1c3b None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:00.597403 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d15ed17-c470-4377-94c4-b5cbc1549a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:00.598027 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d15ed17-c470-4377-94c4-b5cbc1549a17 admin admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:00.598508 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d15ed17-c470-4377-94c4-b5cbc1549a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:00.598960 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d15ed17-c470-4377-94c4-b5cbc1549a17 admin admin] PATH_INFO: `/v3/projects` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:00.599862 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d15ed17-c470-4377-94c4-b5cbc1549a17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:00.622666 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d15ed17-c470-4377-94c4-b5cbc1549a17 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:00.641107 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f27ab7-0c8f-4398-82a8-b3a82884ad9d None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:00.648674 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59144343-638f-4545-bdc7-0b127230ee01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c2b78646374cb79ded4b7b59ba49c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:00.649341 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59144343-638f-4545-bdc7-0b127230ee01 service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:00.649734 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59144343-638f-4545-bdc7-0b127230ee01 service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:00.650017 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59144343-638f-4545-bdc7-0b127230ee01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:00.666120 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59144343-638f-4545-bdc7-0b127230ee01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:00.668134 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59144343-638f-4545-bdc7-0b127230ee01 service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:00.674238 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:00.680286 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1033/2079] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Sep 19 14:58:00 2022] POST /identity/v3/projects => generated 409 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:58:00.681288 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d15ed17-c470-4377-94c4-b5cbc1549a17 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:00.687739 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1047/2080] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:58:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 14:58:00.747163 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:00.794083 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d15ed17-c470-4377-94c4-b5cbc1549a17 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:00.804611 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63341880-a96d-4397-b9df-0a06b9c9bcb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:00.805252 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63341880-a96d-4397-b9df-0a06b9c9bcb8 admin admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:00.805537 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63341880-a96d-4397-b9df-0a06b9c9bcb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:00.805814 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63341880-a96d-4397-b9df-0a06b9c9bcb8 admin admin] PATH_INFO: `/v3/users` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:00.806466 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63341880-a96d-4397-b9df-0a06b9c9bcb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:00.808415 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63341880-a96d-4397-b9df-0a06b9c9bcb8 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:00.852349 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1034/2081] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Sep 19 14:58:00 2022] POST /identity/v3/users => generated 311 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:58:00.856230 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59144343-638f-4545-bdc7-0b127230ee01 service neutron] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:00.866699 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59144343-638f-4545-bdc7-0b127230ee01 service neutron] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:00.871485 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e415b2-32fb-46a4-801f-14cd27c7e40e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:00.872410 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e415b2-32fb-46a4-801f-14cd27c7e40e admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:00.873489 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e415b2-32fb-46a4-801f-14cd27c7e40e admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:00.873784 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e415b2-32fb-46a4-801f-14cd27c7e40e admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:00.875098 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e415b2-32fb-46a4-801f-14cd27c7e40e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:00.877364 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e415b2-32fb-46a4-801f-14cd27c7e40e admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:00.902281 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1048/2082] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:58:00 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:58:00.906789 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63341880-a96d-4397-b9df-0a06b9c9bcb8 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:00.923286 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63341880-a96d-4397-b9df-0a06b9c9bcb8 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:00.963880 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6219a0-f7ab-437c-97d7-b13eed6aeee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:00.964687 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6219a0-f7ab-437c-97d7-b13eed6aeee5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:00.964918 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6219a0-f7ab-437c-97d7-b13eed6aeee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:00.965200 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6219a0-f7ab-437c-97d7-b13eed6aeee5 admin admin] PATH_INFO: `/v3/projects/73718a65c0174c0386342eebfbd2fc4b/users/9656334917264af7b80175c67794d5f5/roles/ddb643577b2e4e478100ec370decfaeb` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:00.993914 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6219a0-f7ab-437c-97d7-b13eed6aeee5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73718a65c0174c0386342eebfbd2fc4b, user_id=9656334917264af7b80175c67794d5f5, role_id=ddb643577b2e4e478100ec370decfaeb)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:01.000051 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6219a0-f7ab-437c-97d7-b13eed6aeee5 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:01.020214 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1035/2083] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 14:58:00 2022] PUT /identity/v3/projects/73718a65c0174c0386342eebfbd2fc4b/users/9656334917264af7b80175c67794d5f5/roles/ddb643577b2e4e478100ec370decfaeb => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 14:58:01.024435 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e415b2-32fb-46a4-801f-14cd27c7e40e admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:01.036442 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e415b2-32fb-46a4-801f-14cd27c7e40e admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:01.106590 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1efac1-1c62-4f94-a561-ca6f7a3d285a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:01.107149 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1efac1-1c62-4f94-a561-ca6f7a3d285a admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:01.107439 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1efac1-1c62-4f94-a561-ca6f7a3d285a admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:01.107720 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1efac1-1c62-4f94-a561-ca6f7a3d285a admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:01.109111 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1efac1-1c62-4f94-a561-ca6f7a3d285a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:01.110846 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1efac1-1c62-4f94-a561-ca6f7a3d285a admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:01.128968 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1049/2084] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:58:01 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 14:58:01.133386 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6219a0-f7ab-437c-97d7-b13eed6aeee5 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:01.152537 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6219a0-f7ab-437c-97d7-b13eed6aeee5 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:01.162862 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd5ddbd-7e5f-42e4-984c-93f517cfcba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:01.163081 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd5ddbd-7e5f-42e4-984c-93f517cfcba3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:01.163323 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd5ddbd-7e5f-42e4-984c-93f517cfcba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:01.163597 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd5ddbd-7e5f-42e4-984c-93f517cfcba3 admin admin] PATH_INFO: `/v3/projects/73718a65c0174c0386342eebfbd2fc4b/users/9656334917264af7b80175c67794d5f5/roles/ddb643577b2e4e478100ec370decfaeb` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:01.167565 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd5ddbd-7e5f-42e4-984c-93f517cfcba3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73718a65c0174c0386342eebfbd2fc4b, user_id=9656334917264af7b80175c67794d5f5, role_id=ddb643577b2e4e478100ec370decfaeb)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:01.172917 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd5ddbd-7e5f-42e4-984c-93f517cfcba3 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:01.219130 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1036/2085] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 14:58:01 2022] PUT /identity/v3/projects/73718a65c0174c0386342eebfbd2fc4b/users/9656334917264af7b80175c67794d5f5/roles/ddb643577b2e4e478100ec370decfaeb => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:58:01.229961 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a4613-41da-44d8-a52c-9d2a6e88bfaf None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:01.230861 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a4613-41da-44d8-a52c-9d2a6e88bfaf None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:01.231137 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a4613-41da-44d8-a52c-9d2a6e88bfaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:01.303659 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-f10a4613-41da-44d8-a52c-9d2a6e88bfaf None None] MFA Rules not processed for user `9656334917264af7b80175c67794d5f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:58:01.306007 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-f10a4613-41da-44d8-a52c-9d2a6e88bfaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:01.468595 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1050/2086] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:58:01 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:58:01.480765 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd5ddbd-7e5f-42e4-984c-93f517cfcba3 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:01.482523 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-6bd5ddbd-7e5f-42e4-984c-93f517cfcba3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:01.588773 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd5ddbd-7e5f-42e4-984c-93f517cfcba3 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:01.593478 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4670b693-3721-4319-b289-be352fd41b7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139dc7a4f1dc48fe8faea848bd1ac0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:01.594240 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4670b693-3721-4319-b289-be352fd41b7e service cinder] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:01.594626 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4670b693-3721-4319-b289-be352fd41b7e service cinder] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:01.595094 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4670b693-3721-4319-b289-be352fd41b7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:01.616742 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4670b693-3721-4319-b289-be352fd41b7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:01.618666 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4670b693-3721-4319-b289-be352fd41b7e service cinder] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:01.645224 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1037/2087] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:58:01 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:58:01.783868 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10a4613-41da-44d8-a52c-9d2a6e88bfaf None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:01.785830 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-f10a4613-41da-44d8-a52c-9d2a6e88bfaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:01.993754 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10a4613-41da-44d8-a52c-9d2a6e88bfaf None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:01.997807 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4670b693-3721-4319-b289-be352fd41b7e service cinder] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:01.998763 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8887e2-3ad1-47b9-8e63-3a6f033800b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:02.000235 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8887e2-3ad1-47b9-8e63-3a6f033800b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:02.000656 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8887e2-3ad1-47b9-8e63-3a6f033800b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:02.000922 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8887e2-3ad1-47b9-8e63-3a6f033800b0 admin admin] PATH_INFO: `/v3/projects/7ffd6df0da7b459e8027e2f317cc1599` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:02.002026 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8887e2-3ad1-47b9-8e63-3a6f033800b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ffd6df0da7b459e8027e2f317cc1599)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:02.003869 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8887e2-3ad1-47b9-8e63-3a6f033800b0 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:02.022597 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:02.032456 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4670b693-3721-4319-b289-be352fd41b7e service cinder] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:02.062341 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e83fa80-1c28-4a26-ae2a-d4443469377b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139dc7a4f1dc48fe8faea848bd1ac0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:02.062997 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e83fa80-1c28-4a26-ae2a-d4443469377b service cinder] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:02.063272 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e83fa80-1c28-4a26-ae2a-d4443469377b service cinder] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:02.063549 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e83fa80-1c28-4a26-ae2a-d4443469377b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:02.091616 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-6b8887e2-3ad1-47b9-8e63-3a6f033800b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ffd6df0da7b459e8027e2f317cc1599', 'request_id': 'req-6b8887e2-3ad1-47b9-8e63-3a6f033800b0'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:02.100675 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-6b8887e2-3ad1-47b9-8e63-3a6f033800b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ffd6df0da7b459e8027e2f317cc1599', 'request_id': 'req-6b8887e2-3ad1-47b9-8e63-3a6f033800b0'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:02.108759 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-6b8887e2-3ad1-47b9-8e63-3a6f033800b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ffd6df0da7b459e8027e2f317cc1599', 'request_id': 'req-6b8887e2-3ad1-47b9-8e63-3a6f033800b0'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:02.122766 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-6b8887e2-3ad1-47b9-8e63-3a6f033800b0 admin admin] The token cache is being invalidate because project 7ffd6df0da7b459e8027e2f317cc1599 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 14:58:02.123900 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-6b8887e2-3ad1-47b9-8e63-3a6f033800b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:02.124717 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-6b8887e2-3ad1-47b9-8e63-3a6f033800b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:02.126265 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1051/2088] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Sep 19 14:58:01 2022] DELETE /identity/v3/projects/7ffd6df0da7b459e8027e2f317cc1599 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:58:02.131418 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f6795-15d4-4750-b53f-130d7f80fb42 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:02.131794 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f6795-15d4-4750-b53f-130d7f80fb42 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:02.132081 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f6795-15d4-4750-b53f-130d7f80fb42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:02.168575 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-666f6795-15d4-4750-b53f-130d7f80fb42 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:58:02.169834 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-666f6795-15d4-4750-b53f-130d7f80fb42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:02.177565 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e83fa80-1c28-4a26-ae2a-d4443469377b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:02.179253 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e83fa80-1c28-4a26-ae2a-d4443469377b service cinder] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:02.205367 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1038/2089] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:58:01 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 14:58:02.249378 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1052/2090] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:58:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:58:02.262024 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42edad9-c4ea-4f06-a062-31b2e12f1823 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:02.266344 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42edad9-c4ea-4f06-a062-31b2e12f1823 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:02.266759 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42edad9-c4ea-4f06-a062-31b2e12f1823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:02.290429 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-b42edad9-c4ea-4f06-a062-31b2e12f1823 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:58:02.292986 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-b42edad9-c4ea-4f06-a062-31b2e12f1823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:02.321796 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666f6795-15d4-4750-b53f-130d7f80fb42 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:02.321952 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1039/2091] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:58:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:58:02.361305 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666f6795-15d4-4750-b53f-130d7f80fb42 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:02.367993 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6862e587-e0b0-4c8f-983f-817ba670aa3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:02.369533 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6862e587-e0b0-4c8f-983f-817ba670aa3a admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:02.370082 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6862e587-e0b0-4c8f-983f-817ba670aa3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:02.370627 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6862e587-e0b0-4c8f-983f-817ba670aa3a admin admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:02.372431 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6862e587-e0b0-4c8f-983f-817ba670aa3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:58:02.372899 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6862e587-e0b0-4c8f-983f-817ba670aa3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:02.375436 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6862e587-e0b0-4c8f-983f-817ba670aa3a admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:02.402799 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42edad9-c4ea-4f06-a062-31b2e12f1823 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:02.410479 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1053/2092] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Sep 19 14:58:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:58:02.419993 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42edad9-c4ea-4f06-a062-31b2e12f1823 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:02.429611 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afd3b3d-3b8d-4217-9727-e47c455289fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:02.431343 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afd3b3d-3b8d-4217-9727-e47c455289fd admin admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:02.431702 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afd3b3d-3b8d-4217-9727-e47c455289fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:02.432146 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afd3b3d-3b8d-4217-9727-e47c455289fd admin admin] PATH_INFO: `/v3/projects` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:02.432864 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afd3b3d-3b8d-4217-9727-e47c455289fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:02.441760 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afd3b3d-3b8d-4217-9727-e47c455289fd admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:02.474546 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:02.505061 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1040/2093] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Sep 19 14:58:02 2022] POST /identity/v3/projects => generated 383 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 14:58:02.508280 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6862e587-e0b0-4c8f-983f-817ba670aa3a admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:02.524009 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6862e587-e0b0-4c8f-983f-817ba670aa3a admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:02.607649 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8d5703-4442-4229-8ed3-b9a452e009f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:02.608995 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d5703-4442-4229-8ed3-b9a452e009f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:02.609561 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d5703-4442-4229-8ed3-b9a452e009f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:02.610056 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d5703-4442-4229-8ed3-b9a452e009f6 admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:02.610924 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8d5703-4442-4229-8ed3-b9a452e009f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:02.615261 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8d5703-4442-4229-8ed3-b9a452e009f6 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:02.654985 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1054/2094] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Sep 19 14:58:02 2022] POST /identity/v3/users => generated 292 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 14:58:02.655294 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afd3b3d-3b8d-4217-9727-e47c455289fd admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:02.679812 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afd3b3d-3b8d-4217-9727-e47c455289fd admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:02.698709 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e35fa4e-4fb2-41d0-8eeb-6c052dcee5b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:02.699359 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e35fa4e-4fb2-41d0-8eeb-6c052dcee5b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:02.699670 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e35fa4e-4fb2-41d0-8eeb-6c052dcee5b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:02.699936 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e35fa4e-4fb2-41d0-8eeb-6c052dcee5b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:02.712882 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e35fa4e-4fb2-41d0-8eeb-6c052dcee5b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:02.712882 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e35fa4e-4fb2-41d0-8eeb-6c052dcee5b0 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:02.742192 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1041/2095] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:58:02 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:58:02.746350 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8d5703-4442-4229-8ed3-b9a452e009f6 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:02.771184 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8d5703-4442-4229-8ed3-b9a452e009f6 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:02.778227 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b791dc38-9cad-42b0-b930-4be9c6c752e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:02.778867 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b791dc38-9cad-42b0-b930-4be9c6c752e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:02.779245 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b791dc38-9cad-42b0-b930-4be9c6c752e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:02.779522 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b791dc38-9cad-42b0-b930-4be9c6c752e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:02.780291 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b791dc38-9cad-42b0-b930-4be9c6c752e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:02.783423 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b791dc38-9cad-42b0-b930-4be9c6c752e2 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:02.795911 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1055/2096] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:58:02 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:58:02.799871 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e35fa4e-4fb2-41d0-8eeb-6c052dcee5b0 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:02.815501 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e35fa4e-4fb2-41d0-8eeb-6c052dcee5b0 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:02.825014 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6a2e7b-27d0-4ee5-bace-40b0541cdce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:02.825961 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6a2e7b-27d0-4ee5-bace-40b0541cdce3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:02.826400 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6a2e7b-27d0-4ee5-bace-40b0541cdce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:02.827728 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6a2e7b-27d0-4ee5-bace-40b0541cdce3 admin admin] PATH_INFO: `/v3/projects/0917ba3911fe475c9894ba638a3cfe8f/users/4413b1d4506943c9b305d7700d0da045/roles/efa0e5b3413748dc828a89b12d67df79` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:02.899860 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6a2e7b-27d0-4ee5-bace-40b0541cdce3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0917ba3911fe475c9894ba638a3cfe8f, user_id=4413b1d4506943c9b305d7700d0da045, role_id=efa0e5b3413748dc828a89b12d67df79)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:02.902631 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6a2e7b-27d0-4ee5-bace-40b0541cdce3 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:02.928716 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1042/2097] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 14:58:02 2022] PUT /identity/v3/projects/0917ba3911fe475c9894ba638a3cfe8f/users/4413b1d4506943c9b305d7700d0da045/roles/efa0e5b3413748dc828a89b12d67df79 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:58:02.944406 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3a4c17-3fe3-4300-a245-1aa347e5f915 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:02.945039 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3a4c17-3fe3-4300-a245-1aa347e5f915 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:02.945401 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3a4c17-3fe3-4300-a245-1aa347e5f915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:02.966372 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:02.994669 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-3d3a4c17-3fe3-4300-a245-1aa347e5f915 None None] MFA Rules not processed for user `4413b1d4506943c9b305d7700d0da045`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:58:02.995897 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-3d3a4c17-3fe3-4300-a245-1aa347e5f915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:03.079150 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1056/2098] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:58:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:58:03.080665 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6a2e7b-27d0-4ee5-bace-40b0541cdce3 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:03.255667 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6a2e7b-27d0-4ee5-bace-40b0541cdce3 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:03.270826 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446868a7-73de-43bc-b3f3-e1bfc8857a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:03.271464 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446868a7-73de-43bc-b3f3-e1bfc8857a2c admin admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:03.271749 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446868a7-73de-43bc-b3f3-e1bfc8857a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:03.272023 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446868a7-73de-43bc-b3f3-e1bfc8857a2c admin admin] PATH_INFO: `/v3/projects` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:03.272707 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446868a7-73de-43bc-b3f3-e1bfc8857a2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:03.279843 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446868a7-73de-43bc-b3f3-e1bfc8857a2c admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:03.346960 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3a4c17-3fe3-4300-a245-1aa347e5f915 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:03.348507 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1043/2099] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Sep 19 14:58:03 2022] POST /identity/v3/projects => generated 385 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 14:58:03.359565 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3a4c17-3fe3-4300-a245-1aa347e5f915 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:03.443590 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa096ce-bab8-4dbb-bfb2-f10a6c6c7289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:03.445047 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa096ce-bab8-4dbb-bfb2-f10a6c6c7289 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:03.454348 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa096ce-bab8-4dbb-bfb2-f10a6c6c7289 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:03.454348 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa096ce-bab8-4dbb-bfb2-f10a6c6c7289 admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:03.454348 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa096ce-bab8-4dbb-bfb2-f10a6c6c7289 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:03.455235 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa096ce-bab8-4dbb-bfb2-f10a6c6c7289 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:03.485463 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1057/2100] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Sep 19 14:58:03 2022] POST /identity/v3/users => generated 293 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 14:58:03.486707 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446868a7-73de-43bc-b3f3-e1bfc8857a2c admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:03.497480 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446868a7-73de-43bc-b3f3-e1bfc8857a2c admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:03.503030 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e52e20-733d-442b-a8ad-84d239ddec37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:03.503637 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e52e20-733d-442b-a8ad-84d239ddec37 admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:03.503918 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e52e20-733d-442b-a8ad-84d239ddec37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:03.504192 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e52e20-733d-442b-a8ad-84d239ddec37 admin admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:03.504877 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e52e20-733d-442b-a8ad-84d239ddec37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:03.506468 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e52e20-733d-442b-a8ad-84d239ddec37 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:03.517637 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1044/2101] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:58:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:58:03.522109 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa096ce-bab8-4dbb-bfb2-f10a6c6c7289 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:03.533324 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa096ce-bab8-4dbb-bfb2-f10a6c6c7289 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:03.538762 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a831b77d-44b9-482e-ab78-d139ae474153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:03.541969 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a831b77d-44b9-482e-ab78-d139ae474153 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:03.541969 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a831b77d-44b9-482e-ab78-d139ae474153 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:03.541969 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a831b77d-44b9-482e-ab78-d139ae474153 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:03.541969 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a831b77d-44b9-482e-ab78-d139ae474153 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:03.542547 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a831b77d-44b9-482e-ab78-d139ae474153 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:03.560363 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1058/2102] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:58:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 14:58:03.562211 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e52e20-733d-442b-a8ad-84d239ddec37 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:03.564626 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a831b77d-44b9-482e-ab78-d139ae474153 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:03.566382 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-a831b77d-44b9-482e-ab78-d139ae474153 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:03.574684 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e52e20-733d-442b-a8ad-84d239ddec37 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:03.580002 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a831b77d-44b9-482e-ab78-d139ae474153 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:03.581508 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cd239b-9103-4ce9-a3bb-4157b68d6991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:03.582279 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd239b-9103-4ce9-a3bb-4157b68d6991 admin admin] REQUEST_METHOD: `PUT` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:03.582603 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd239b-9103-4ce9-a3bb-4157b68d6991 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:03.582888 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd239b-9103-4ce9-a3bb-4157b68d6991 admin admin] PATH_INFO: `/v3/projects/4825e649d2d64dc58dd7141bcc168c45/users/70cd86580fb84b6e94c8f714ac8a492b/roles/efa0e5b3413748dc828a89b12d67df79` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:03.585033 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336b81bd-8242-434d-a228-7b9a7096b12c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:03.585740 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336b81bd-8242-434d-a228-7b9a7096b12c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:03.586102 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336b81bd-8242-434d-a228-7b9a7096b12c admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:03.586443 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336b81bd-8242-434d-a228-7b9a7096b12c admin admin] PATH_INFO: `/v3/users/abb915734cc648e4809dafd442eb5c49` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:03.587789 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336b81bd-8242-434d-a228-7b9a7096b12c admin admin] RBAC: Authorizing `identity:delete_user(user_id=abb915734cc648e4809dafd442eb5c49)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:03.590131 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336b81bd-8242-434d-a228-7b9a7096b12c admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:03.603942 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cd239b-9103-4ce9-a3bb-4157b68d6991 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4825e649d2d64dc58dd7141bcc168c45, user_id=70cd86580fb84b6e94c8f714ac8a492b, role_id=efa0e5b3413748dc828a89b12d67df79)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:03.607643 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cd239b-9103-4ce9-a3bb-4157b68d6991 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:03.626167 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1045/2103] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 14:58:03 2022] PUT /identity/v3/projects/4825e649d2d64dc58dd7141bcc168c45/users/70cd86580fb84b6e94c8f714ac8a492b/roles/efa0e5b3413748dc828a89b12d67df79 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:58:03.635937 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17db83d-9ad6-4218-b40f-8d1a00f137f3 None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:03.635937 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17db83d-9ad6-4218-b40f-8d1a00f137f3 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:03.635937 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17db83d-9ad6-4218-b40f-8d1a00f137f3 None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:03.635937 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1046/2104] 10.222.0.72 () {54 vars in 921 bytes} [Mon Sep 19 14:58:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:58:03.636790 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f9f1ab-7977-4b9a-b1c0-892a56612773 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:03.637227 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f9f1ab-7977-4b9a-b1c0-892a56612773 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:03.637544 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f9f1ab-7977-4b9a-b1c0-892a56612773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:03.654910 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-336b81bd-8242-434d-a228-7b9a7096b12c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abb915734cc648e4809dafd442eb5c49'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:03.668433 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-336b81bd-8242-434d-a228-7b9a7096b12c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abb915734cc648e4809dafd442eb5c49'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:03.674047 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-02f9f1ab-7977-4b9a-b1c0-892a56612773 None None] MFA Rules not processed for user `70cd86580fb84b6e94c8f714ac8a492b`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:58:03.674985 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:03.675554 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-02f9f1ab-7977-4b9a-b1c0-892a56612773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:03.685306 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-336b81bd-8242-434d-a228-7b9a7096b12c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abb915734cc648e4809dafd442eb5c49'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:03.708122 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-336b81bd-8242-434d-a228-7b9a7096b12c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abb915734cc648e4809dafd442eb5c49'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:03.710246 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-336b81bd-8242-434d-a228-7b9a7096b12c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abb915734cc648e4809dafd442eb5c49'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:03.721670 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1059/2105] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Sep 19 14:58:03 2022] DELETE /identity/v3/users/abb915734cc648e4809dafd442eb5c49 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:58:03.724265 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931aec65-f53a-46e3-8183-77e7419f988c None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:03.724817 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931aec65-f53a-46e3-8183-77e7419f988c None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:03.725103 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931aec65-f53a-46e3-8183-77e7419f988c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:03.749034 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-931aec65-f53a-46e3-8183-77e7419f988c None None] MFA Rules not processed for user `51e7a0148db8462b8ba24bac6dd15298`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:58:03.750118 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-931aec65-f53a-46e3-8183-77e7419f988c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:03.769696 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:03.776565 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1047/2106] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:58:03 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 14:58:03.777874 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f9f1ab-7977-4b9a-b1c0-892a56612773 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:03.782936 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-02f9f1ab-7977-4b9a-b1c0-892a56612773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:03.850743 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1060/2107] 10.222.0.72 () {58 vars in 1018 bytes} [Mon Sep 19 14:58:03 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:58:03.851953 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec4021-472c-4eca-880c-e489d7c1514c None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:03.852238 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec4021-472c-4eca-880c-e489d7c1514c None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:03.852538 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec4021-472c-4eca-880c-e489d7c1514c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:03.872511 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-e2ec4021-472c-4eca-880c-e489d7c1514c None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:58:03.873712 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-e2ec4021-472c-4eca-880c-e489d7c1514c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:03.877935 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f9f1ab-7977-4b9a-b1c0-892a56612773 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:03.942828 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1061/2108] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:58:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:58:03.944203 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ec4021-472c-4eca-880c-e489d7c1514c None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:03.945678 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-e2ec4021-472c-4eca-880c-e489d7c1514c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:03.953398 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02163fa-1138-4ffc-980b-deebf8570673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:03.955263 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02163fa-1138-4ffc-980b-deebf8570673 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:03.955746 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02163fa-1138-4ffc-980b-deebf8570673 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:03.956212 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02163fa-1138-4ffc-980b-deebf8570673 admin admin] PATH_INFO: `/v3/users/37c6063c794f4bab8f3850b5b8daa47c` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:03.957616 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02163fa-1138-4ffc-980b-deebf8570673 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37c6063c794f4bab8f3850b5b8daa47c)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:03.959903 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02163fa-1138-4ffc-980b-deebf8570673 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:03.965043 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ec4021-472c-4eca-880c-e489d7c1514c None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:03.970984 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2916f9ef-51e1-47d1-b0cb-f28d2057b61c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:03.971816 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2916f9ef-51e1-47d1-b0cb-f28d2057b61c admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:03.972532 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2916f9ef-51e1-47d1-b0cb-f28d2057b61c admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:03.973126 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2916f9ef-51e1-47d1-b0cb-f28d2057b61c admin admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:03.973949 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2916f9ef-51e1-47d1-b0cb-f28d2057b61c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:03.976493 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2916f9ef-51e1-47d1-b0cb-f28d2057b61c admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:04.016347 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1062/2109] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Sep 19 14:58:03 2022] POST /identity/v3/projects => generated 385 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:58:04.017279 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2916f9ef-51e1-47d1-b0cb-f28d2057b61c admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:04.020939 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-2916f9ef-51e1-47d1-b0cb-f28d2057b61c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:04.034851 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-d02163fa-1138-4ffc-980b-deebf8570673 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37c6063c794f4bab8f3850b5b8daa47c'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:04.050993 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-d02163fa-1138-4ffc-980b-deebf8570673 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37c6063c794f4bab8f3850b5b8daa47c'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:04.062813 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-d02163fa-1138-4ffc-980b-deebf8570673 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37c6063c794f4bab8f3850b5b8daa47c'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:04.063928 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-d02163fa-1138-4ffc-980b-deebf8570673 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37c6063c794f4bab8f3850b5b8daa47c'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:04.076232 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-d02163fa-1138-4ffc-980b-deebf8570673 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37c6063c794f4bab8f3850b5b8daa47c'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:04.085716 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1048/2110] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Sep 19 14:58:03 2022] DELETE /identity/v3/users/37c6063c794f4bab8f3850b5b8daa47c => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:58:04.087174 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02163fa-1138-4ffc-980b-deebf8570673 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:04.089911 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-d02163fa-1138-4ffc-980b-deebf8570673 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:04.130085 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:04.135250 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:04.143966 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2916f9ef-51e1-47d1-b0cb-f28d2057b61c admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:04.189421 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02163fa-1138-4ffc-980b-deebf8570673 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:04.193574 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc6500d-6646-4a3e-a208-413bf209dc8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c2b78646374cb79ded4b7b59ba49c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:04.194706 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc6500d-6646-4a3e-a208-413bf209dc8d service neutron] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:04.194994 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc6500d-6646-4a3e-a208-413bf209dc8d service neutron] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:04.195267 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc6500d-6646-4a3e-a208-413bf209dc8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:04.197146 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-3fc6500d-6646-4a3e-a208-413bf209dc8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:04.235468 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4aabb3-af7b-4778-b1f0-1a80a39ae9f4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e7a0148db8462b8ba24bac6dd15298', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:04.236097 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4aabb3-af7b-4778-b1f0-1a80a39ae9f4 service placement] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:04.236671 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4aabb3-af7b-4778-b1f0-1a80a39ae9f4 service placement] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:04.236671 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4aabb3-af7b-4778-b1f0-1a80a39ae9f4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:04.238758 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-ba4aabb3-af7b-4778-b1f0-1a80a39ae9f4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:04.252770 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4aabb3-af7b-4778-b1f0-1a80a39ae9f4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:04.254574 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4aabb3-af7b-4778-b1f0-1a80a39ae9f4 service placement] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:04.266271 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1063/2111] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:58:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:58:04.267107 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4aabb3-af7b-4778-b1f0-1a80a39ae9f4 service placement] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:04.268536 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-ba4aabb3-af7b-4778-b1f0-1a80a39ae9f4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:04.326385 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc6500d-6646-4a3e-a208-413bf209dc8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:04.328063 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc6500d-6646-4a3e-a208-413bf209dc8d service neutron] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:04.341426 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1049/2112] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:58:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:58:04.342363 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc6500d-6646-4a3e-a208-413bf209dc8d service neutron] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:04.343966 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-3fc6500d-6646-4a3e-a208-413bf209dc8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:04.361151 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc6500d-6646-4a3e-a208-413bf209dc8d service neutron] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:04.368074 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97234c39-11d1-4bdc-8a86-deef711b1025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:04.369421 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97234c39-11d1-4bdc-8a86-deef711b1025 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:04.370285 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97234c39-11d1-4bdc-8a86-deef711b1025 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:04.370456 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97234c39-11d1-4bdc-8a86-deef711b1025 admin admin] PATH_INFO: `/v3/projects/0cc13ff8f3da418bb4b298d74f33064a` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:04.373514 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97234c39-11d1-4bdc-8a86-deef711b1025 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cc13ff8f3da418bb4b298d74f33064a)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:04.376891 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97234c39-11d1-4bdc-8a86-deef711b1025 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:04.407496 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4aabb3-af7b-4778-b1f0-1a80a39ae9f4 service placement] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:04.413986 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e11d59-9ec0-4ec9-ba9b-760b4a87ffb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:04.414855 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e11d59-9ec0-4ec9-ba9b-760b4a87ffb1 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:04.414969 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e11d59-9ec0-4ec9-ba9b-760b4a87ffb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:04.415770 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e11d59-9ec0-4ec9-ba9b-760b4a87ffb1 admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:04.416524 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e11d59-9ec0-4ec9-ba9b-760b4a87ffb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:04.418708 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e11d59-9ec0-4ec9-ba9b-760b4a87ffb1 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:04.437349 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-97234c39-11d1-4bdc-8a86-deef711b1025 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cc13ff8f3da418bb4b298d74f33064a', 'request_id': 'req-97234c39-11d1-4bdc-8a86-deef711b1025'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:04.446132 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1064/2113] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Sep 19 14:58:04 2022] POST /identity/v3/users => generated 299 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:58:04.446528 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-97234c39-11d1-4bdc-8a86-deef711b1025 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cc13ff8f3da418bb4b298d74f33064a', 'request_id': 'req-97234c39-11d1-4bdc-8a86-deef711b1025'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:04.451176 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e11d59-9ec0-4ec9-ba9b-760b4a87ffb1 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:04.454384 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-97234c39-11d1-4bdc-8a86-deef711b1025 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cc13ff8f3da418bb4b298d74f33064a', 'request_id': 'req-97234c39-11d1-4bdc-8a86-deef711b1025'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:04.464428 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e11d59-9ec0-4ec9-ba9b-760b4a87ffb1 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:04.466268 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-97234c39-11d1-4bdc-8a86-deef711b1025 admin admin] The token cache is being invalidate because project 0cc13ff8f3da418bb4b298d74f33064a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 14:58:04.466624 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-97234c39-11d1-4bdc-8a86-deef711b1025 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:04.467257 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-97234c39-11d1-4bdc-8a86-deef711b1025 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:04.473157 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1050/2114] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Sep 19 14:58:04 2022] DELETE /identity/v3/projects/0cc13ff8f3da418bb4b298d74f33064a => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:58:04.477788 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef5329-9574-4ccb-811c-52a327b8b71e None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:04.478829 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef5329-9574-4ccb-811c-52a327b8b71e None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:04.479591 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef5329-9574-4ccb-811c-52a327b8b71e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:04.507180 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-a2ef5329-9574-4ccb-811c-52a327b8b71e None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:58:04.508719 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-a2ef5329-9574-4ccb-811c-52a327b8b71e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:04.534911 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65a17d1-350a-4a05-a2d6-58c699a8429c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:04.535532 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a17d1-350a-4a05-a2d6-58c699a8429c admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:04.535811 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a17d1-350a-4a05-a2d6-58c699a8429c admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:04.536085 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a17d1-350a-4a05-a2d6-58c699a8429c admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:04.536849 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65a17d1-350a-4a05-a2d6-58c699a8429c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:04.539357 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65a17d1-350a-4a05-a2d6-58c699a8429c admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:04.554303 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1065/2115] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:58:04 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:58:04.558182 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65a17d1-350a-4a05-a2d6-58c699a8429c admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:04.560943 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-f65a17d1-350a-4a05-a2d6-58c699a8429c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:04.577836 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:04.591234 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65a17d1-350a-4a05-a2d6-58c699a8429c admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:04.593649 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1051/2116] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:58:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:58:04.600222 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b96df1-1bb5-4dcc-94d9-48c2b21f339b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:04.601053 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b96df1-1bb5-4dcc-94d9-48c2b21f339b admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:04.601324 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369643b3-19c9-4967-ac66-bf4a908903e4 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:04.601435 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b96df1-1bb5-4dcc-94d9-48c2b21f339b admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:04.601617 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369643b3-19c9-4967-ac66-bf4a908903e4 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:04.601764 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b96df1-1bb5-4dcc-94d9-48c2b21f339b admin admin] PATH_INFO: `/v3/projects/2812bb9a5a444f629dcd793d73ea0527/users/44d3719a40e84dd891e1804b5e49bd36/roles/ddb643577b2e4e478100ec370decfaeb` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:04.601953 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369643b3-19c9-4967-ac66-bf4a908903e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:04.630589 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b96df1-1bb5-4dcc-94d9-48c2b21f339b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2812bb9a5a444f629dcd793d73ea0527, user_id=44d3719a40e84dd891e1804b5e49bd36, role_id=ddb643577b2e4e478100ec370decfaeb)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:04.633827 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b96df1-1bb5-4dcc-94d9-48c2b21f339b admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:04.635006 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-369643b3-19c9-4967-ac66-bf4a908903e4 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:58:04.635893 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:04.636632 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-369643b3-19c9-4967-ac66-bf4a908903e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:04.652823 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1052/2117] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:58:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:58:04.658044 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369643b3-19c9-4967-ac66-bf4a908903e4 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:04.666532 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1066/2118] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 14:58:04 2022] PUT /identity/v3/projects/2812bb9a5a444f629dcd793d73ea0527/users/44d3719a40e84dd891e1804b5e49bd36/roles/ddb643577b2e4e478100ec370decfaeb => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:58:04.671980 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b96df1-1bb5-4dcc-94d9-48c2b21f339b admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:04.686500 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369643b3-19c9-4967-ac66-bf4a908903e4 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:04.767277 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b96df1-1bb5-4dcc-94d9-48c2b21f339b admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:04.774642 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34941c7-cfd8-4fef-bfa5-5b3e03d7f7b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:04.775482 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34941c7-cfd8-4fef-bfa5-5b3e03d7f7b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:04.775879 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34941c7-cfd8-4fef-bfa5-5b3e03d7f7b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:04.776210 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34941c7-cfd8-4fef-bfa5-5b3e03d7f7b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:04.777095 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34941c7-cfd8-4fef-bfa5-5b3e03d7f7b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:04.779053 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34941c7-cfd8-4fef-bfa5-5b3e03d7f7b3 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:04.781720 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4780960a-efa0-4c42-8976-360c6c5e7d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:04.782492 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4780960a-efa0-4c42-8976-360c6c5e7d28 admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:04.782775 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4780960a-efa0-4c42-8976-360c6c5e7d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:04.783094 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4780960a-efa0-4c42-8976-360c6c5e7d28 admin admin] PATH_INFO: `/v3/domains` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:04.783740 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4780960a-efa0-4c42-8976-360c6c5e7d28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:58:04.784162 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4780960a-efa0-4c42-8976-360c6c5e7d28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:04.786010 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4780960a-efa0-4c42-8976-360c6c5e7d28 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:04.798093 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1067/2119] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:58:04 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:58:04.806342 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1053/2120] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Sep 19 14:58:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:58:04.809399 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34941c7-cfd8-4fef-bfa5-5b3e03d7f7b3 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:04.810298 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4780960a-efa0-4c42-8976-360c6c5e7d28 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:04.822436 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34941c7-cfd8-4fef-bfa5-5b3e03d7f7b3 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:04.836372 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef86515-4b36-4a78-b967-7b83c8c68123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:04.840692 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4780960a-efa0-4c42-8976-360c6c5e7d28 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:04.847134 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef86515-4b36-4a78-b967-7b83c8c68123 admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:04.853328 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef86515-4b36-4a78-b967-7b83c8c68123 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:04.853521 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea51ee7b-4045-44b0-a457-084673583df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:04.854569 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea51ee7b-4045-44b0-a457-084673583df3 admin admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:04.855026 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea51ee7b-4045-44b0-a457-084673583df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:04.855476 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea51ee7b-4045-44b0-a457-084673583df3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:04.860607 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef86515-4b36-4a78-b967-7b83c8c68123 admin admin] PATH_INFO: `/v3/projects/2812bb9a5a444f629dcd793d73ea0527/users/44d3719a40e84dd891e1804b5e49bd36/roles/ddb643577b2e4e478100ec370decfaeb` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:04.871465 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea51ee7b-4045-44b0-a457-084673583df3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:04.871657 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef86515-4b36-4a78-b967-7b83c8c68123 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2812bb9a5a444f629dcd793d73ea0527, user_id=44d3719a40e84dd891e1804b5e49bd36, role_id=ddb643577b2e4e478100ec370decfaeb)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:04.875167 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea51ee7b-4045-44b0-a457-084673583df3 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:04.875312 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef86515-4b36-4a78-b967-7b83c8c68123 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:04.907921 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1068/2121] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 14:58:04 2022] PUT /identity/v3/projects/2812bb9a5a444f629dcd793d73ea0527/users/44d3719a40e84dd891e1804b5e49bd36/roles/ddb643577b2e4e478100ec370decfaeb => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:58:04.907921 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef86515-4b36-4a78-b967-7b83c8c68123 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:04.907921 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-4ef86515-4b36-4a78-b967-7b83c8c68123 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:04.936706 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1054/2122] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Sep 19 14:58:04 2022] POST /identity/v3/projects => generated 387 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:58:04.938577 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3c5d00-ce74-4605-9145-e5547c2ca0e5 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:04.938935 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3c5d00-ce74-4605-9145-e5547c2ca0e5 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:04.939287 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3c5d00-ce74-4605-9145-e5547c2ca0e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:04.973477 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-8e3c5d00-ce74-4605-9145-e5547c2ca0e5 None None] MFA Rules not processed for user `44d3719a40e84dd891e1804b5e49bd36`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:58:04.976490 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-8e3c5d00-ce74-4605-9145-e5547c2ca0e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:04.988013 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef86515-4b36-4a78-b967-7b83c8c68123 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:05.051011 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d3e5ea-52a9-412d-93e0-b6a3926369d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:05.051697 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3e5ea-52a9-412d-93e0-b6a3926369d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:05.051942 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1055/2123] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:58:04 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:58:05.052790 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3c5d00-ce74-4605-9145-e5547c2ca0e5 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:05.056270 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3e5ea-52a9-412d-93e0-b6a3926369d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:05.056598 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3e5ea-52a9-412d-93e0-b6a3926369d7 admin admin] PATH_INFO: `/v3/projects/d4faa8323ce84966a7bdbaecc0446bab` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:05.058140 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d3e5ea-52a9-412d-93e0-b6a3926369d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4faa8323ce84966a7bdbaecc0446bab)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:05.061088 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d3e5ea-52a9-412d-93e0-b6a3926369d7 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:05.062767 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3c5d00-ce74-4605-9145-e5547c2ca0e5 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:05.067921 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b236e2a-50e6-42bb-9cc1-d4948eca2618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:05.069255 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b236e2a-50e6-42bb-9cc1-d4948eca2618 admin admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:05.069530 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b236e2a-50e6-42bb-9cc1-d4948eca2618 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:05.069793 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b236e2a-50e6-42bb-9cc1-d4948eca2618 admin admin] PATH_INFO: `/v3/users` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:05.070421 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b236e2a-50e6-42bb-9cc1-d4948eca2618 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:05.072427 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b236e2a-50e6-42bb-9cc1-d4948eca2618 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:05.096253 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1056/2124] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Sep 19 14:58:05 2022] POST /identity/v3/users => generated 294 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:58:05.097115 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b236e2a-50e6-42bb-9cc1-d4948eca2618 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:05.097819 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:INSERT=2,keystone:SELECT=97,keystone:DELETE=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:05.099962 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-7b236e2a-50e6-42bb-9cc1-d4948eca2618 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:05.116860 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-34d3e5ea-52a9-412d-93e0-b6a3926369d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4faa8323ce84966a7bdbaecc0446bab', 'request_id': 'req-34d3e5ea-52a9-412d-93e0-b6a3926369d7'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:05.124859 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-34d3e5ea-52a9-412d-93e0-b6a3926369d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4faa8323ce84966a7bdbaecc0446bab', 'request_id': 'req-34d3e5ea-52a9-412d-93e0-b6a3926369d7'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:05.130623 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-34d3e5ea-52a9-412d-93e0-b6a3926369d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4faa8323ce84966a7bdbaecc0446bab', 'request_id': 'req-34d3e5ea-52a9-412d-93e0-b6a3926369d7'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:05.136909 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:05.142968 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-34d3e5ea-52a9-412d-93e0-b6a3926369d7 admin admin] The token cache is being invalidate because project d4faa8323ce84966a7bdbaecc0446bab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 14:58:05.143265 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-34d3e5ea-52a9-412d-93e0-b6a3926369d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:05.143913 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-34d3e5ea-52a9-412d-93e0-b6a3926369d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:05.145884 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1069/2125] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Sep 19 14:58:04 2022] DELETE /identity/v3/projects/d4faa8323ce84966a7bdbaecc0446bab => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:58:05.146649 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d3e5ea-52a9-412d-93e0-b6a3926369d7 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:05.148320 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-34d3e5ea-52a9-412d-93e0-b6a3926369d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:05.168590 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b236e2a-50e6-42bb-9cc1-d4948eca2618 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:05.219751 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d3e5ea-52a9-412d-93e0-b6a3926369d7 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:05.224696 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8c8f8a-c127-4862-b7a8-724d4dfbe2d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:05.225310 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c8f8a-c127-4862-b7a8-724d4dfbe2d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:05.225614 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c8f8a-c127-4862-b7a8-724d4dfbe2d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:05.225860 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c8f8a-c127-4862-b7a8-724d4dfbe2d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:05.226507 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8c8f8a-c127-4862-b7a8-724d4dfbe2d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:05.228109 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8c8f8a-c127-4862-b7a8-724d4dfbe2d9 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:05.230162 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d716bea2-da21-4f5a-a85e-bdb3b75452c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139dc7a4f1dc48fe8faea848bd1ac0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:05.230766 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d716bea2-da21-4f5a-a85e-bdb3b75452c9 service cinder] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:05.231046 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d716bea2-da21-4f5a-a85e-bdb3b75452c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:05.231315 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d716bea2-da21-4f5a-a85e-bdb3b75452c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:05.233935 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-d716bea2-da21-4f5a-a85e-bdb3b75452c9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:05.240551 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1070/2126] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:58:05 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:58:05.241248 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8c8f8a-c127-4862-b7a8-724d4dfbe2d9 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:05.243820 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-df8c8f8a-c127-4862-b7a8-724d4dfbe2d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:05.256927 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8c8f8a-c127-4862-b7a8-724d4dfbe2d9 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:05.262209 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae7a7ae-6038-4594-85ce-0d866c1cacf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:05.262492 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae7a7ae-6038-4594-85ce-0d866c1cacf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:05.262769 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae7a7ae-6038-4594-85ce-0d866c1cacf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:05.263049 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae7a7ae-6038-4594-85ce-0d866c1cacf9 admin admin] PATH_INFO: `/v3/users/9a7f48b943404778acdf90d433a2a7a4` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:05.264174 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae7a7ae-6038-4594-85ce-0d866c1cacf9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a7f48b943404778acdf90d433a2a7a4)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:05.266935 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae7a7ae-6038-4594-85ce-0d866c1cacf9 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:05.300836 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d716bea2-da21-4f5a-a85e-bdb3b75452c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:05.302684 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d716bea2-da21-4f5a-a85e-bdb3b75452c9 service cinder] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:05.313467 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1057/2127] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:58:05 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:58:05.321980 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d716bea2-da21-4f5a-a85e-bdb3b75452c9 service cinder] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:05.323277 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-aae7a7ae-6038-4594-85ce-0d866c1cacf9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a7f48b943404778acdf90d433a2a7a4'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:05.336744 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d716bea2-da21-4f5a-a85e-bdb3b75452c9 service cinder] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:05.346660 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04462db0-bf59-4d8d-8910-553990756a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:05.346849 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-aae7a7ae-6038-4594-85ce-0d866c1cacf9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a7f48b943404778acdf90d433a2a7a4'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:05.347247 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04462db0-bf59-4d8d-8910-553990756a1c admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:05.347527 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04462db0-bf59-4d8d-8910-553990756a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:05.347867 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04462db0-bf59-4d8d-8910-553990756a1c admin admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:05.351171 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04462db0-bf59-4d8d-8910-553990756a1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:05.352820 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04462db0-bf59-4d8d-8910-553990756a1c admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:05.355654 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-aae7a7ae-6038-4594-85ce-0d866c1cacf9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a7f48b943404778acdf90d433a2a7a4'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:05.366714 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-aae7a7ae-6038-4594-85ce-0d866c1cacf9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a7f48b943404778acdf90d433a2a7a4'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:05.367515 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-aae7a7ae-6038-4594-85ce-0d866c1cacf9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a7f48b943404778acdf90d433a2a7a4'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:05.369384 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1058/2128] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:58:05 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:58:05.373671 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04462db0-bf59-4d8d-8910-553990756a1c admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:05.375626 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-04462db0-bf59-4d8d-8910-553990756a1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:05.379001 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1071/2129] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Sep 19 14:58:05 2022] DELETE /identity/v3/users/9a7f48b943404778acdf90d433a2a7a4 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:58:05.391908 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04462db0-bf59-4d8d-8910-553990756a1c admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:05.488133 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99156c1-1e71-4d16-8199-f8f1834b84af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:05.489808 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99156c1-1e71-4d16-8199-f8f1834b84af admin admin] REQUEST_METHOD: `PUT` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:05.490497 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99156c1-1e71-4d16-8199-f8f1834b84af admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:05.491217 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99156c1-1e71-4d16-8199-f8f1834b84af admin admin] PATH_INFO: `/v3/projects/b63ae244aeb640d4a87beaf09a3454d9/users/b5fbe11b49b24fdb80257652ed9fe298/roles/efa0e5b3413748dc828a89b12d67df79` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:05.514436 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99156c1-1e71-4d16-8199-f8f1834b84af admin admin] RBAC: Authorizing `identity:create_grant(project_id=b63ae244aeb640d4a87beaf09a3454d9, user_id=b5fbe11b49b24fdb80257652ed9fe298, role_id=efa0e5b3413748dc828a89b12d67df79)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:05.518866 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99156c1-1e71-4d16-8199-f8f1834b84af admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:05.552419 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1059/2130] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 14:58:05 2022] PUT /identity/v3/projects/b63ae244aeb640d4a87beaf09a3454d9/users/b5fbe11b49b24fdb80257652ed9fe298/roles/efa0e5b3413748dc828a89b12d67df79 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:58:05.559395 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b72c087-b4b8-4a20-9264-d4be7fbbd81f None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:05.559946 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b72c087-b4b8-4a20-9264-d4be7fbbd81f None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:05.560447 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b72c087-b4b8-4a20-9264-d4be7fbbd81f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:05.594070 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-4b72c087-b4b8-4a20-9264-d4be7fbbd81f None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:58:05.595984 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-4b72c087-b4b8-4a20-9264-d4be7fbbd81f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:05.648434 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:05.725935 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1072/2131] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:58:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 14:58:05.744504 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99156c1-1e71-4d16-8199-f8f1834b84af admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:05.748709 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-b99156c1-1e71-4d16-8199-f8f1834b84af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:05.771291 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:05.838833 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99156c1-1e71-4d16-8199-f8f1834b84af admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:05.844132 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4857e3-1c0f-45e9-a165-4bbafbb3c02e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c2b78646374cb79ded4b7b59ba49c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:05.845172 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4857e3-1c0f-45e9-a165-4bbafbb3c02e service neutron] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:05.845554 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4857e3-1c0f-45e9-a165-4bbafbb3c02e service neutron] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:05.845894 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4857e3-1c0f-45e9-a165-4bbafbb3c02e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:05.860796 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4857e3-1c0f-45e9-a165-4bbafbb3c02e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:05.862470 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4857e3-1c0f-45e9-a165-4bbafbb3c02e service neutron] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:05.898367 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1060/2132] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:58:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:58:05.929282 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b72c087-b4b8-4a20-9264-d4be7fbbd81f None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:05.930998 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-4b72c087-b4b8-4a20-9264-d4be7fbbd81f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:05.959089 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b72c087-b4b8-4a20-9264-d4be7fbbd81f None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:05.967238 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8416789d-ffb7-40c8-8816-1532d10e981b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:05.968572 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8416789d-ffb7-40c8-8816-1532d10e981b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:05.968964 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8416789d-ffb7-40c8-8816-1532d10e981b admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:05.969318 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8416789d-ffb7-40c8-8816-1532d10e981b admin admin] PATH_INFO: `/v3/projects/8bf519ab65af47939e7cfeace5e7a039` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:05.970628 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8416789d-ffb7-40c8-8816-1532d10e981b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bf519ab65af47939e7cfeace5e7a039)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:05.973435 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8416789d-ffb7-40c8-8816-1532d10e981b admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:06.029195 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-8416789d-ffb7-40c8-8816-1532d10e981b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bf519ab65af47939e7cfeace5e7a039', 'request_id': 'req-8416789d-ffb7-40c8-8816-1532d10e981b'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:06.038349 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-8416789d-ffb7-40c8-8816-1532d10e981b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bf519ab65af47939e7cfeace5e7a039', 'request_id': 'req-8416789d-ffb7-40c8-8816-1532d10e981b'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:06.045577 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-8416789d-ffb7-40c8-8816-1532d10e981b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bf519ab65af47939e7cfeace5e7a039', 'request_id': 'req-8416789d-ffb7-40c8-8816-1532d10e981b'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:06.060233 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-8416789d-ffb7-40c8-8816-1532d10e981b admin admin] The token cache is being invalidate because project 8bf519ab65af47939e7cfeace5e7a039 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 14:58:06.060859 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-8416789d-ffb7-40c8-8816-1532d10e981b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:06.061217 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-8416789d-ffb7-40c8-8816-1532d10e981b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:06.067302 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1073/2133] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Sep 19 14:58:05 2022] DELETE /identity/v3/projects/8bf519ab65af47939e7cfeace5e7a039 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:58:06.068401 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987b4aea-87dd-4cc9-ac70-df883998c73e None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:06.068694 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987b4aea-87dd-4cc9-ac70-df883998c73e None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:06.069233 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987b4aea-87dd-4cc9-ac70-df883998c73e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:06.092159 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-987b4aea-87dd-4cc9-ac70-df883998c73e None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:58:06.093353 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-987b4aea-87dd-4cc9-ac70-df883998c73e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:06.169314 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1061/2134] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:58:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:58:06.177081 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f58329-9e1d-4659-8efe-824611835001 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:06.177371 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f58329-9e1d-4659-8efe-824611835001 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:06.177650 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f58329-9e1d-4659-8efe-824611835001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:06.199961 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-70f58329-9e1d-4659-8efe-824611835001 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:58:06.201949 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-70f58329-9e1d-4659-8efe-824611835001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:06.217588 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987b4aea-87dd-4cc9-ac70-df883998c73e None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:06.224215 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1074/2135] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:58:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:58:06.231263 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987b4aea-87dd-4cc9-ac70-df883998c73e None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:06.236345 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74f044a-f2d8-4f34-9c4c-458a6f960520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:06.236973 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74f044a-f2d8-4f34-9c4c-458a6f960520 admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:06.237255 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74f044a-f2d8-4f34-9c4c-458a6f960520 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:06.237527 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74f044a-f2d8-4f34-9c4c-458a6f960520 admin admin] PATH_INFO: `/v3/domains` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:06.238172 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74f044a-f2d8-4f34-9c4c-458a6f960520 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:58:06.238479 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74f044a-f2d8-4f34-9c4c-458a6f960520 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:06.240178 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74f044a-f2d8-4f34-9c4c-458a6f960520 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:06.258999 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1062/2136] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Sep 19 14:58:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:58:06.260424 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f58329-9e1d-4659-8efe-824611835001 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:06.282894 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f58329-9e1d-4659-8efe-824611835001 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:06.289977 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23334cce-8661-4c0e-b5b3-bc8f0f27b20c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:06.290943 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23334cce-8661-4c0e-b5b3-bc8f0f27b20c admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:06.291457 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23334cce-8661-4c0e-b5b3-bc8f0f27b20c admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:06.291977 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23334cce-8661-4c0e-b5b3-bc8f0f27b20c admin admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:06.293032 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23334cce-8661-4c0e-b5b3-bc8f0f27b20c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:06.296001 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23334cce-8661-4c0e-b5b3-bc8f0f27b20c admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:06.330137 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1075/2137] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Sep 19 14:58:06 2022] POST /identity/v3/projects => generated 363 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:58:06.334109 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74f044a-f2d8-4f34-9c4c-458a6f960520 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:06.347572 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74f044a-f2d8-4f34-9c4c-458a6f960520 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:06.411232 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9a89e9-5280-4b14-a25f-d640922567d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:06.411762 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a89e9-5280-4b14-a25f-d640922567d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:06.412047 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a89e9-5280-4b14-a25f-d640922567d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:06.412349 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a89e9-5280-4b14-a25f-d640922567d0 admin admin] PATH_INFO: `/v3/users` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:06.413001 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9a89e9-5280-4b14-a25f-d640922567d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:06.414950 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9a89e9-5280-4b14-a25f-d640922567d0 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:06.438574 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1063/2138] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Sep 19 14:58:06 2022] POST /identity/v3/users => generated 282 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:58:06.442831 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23334cce-8661-4c0e-b5b3-bc8f0f27b20c admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:06.454575 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23334cce-8661-4c0e-b5b3-bc8f0f27b20c admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:06.459448 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcb6217-7aa8-403b-bea0-2322ff8b1077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:06.460046 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb6217-7aa8-403b-bea0-2322ff8b1077 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:06.460404 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb6217-7aa8-403b-bea0-2322ff8b1077 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:06.460693 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb6217-7aa8-403b-bea0-2322ff8b1077 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:06.461361 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcb6217-7aa8-403b-bea0-2322ff8b1077 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:06.462990 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcb6217-7aa8-403b-bea0-2322ff8b1077 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:06.474141 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1076/2139] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:58:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:58:06.478330 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9a89e9-5280-4b14-a25f-d640922567d0 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:06.490465 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9a89e9-5280-4b14-a25f-d640922567d0 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:06.496890 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259c7139-1b5d-4ec3-a06e-49bf8702cd1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:06.497787 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c7139-1b5d-4ec3-a06e-49bf8702cd1c admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:06.498082 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c7139-1b5d-4ec3-a06e-49bf8702cd1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:06.498354 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c7139-1b5d-4ec3-a06e-49bf8702cd1c admin admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:06.499034 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259c7139-1b5d-4ec3-a06e-49bf8702cd1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:06.501077 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259c7139-1b5d-4ec3-a06e-49bf8702cd1c admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:06.517897 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1064/2140] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:58:06 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:58:06.519795 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcb6217-7aa8-403b-bea0-2322ff8b1077 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:06.530905 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcb6217-7aa8-403b-bea0-2322ff8b1077 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:06.535613 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2c492a-c4f4-42f0-b1ae-80b21f3034cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:06.536267 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c492a-c4f4-42f0-b1ae-80b21f3034cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:06.536581 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c492a-c4f4-42f0-b1ae-80b21f3034cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:06.536859 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c492a-c4f4-42f0-b1ae-80b21f3034cc admin admin] PATH_INFO: `/v3/projects/46db57ace97b427ebcfc9d91df98ac21/users/46018b24e97e4c75b5561aac3405180c/roles/efa0e5b3413748dc828a89b12d67df79` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:06.554504 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2c492a-c4f4-42f0-b1ae-80b21f3034cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=46db57ace97b427ebcfc9d91df98ac21, user_id=46018b24e97e4c75b5561aac3405180c, role_id=efa0e5b3413748dc828a89b12d67df79)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:06.557916 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2c492a-c4f4-42f0-b1ae-80b21f3034cc admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:06.574928 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1077/2141] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 14:58:06 2022] PUT /identity/v3/projects/46db57ace97b427ebcfc9d91df98ac21/users/46018b24e97e4c75b5561aac3405180c/roles/efa0e5b3413748dc828a89b12d67df79 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:58:06.587256 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c37a92b-1492-4584-9bf1-c2160933abd9 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:06.587670 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c37a92b-1492-4584-9bf1-c2160933abd9 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:06.588027 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c37a92b-1492-4584-9bf1-c2160933abd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:06.630899 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-6c37a92b-1492-4584-9bf1-c2160933abd9 None None] MFA Rules not processed for user `46018b24e97e4c75b5561aac3405180c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:58:06.632146 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-6c37a92b-1492-4584-9bf1-c2160933abd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:06.652227 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:06.752805 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2c492a-c4f4-42f0-b1ae-80b21f3034cc admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:06.754822 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1065/2142] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:58:06 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:58:06.802823 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:06.822776 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2c492a-c4f4-42f0-b1ae-80b21f3034cc admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:06.829625 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012b47d8-f9c6-4374-8008-2abec4a82ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:06.830525 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b47d8-f9c6-4374-8008-2abec4a82ce7 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:06.830724 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b47d8-f9c6-4374-8008-2abec4a82ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:06.830999 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b47d8-f9c6-4374-8008-2abec4a82ce7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:06.831649 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012b47d8-f9c6-4374-8008-2abec4a82ce7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:06.833807 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012b47d8-f9c6-4374-8008-2abec4a82ce7 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:06.872725 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c37a92b-1492-4584-9bf1-c2160933abd9 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:06.881570 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1078/2143] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Sep 19 14:58:06 2022] POST /identity/v3/projects => generated 365 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 14:58:06.888533 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c37a92b-1492-4584-9bf1-c2160933abd9 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:07.099626 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092b861f-b191-4e01-bb5d-87100e5a7c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:07.102176 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092b861f-b191-4e01-bb5d-87100e5a7c90 admin admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:07.103762 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092b861f-b191-4e01-bb5d-87100e5a7c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:07.104191 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092b861f-b191-4e01-bb5d-87100e5a7c90 admin admin] PATH_INFO: `/v3/users` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:07.106970 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092b861f-b191-4e01-bb5d-87100e5a7c90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:07.112101 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092b861f-b191-4e01-bb5d-87100e5a7c90 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:07.162515 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1066/2144] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Sep 19 14:58:06 2022] POST /identity/v3/users => generated 289 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:58:07.165164 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012b47d8-f9c6-4374-8008-2abec4a82ce7 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:07.204523 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012b47d8-f9c6-4374-8008-2abec4a82ce7 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:07.210339 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7291320d-05f4-4b21-bfb9-e0ea751d523b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:07.211575 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7291320d-05f4-4b21-bfb9-e0ea751d523b admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:07.211866 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7291320d-05f4-4b21-bfb9-e0ea751d523b admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:07.212144 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7291320d-05f4-4b21-bfb9-e0ea751d523b admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:07.212829 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7291320d-05f4-4b21-bfb9-e0ea751d523b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:07.214459 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7291320d-05f4-4b21-bfb9-e0ea751d523b admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:07.237799 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1079/2145] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:58:07 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:58:07.242208 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092b861f-b191-4e01-bb5d-87100e5a7c90 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:07.257307 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092b861f-b191-4e01-bb5d-87100e5a7c90 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:07.282467 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f3d770-4b0a-4d2a-ad21-dcf4284d2c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:07.283150 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f3d770-4b0a-4d2a-ad21-dcf4284d2c3d admin admin] REQUEST_METHOD: `PUT` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:07.283433 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f3d770-4b0a-4d2a-ad21-dcf4284d2c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:07.285468 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f3d770-4b0a-4d2a-ad21-dcf4284d2c3d admin admin] PATH_INFO: `/v3/projects/81150adc5cf844aea9849d70078df603/users/44241c828a4d4e08a1ebd5af6991d6df/roles/ddb643577b2e4e478100ec370decfaeb` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:07.287353 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7291320d-05f4-4b21-bfb9-e0ea751d523b admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:07.289209 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-7291320d-05f4-4b21-bfb9-e0ea751d523b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:07.315324 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f3d770-4b0a-4d2a-ad21-dcf4284d2c3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=81150adc5cf844aea9849d70078df603, user_id=44241c828a4d4e08a1ebd5af6991d6df, role_id=ddb643577b2e4e478100ec370decfaeb)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:07.321589 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f3d770-4b0a-4d2a-ad21-dcf4284d2c3d admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:07.363584 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1067/2146] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 14:58:07 2022] PUT /identity/v3/projects/81150adc5cf844aea9849d70078df603/users/44241c828a4d4e08a1ebd5af6991d6df/roles/ddb643577b2e4e478100ec370decfaeb => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 14:58:07.367795 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f3d770-4b0a-4d2a-ad21-dcf4284d2c3d admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:07.435966 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7291320d-05f4-4b21-bfb9-e0ea751d523b admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:07.489111 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f3d770-4b0a-4d2a-ad21-dcf4284d2c3d admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:07.497440 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec57fd5-89b9-465d-9db1-8362056b8f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:07.498386 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec57fd5-89b9-465d-9db1-8362056b8f8c admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:07.499014 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec57fd5-89b9-465d-9db1-8362056b8f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:07.499805 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec57fd5-89b9-465d-9db1-8362056b8f8c admin admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:07.500673 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec57fd5-89b9-465d-9db1-8362056b8f8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:07.502457 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec57fd5-89b9-465d-9db1-8362056b8f8c admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:07.519343 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1068/2147] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:58:07 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 14:58:07.523877 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec57fd5-89b9-465d-9db1-8362056b8f8c admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:07.527723 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c4a4ca-bcfd-4187-a305-d6feb0a39537 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139dc7a4f1dc48fe8faea848bd1ac0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:07.528696 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c4a4ca-bcfd-4187-a305-d6feb0a39537 service cinder] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:07.529822 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c4a4ca-bcfd-4187-a305-d6feb0a39537 service cinder] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:07.531173 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c4a4ca-bcfd-4187-a305-d6feb0a39537 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:07.534476 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-39c4a4ca-bcfd-4187-a305-d6feb0a39537 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:07.544570 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec57fd5-89b9-465d-9db1-8362056b8f8c admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:07.553205 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d9da9e-b06f-4edc-8349-6543c95fcda0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:07.553918 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d9da9e-b06f-4edc-8349-6543c95fcda0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:07.555518 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d9da9e-b06f-4edc-8349-6543c95fcda0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:07.555518 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d9da9e-b06f-4edc-8349-6543c95fcda0 admin admin] PATH_INFO: `/v3/projects/81150adc5cf844aea9849d70078df603/users/44241c828a4d4e08a1ebd5af6991d6df/roles/ddb643577b2e4e478100ec370decfaeb` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:07.556874 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d9da9e-b06f-4edc-8349-6543c95fcda0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81150adc5cf844aea9849d70078df603, user_id=44241c828a4d4e08a1ebd5af6991d6df, role_id=ddb643577b2e4e478100ec370decfaeb)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:07.560006 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d9da9e-b06f-4edc-8349-6543c95fcda0 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:07.570468 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:07.598580 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1069/2148] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 14:58:07 2022] PUT /identity/v3/projects/81150adc5cf844aea9849d70078df603/users/44241c828a4d4e08a1ebd5af6991d6df/roles/ddb643577b2e4e478100ec370decfaeb => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:58:07.600274 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab277d0-b839-49fb-9338-6e754e993d8b None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:07.600610 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab277d0-b839-49fb-9338-6e754e993d8b None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:07.600892 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab277d0-b839-49fb-9338-6e754e993d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:07.646745 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-9ab277d0-b839-49fb-9338-6e754e993d8b None None] MFA Rules not processed for user `44241c828a4d4e08a1ebd5af6991d6df`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:58:07.647919 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-9ab277d0-b839-49fb-9338-6e754e993d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:07.691497 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c4a4ca-bcfd-4187-a305-d6feb0a39537 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:07.693099 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c4a4ca-bcfd-4187-a305-d6feb0a39537 service cinder] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:07.711574 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1080/2149] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:58:07 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 14:58:07.772512 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1070/2150] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:58:07 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 14:58:07.790126 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c4a4ca-bcfd-4187-a305-d6feb0a39537 service cinder] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:07.791942 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-39c4a4ca-bcfd-4187-a305-d6feb0a39537 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:07.807038 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c4a4ca-bcfd-4187-a305-d6feb0a39537 service cinder] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:07.893626 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:07.959473 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30985036-74ad-4044-ab8f-0a5cad75bb6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139dc7a4f1dc48fe8faea848bd1ac0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:07.960210 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30985036-74ad-4044-ab8f-0a5cad75bb6d service cinder] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:07.960744 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30985036-74ad-4044-ab8f-0a5cad75bb6d service cinder] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:07.961370 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30985036-74ad-4044-ab8f-0a5cad75bb6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:07.977248 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30985036-74ad-4044-ab8f-0a5cad75bb6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:07.979615 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30985036-74ad-4044-ab8f-0a5cad75bb6d service cinder] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:07.996580 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1081/2151] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:58:07 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:58:08.153668 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab277d0-b839-49fb-9338-6e754e993d8b None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:08.172071 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab277d0-b839-49fb-9338-6e754e993d8b None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:08.175864 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d04a909-47f7-4854-a670-0648fa7982b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139dc7a4f1dc48fe8faea848bd1ac0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:08.176514 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d04a909-47f7-4854-a670-0648fa7982b7 service cinder] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:08.176797 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d04a909-47f7-4854-a670-0648fa7982b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:08.177073 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d04a909-47f7-4854-a670-0648fa7982b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:08.254592 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d04a909-47f7-4854-a670-0648fa7982b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:08.256135 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d04a909-47f7-4854-a670-0648fa7982b7 service cinder] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:08.267550 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1071/2152] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:58:08 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:58:08.937936 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30985036-74ad-4044-ab8f-0a5cad75bb6d service cinder] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:08.939907 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-30985036-74ad-4044-ab8f-0a5cad75bb6d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:09.068358 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d04a909-47f7-4854-a670-0648fa7982b7 service cinder] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:09.085280 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d04a909-47f7-4854-a670-0648fa7982b7 service cinder] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:09.093429 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eb4be2-e543-4963-950c-312cf1193d2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139dc7a4f1dc48fe8faea848bd1ac0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:09.094185 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eb4be2-e543-4963-950c-312cf1193d2c service cinder] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:09.094463 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eb4be2-e543-4963-950c-312cf1193d2c service cinder] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:09.094730 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eb4be2-e543-4963-950c-312cf1193d2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:09.101251 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-62eb4be2-e543-4963-950c-312cf1193d2c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:09.126412 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30985036-74ad-4044-ab8f-0a5cad75bb6d service cinder] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:09.134941 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debb6017-b15e-41c1-bd36-359458c7d9e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:09.135964 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debb6017-b15e-41c1-bd36-359458c7d9e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:09.136189 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debb6017-b15e-41c1-bd36-359458c7d9e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:09.136617 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debb6017-b15e-41c1-bd36-359458c7d9e6 admin admin] PATH_INFO: `/v3/users/50d5d413a5724ea298ecb47d1aff84eb` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:09.149153 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debb6017-b15e-41c1-bd36-359458c7d9e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50d5d413a5724ea298ecb47d1aff84eb)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:09.149153 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debb6017-b15e-41c1-bd36-359458c7d9e6 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:09.259561 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-debb6017-b15e-41c1-bd36-359458c7d9e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50d5d413a5724ea298ecb47d1aff84eb'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:09.281644 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eb4be2-e543-4963-950c-312cf1193d2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:09.283950 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eb4be2-e543-4963-950c-312cf1193d2c service cinder] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:09.300072 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-debb6017-b15e-41c1-bd36-359458c7d9e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50d5d413a5724ea298ecb47d1aff84eb'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:09.303050 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1072/2153] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:58:09 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:58:09.308920 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-debb6017-b15e-41c1-bd36-359458c7d9e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50d5d413a5724ea298ecb47d1aff84eb'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:09.322063 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-debb6017-b15e-41c1-bd36-359458c7d9e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50d5d413a5724ea298ecb47d1aff84eb'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:09.322790 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-debb6017-b15e-41c1-bd36-359458c7d9e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50d5d413a5724ea298ecb47d1aff84eb'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:09.336322 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1082/2154] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Sep 19 14:58:08 2022] DELETE /identity/v3/users/50d5d413a5724ea298ecb47d1aff84eb => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:58:09.340915 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d186d1-3be5-4fae-b5ab-375bba1f8655 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:09.341269 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d186d1-3be5-4fae-b5ab-375bba1f8655 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:09.341728 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d186d1-3be5-4fae-b5ab-375bba1f8655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:09.378627 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-41d186d1-3be5-4fae-b5ab-375bba1f8655 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:58:09.379244 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-41d186d1-3be5-4fae-b5ab-375bba1f8655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:09.412792 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:09.477857 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1073/2155] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:58:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 14:58:09.493903 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debb6017-b15e-41c1-bd36-359458c7d9e6 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:09.496745 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-debb6017-b15e-41c1-bd36-359458c7d9e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:09.589699 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:09.596027 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debb6017-b15e-41c1-bd36-359458c7d9e6 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:09.602801 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28331eb-3187-4982-bdcc-ad2f02ca1d0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c2b78646374cb79ded4b7b59ba49c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:09.603637 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28331eb-3187-4982-bdcc-ad2f02ca1d0a service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:09.604805 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28331eb-3187-4982-bdcc-ad2f02ca1d0a service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:09.605335 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28331eb-3187-4982-bdcc-ad2f02ca1d0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:09.620962 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28331eb-3187-4982-bdcc-ad2f02ca1d0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:09.623365 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28331eb-3187-4982-bdcc-ad2f02ca1d0a service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:09.639070 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1083/2156] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:58:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:58:10.112517 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d186d1-3be5-4fae-b5ab-375bba1f8655 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:10.114068 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-41d186d1-3be5-4fae-b5ab-375bba1f8655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:10.142800 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d186d1-3be5-4fae-b5ab-375bba1f8655 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:10.162824 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41e8ee7-43a9-4868-b3b9-cc85782c42f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:10.164108 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41e8ee7-43a9-4868-b3b9-cc85782c42f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:10.165213 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41e8ee7-43a9-4868-b3b9-cc85782c42f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:10.165758 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41e8ee7-43a9-4868-b3b9-cc85782c42f2 admin admin] PATH_INFO: `/v3/projects/b4ac6e7b3d2a4e1a82bfc416ab0436a8` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:10.167485 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41e8ee7-43a9-4868-b3b9-cc85782c42f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4ac6e7b3d2a4e1a82bfc416ab0436a8)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:10.174587 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41e8ee7-43a9-4868-b3b9-cc85782c42f2 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:10.295568 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-e41e8ee7-43a9-4868-b3b9-cc85782c42f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4ac6e7b3d2a4e1a82bfc416ab0436a8', 'request_id': 'req-e41e8ee7-43a9-4868-b3b9-cc85782c42f2'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:10.307253 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-e41e8ee7-43a9-4868-b3b9-cc85782c42f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4ac6e7b3d2a4e1a82bfc416ab0436a8', 'request_id': 'req-e41e8ee7-43a9-4868-b3b9-cc85782c42f2'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:10.316792 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-e41e8ee7-43a9-4868-b3b9-cc85782c42f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4ac6e7b3d2a4e1a82bfc416ab0436a8', 'request_id': 'req-e41e8ee7-43a9-4868-b3b9-cc85782c42f2'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:10.349796 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-e41e8ee7-43a9-4868-b3b9-cc85782c42f2 admin admin] The token cache is being invalidate because project b4ac6e7b3d2a4e1a82bfc416ab0436a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 14:58:10.350099 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-e41e8ee7-43a9-4868-b3b9-cc85782c42f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:10.350805 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-e41e8ee7-43a9-4868-b3b9-cc85782c42f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:10.353521 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1074/2157] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Sep 19 14:58:10 2022] DELETE /identity/v3/projects/b4ac6e7b3d2a4e1a82bfc416ab0436a8 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:58:10.357819 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28331eb-3187-4982-bdcc-ad2f02ca1d0a service neutron] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:10.370339 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28331eb-3187-4982-bdcc-ad2f02ca1d0a service neutron] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:10.480842 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103c8459-4214-4ada-9b4c-4d45cca34d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:10.481740 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103c8459-4214-4ada-9b4c-4d45cca34d63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:10.482090 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103c8459-4214-4ada-9b4c-4d45cca34d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:10.483190 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103c8459-4214-4ada-9b4c-4d45cca34d63 admin admin] PATH_INFO: `/v3/users/9656334917264af7b80175c67794d5f5` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:10.484511 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103c8459-4214-4ada-9b4c-4d45cca34d63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9656334917264af7b80175c67794d5f5)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:10.486964 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103c8459-4214-4ada-9b4c-4d45cca34d63 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:10.585725 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-103c8459-4214-4ada-9b4c-4d45cca34d63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9656334917264af7b80175c67794d5f5'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:10.609388 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-103c8459-4214-4ada-9b4c-4d45cca34d63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9656334917264af7b80175c67794d5f5'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:10.620194 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-103c8459-4214-4ada-9b4c-4d45cca34d63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9656334917264af7b80175c67794d5f5'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:10.632588 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-103c8459-4214-4ada-9b4c-4d45cca34d63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9656334917264af7b80175c67794d5f5'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:10.633562 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-103c8459-4214-4ada-9b4c-4d45cca34d63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9656334917264af7b80175c67794d5f5'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:10.644698 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1084/2158] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Sep 19 14:58:10 2022] DELETE /identity/v3/users/9656334917264af7b80175c67794d5f5 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:58:11.366778 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41e8ee7-43a9-4868-b3b9-cc85782c42f2 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:11.368283 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-e41e8ee7-43a9-4868-b3b9-cc85782c42f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:11.391976 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41e8ee7-43a9-4868-b3b9-cc85782c42f2 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:11.613116 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f93b42b-9864-40ec-9d83-39726150fcd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:11.614199 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f93b42b-9864-40ec-9d83-39726150fcd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:11.615183 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f93b42b-9864-40ec-9d83-39726150fcd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:11.618161 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f93b42b-9864-40ec-9d83-39726150fcd1 admin admin] PATH_INFO: `/v3/projects/73718a65c0174c0386342eebfbd2fc4b` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:11.620909 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f93b42b-9864-40ec-9d83-39726150fcd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73718a65c0174c0386342eebfbd2fc4b)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:11.623337 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f93b42b-9864-40ec-9d83-39726150fcd1 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:11.815535 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:11.821397 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-7f93b42b-9864-40ec-9d83-39726150fcd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73718a65c0174c0386342eebfbd2fc4b', 'request_id': 'req-7f93b42b-9864-40ec-9d83-39726150fcd1'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:11.844679 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-7f93b42b-9864-40ec-9d83-39726150fcd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73718a65c0174c0386342eebfbd2fc4b', 'request_id': 'req-7f93b42b-9864-40ec-9d83-39726150fcd1'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:11.854364 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-7f93b42b-9864-40ec-9d83-39726150fcd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73718a65c0174c0386342eebfbd2fc4b', 'request_id': 'req-7f93b42b-9864-40ec-9d83-39726150fcd1'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:11.870144 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-7f93b42b-9864-40ec-9d83-39726150fcd1 admin admin] The token cache is being invalidate because project 73718a65c0174c0386342eebfbd2fc4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 14:58:11.871043 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-7f93b42b-9864-40ec-9d83-39726150fcd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:11.872131 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-7f93b42b-9864-40ec-9d83-39726150fcd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:11.875293 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1075/2159] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Sep 19 14:58:11 2022] DELETE /identity/v3/projects/73718a65c0174c0386342eebfbd2fc4b => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:58:11.880925 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c169b4-2c38-4902-be83-e6a80e9f614e None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:11.884306 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c169b4-2c38-4902-be83-e6a80e9f614e None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:11.884763 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c169b4-2c38-4902-be83-e6a80e9f614e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:11.950162 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-83c169b4-2c38-4902-be83-e6a80e9f614e None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:58:11.956561 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-83c169b4-2c38-4902-be83-e6a80e9f614e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:12.130681 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1085/2160] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:58:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:58:12.134574 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfc71a4-ffa1-416f-a139-da8608bf1576 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:12.134864 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfc71a4-ffa1-416f-a139-da8608bf1576 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:12.135767 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfc71a4-ffa1-416f-a139-da8608bf1576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:12.177064 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-1bfc71a4-ffa1-416f-a139-da8608bf1576 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:58:12.178940 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-1bfc71a4-ffa1-416f-a139-da8608bf1576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:12.193439 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1076/2161] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:58:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:58:12.198129 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c169b4-2c38-4902-be83-e6a80e9f614e None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:12.209026 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c169b4-2c38-4902-be83-e6a80e9f614e None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:12.214429 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06acb95a-e96a-4797-a6b1-6d38c7c7800c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:12.215062 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06acb95a-e96a-4797-a6b1-6d38c7c7800c admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:12.215333 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06acb95a-e96a-4797-a6b1-6d38c7c7800c admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:12.215610 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06acb95a-e96a-4797-a6b1-6d38c7c7800c admin admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:12.216268 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06acb95a-e96a-4797-a6b1-6d38c7c7800c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:58:12.216621 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06acb95a-e96a-4797-a6b1-6d38c7c7800c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:12.218360 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06acb95a-e96a-4797-a6b1-6d38c7c7800c admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:12.231544 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:12.241269 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1086/2162] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Sep 19 14:58:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:58:12.247207 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfc71a4-ffa1-416f-a139-da8608bf1576 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:12.259023 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfc71a4-ffa1-416f-a139-da8608bf1576 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:12.267701 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de01830-f303-4608-ac07-3faf8a3898a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:12.268688 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de01830-f303-4608-ac07-3faf8a3898a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:12.269146 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de01830-f303-4608-ac07-3faf8a3898a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:12.269579 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de01830-f303-4608-ac07-3faf8a3898a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:12.270535 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de01830-f303-4608-ac07-3faf8a3898a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:12.273192 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de01830-f303-4608-ac07-3faf8a3898a2 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:12.316840 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1077/2163] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Sep 19 14:58:12 2022] POST /identity/v3/projects => generated 387 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:58:12.325463 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06acb95a-e96a-4797-a6b1-6d38c7c7800c admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:12.347602 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06acb95a-e96a-4797-a6b1-6d38c7c7800c admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:12.441276 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c69080-588a-49aa-8ec6-07f973ab77ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:12.442051 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c69080-588a-49aa-8ec6-07f973ab77ca admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:12.442455 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c69080-588a-49aa-8ec6-07f973ab77ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:12.442736 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c69080-588a-49aa-8ec6-07f973ab77ca admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:12.443384 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c69080-588a-49aa-8ec6-07f973ab77ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:12.446426 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c69080-588a-49aa-8ec6-07f973ab77ca admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:12.492951 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1087/2164] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Sep 19 14:58:12 2022] POST /identity/v3/users => generated 294 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:58:12.493039 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de01830-f303-4608-ac07-3faf8a3898a2 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:12.513198 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de01830-f303-4608-ac07-3faf8a3898a2 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:12.522369 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f55e93-0b1b-480a-b484-5a9c92da9931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:12.523045 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f55e93-0b1b-480a-b484-5a9c92da9931 admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:12.523627 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f55e93-0b1b-480a-b484-5a9c92da9931 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:12.523941 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f55e93-0b1b-480a-b484-5a9c92da9931 admin admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:12.524922 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f55e93-0b1b-480a-b484-5a9c92da9931 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:12.534404 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f55e93-0b1b-480a-b484-5a9c92da9931 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:12.549639 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1078/2165] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:58:12 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:58:12.550813 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c69080-588a-49aa-8ec6-07f973ab77ca admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:12.569355 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c69080-588a-49aa-8ec6-07f973ab77ca admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:12.579718 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3866190e-5cd8-4e84-a9a9-058570c2a89d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:12.580368 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3866190e-5cd8-4e84-a9a9-058570c2a89d admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:12.582716 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3866190e-5cd8-4e84-a9a9-058570c2a89d admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:12.582716 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3866190e-5cd8-4e84-a9a9-058570c2a89d admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:12.582716 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3866190e-5cd8-4e84-a9a9-058570c2a89d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:12.583515 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3866190e-5cd8-4e84-a9a9-058570c2a89d admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:12.618505 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1088/2166] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:58:12 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:58:12.622287 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f55e93-0b1b-480a-b484-5a9c92da9931 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:12.642411 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f55e93-0b1b-480a-b484-5a9c92da9931 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:12.655411 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea11b94b-3df4-4f29-b536-275ab091e65d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:12.657015 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea11b94b-3df4-4f29-b536-275ab091e65d admin admin] REQUEST_METHOD: `PUT` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:12.657311 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea11b94b-3df4-4f29-b536-275ab091e65d admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:12.657733 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea11b94b-3df4-4f29-b536-275ab091e65d admin admin] PATH_INFO: `/v3/projects/6cd9350b6c65485b9f43092c23f14456/users/3315180c2bca4677adb5c69d4b43bee2/roles/efa0e5b3413748dc828a89b12d67df79` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:12.679186 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea11b94b-3df4-4f29-b536-275ab091e65d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cd9350b6c65485b9f43092c23f14456, user_id=3315180c2bca4677adb5c69d4b43bee2, role_id=efa0e5b3413748dc828a89b12d67df79)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:12.684079 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea11b94b-3df4-4f29-b536-275ab091e65d admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:12.714804 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1079/2167] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 14:58:12 2022] PUT /identity/v3/projects/6cd9350b6c65485b9f43092c23f14456/users/3315180c2bca4677adb5c69d4b43bee2/roles/efa0e5b3413748dc828a89b12d67df79 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:58:12.740807 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a84987-342c-4603-b683-3c3e82e50185 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:12.740807 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a84987-342c-4603-b683-3c3e82e50185 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:12.740807 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a84987-342c-4603-b683-3c3e82e50185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:12.781843 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-71a84987-342c-4603-b683-3c3e82e50185 None None] MFA Rules not processed for user `3315180c2bca4677adb5c69d4b43bee2`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:58:12.783480 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-71a84987-342c-4603-b683-3c3e82e50185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:12.911001 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ae9033-fb2e-4a1f-abc2-8c54c0c27f91 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:12.911389 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ae9033-fb2e-4a1f-abc2-8c54c0c27f91 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:12.911763 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ae9033-fb2e-4a1f-abc2-8c54c0c27f91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:12.920380 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1089/2168] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:58:12 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:58:12.925980 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a84987-342c-4603-b683-3c3e82e50185 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:12.955283 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-e7ae9033-fb2e-4a1f-abc2-8c54c0c27f91 None None] MFA Rules not processed for user `b5fbe11b49b24fdb80257652ed9fe298`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:58:12.955283 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-e7ae9033-fb2e-4a1f-abc2-8c54c0c27f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:13.023032 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a84987-342c-4603-b683-3c3e82e50185 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:13.038107 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d916385-17ee-4b9a-a86c-e826dfa82260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:13.039085 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d916385-17ee-4b9a-a86c-e826dfa82260 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:13.039507 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d916385-17ee-4b9a-a86c-e826dfa82260 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:13.039959 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d916385-17ee-4b9a-a86c-e826dfa82260 admin admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:13.041787 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d916385-17ee-4b9a-a86c-e826dfa82260 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:13.045043 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d916385-17ee-4b9a-a86c-e826dfa82260 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:13.058783 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1080/2169] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:58:12 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 14:58:13.065233 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:13.077729 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ae9033-fb2e-4a1f-abc2-8c54c0c27f91 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:13.082712 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-e7ae9033-fb2e-4a1f-abc2-8c54c0c27f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:13.096695 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1090/2170] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Sep 19 14:58:12 2022] POST /identity/v3/projects => generated 381 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:58:13.100359 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d916385-17ee-4b9a-a86c-e826dfa82260 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:13.191819 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:13.229829 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d916385-17ee-4b9a-a86c-e826dfa82260 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:13.233032 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ae9033-fb2e-4a1f-abc2-8c54c0c27f91 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:13.241608 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737f93e2-5b5b-4e70-bf05-173e7e714e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:13.242290 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f93e2-5b5b-4e70-bf05-173e7e714e4b admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:13.242583 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f93e2-5b5b-4e70-bf05-173e7e714e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:13.243221 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f93e2-5b5b-4e70-bf05-173e7e714e4b admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:13.243580 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737f93e2-5b5b-4e70-bf05-173e7e714e4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:13.247345 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737f93e2-5b5b-4e70-bf05-173e7e714e4b admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:13.288691 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1091/2171] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Sep 19 14:58:13 2022] POST /identity/v3/users => generated 297 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:58:13.302175 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737f93e2-5b5b-4e70-bf05-173e7e714e4b admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:13.315083 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737f93e2-5b5b-4e70-bf05-173e7e714e4b admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:13.320872 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7433ae-3075-4125-b9b8-641ca16d6c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:13.321482 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7433ae-3075-4125-b9b8-641ca16d6c08 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:13.321763 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7433ae-3075-4125-b9b8-641ca16d6c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:13.322040 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7433ae-3075-4125-b9b8-641ca16d6c08 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:13.322685 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7433ae-3075-4125-b9b8-641ca16d6c08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:13.324292 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7433ae-3075-4125-b9b8-641ca16d6c08 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:13.336883 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1092/2172] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:58:13 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 14:58:13.341321 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7433ae-3075-4125-b9b8-641ca16d6c08 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:13.341816 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a1e5f6-d3b7-48a4-867d-42a1578f28e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055439dc35e946f4a82535c684f9b60d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:13.343094 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a1e5f6-d3b7-48a4-867d-42a1578f28e5 service nova] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:13.343441 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a1e5f6-d3b7-48a4-867d-42a1578f28e5 service nova] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:13.343910 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a1e5f6-d3b7-48a4-867d-42a1578f28e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:13.353367 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7433ae-3075-4125-b9b8-641ca16d6c08 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:13.359200 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0102d76-9358-4ff4-84e1-bc9e91d4fea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:13.359874 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0102d76-9358-4ff4-84e1-bc9e91d4fea8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:13.360158 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0102d76-9358-4ff4-84e1-bc9e91d4fea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:13.360540 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0102d76-9358-4ff4-84e1-bc9e91d4fea8 admin admin] PATH_INFO: `/v3/projects/0997ee8a702e44f7b4a35c297b2e4ddf/users/f5e3fd54f1fb4e9081da60b729b8eae0/roles/ddb643577b2e4e478100ec370decfaeb` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:13.377297 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0102d76-9358-4ff4-84e1-bc9e91d4fea8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0997ee8a702e44f7b4a35c297b2e4ddf, user_id=f5e3fd54f1fb4e9081da60b729b8eae0, role_id=ddb643577b2e4e478100ec370decfaeb)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:13.383798 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0102d76-9358-4ff4-84e1-bc9e91d4fea8 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:13.407517 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1093/2173] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 14:58:13 2022] PUT /identity/v3/projects/0997ee8a702e44f7b4a35c297b2e4ddf/users/f5e3fd54f1fb4e9081da60b729b8eae0/roles/ddb643577b2e4e478100ec370decfaeb => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 14:58:13.411086 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0102d76-9358-4ff4-84e1-bc9e91d4fea8 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:13.418229 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a1e5f6-d3b7-48a4-867d-42a1578f28e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:13.420058 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a1e5f6-d3b7-48a4-867d-42a1578f28e5 service nova] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:13.434554 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1081/2174] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:58:13 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:58:13.497430 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0102d76-9358-4ff4-84e1-bc9e91d4fea8 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:13.506990 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82496f9a-2063-4c7b-ae9d-9e1b78aa0fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:13.507996 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82496f9a-2063-4c7b-ae9d-9e1b78aa0fdf admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:13.508481 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82496f9a-2063-4c7b-ae9d-9e1b78aa0fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:13.508759 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82496f9a-2063-4c7b-ae9d-9e1b78aa0fdf admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:13.509843 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82496f9a-2063-4c7b-ae9d-9e1b78aa0fdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:13.512115 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82496f9a-2063-4c7b-ae9d-9e1b78aa0fdf admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:13.524929 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1094/2175] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:58:13 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 14:58:13.529170 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a1e5f6-d3b7-48a4-867d-42a1578f28e5 service nova] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:13.544865 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a1e5f6-d3b7-48a4-867d-42a1578f28e5 service nova] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:13.556527 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad3fb64-4c1a-4262-be4e-d8e32ae622d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:13.557340 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad3fb64-4c1a-4262-be4e-d8e32ae622d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:13.557779 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad3fb64-4c1a-4262-be4e-d8e32ae622d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:13.558096 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad3fb64-4c1a-4262-be4e-d8e32ae622d6 admin admin] PATH_INFO: `/v3/projects/0997ee8a702e44f7b4a35c297b2e4ddf/users/f5e3fd54f1fb4e9081da60b729b8eae0/roles/ddb643577b2e4e478100ec370decfaeb` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:13.566310 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad3fb64-4c1a-4262-be4e-d8e32ae622d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0997ee8a702e44f7b4a35c297b2e4ddf, user_id=f5e3fd54f1fb4e9081da60b729b8eae0, role_id=ddb643577b2e4e478100ec370decfaeb)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:13.570133 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad3fb64-4c1a-4262-be4e-d8e32ae622d6 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:13.584829 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1082/2176] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 14:58:13 2022] PUT /identity/v3/projects/0997ee8a702e44f7b4a35c297b2e4ddf/users/f5e3fd54f1fb4e9081da60b729b8eae0/roles/ddb643577b2e4e478100ec370decfaeb => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 14:58:13.596033 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e307f0c-3db0-4810-a9d6-161c0cc9e7b1 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:13.596320 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e307f0c-3db0-4810-a9d6-161c0cc9e7b1 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:13.596660 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e307f0c-3db0-4810-a9d6-161c0cc9e7b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:13.643526 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-6e307f0c-3db0-4810-a9d6-161c0cc9e7b1 None None] MFA Rules not processed for user `f5e3fd54f1fb4e9081da60b729b8eae0`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:58:13.645782 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-6e307f0c-3db0-4810-a9d6-161c0cc9e7b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:13.725282 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:13.820649 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1095/2177] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:58:13 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:58:13.832457 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad3fb64-4c1a-4262-be4e-d8e32ae622d6 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:13.835239 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-6ad3fb64-4c1a-4262-be4e-d8e32ae622d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:13.968578 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad3fb64-4c1a-4262-be4e-d8e32ae622d6 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:13.984571 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518b19e8-3a1a-4072-9394-7279010674db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139dc7a4f1dc48fe8faea848bd1ac0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:13.985744 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b19e8-3a1a-4072-9394-7279010674db service cinder] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:13.985744 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b19e8-3a1a-4072-9394-7279010674db service cinder] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:13.985943 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b19e8-3a1a-4072-9394-7279010674db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:13.998284 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518b19e8-3a1a-4072-9394-7279010674db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:14.000680 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518b19e8-3a1a-4072-9394-7279010674db service cinder] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:14.023316 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1083/2178] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:58:13 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 14:58:14.307788 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e307f0c-3db0-4810-a9d6-161c0cc9e7b1 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:14.310275 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-6e307f0c-3db0-4810-a9d6-161c0cc9e7b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:14.465043 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e307f0c-3db0-4810-a9d6-161c0cc9e7b1 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:14.479945 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2031f143-31b4-47cb-9e6c-192c7d6905da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:14.481343 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2031f143-31b4-47cb-9e6c-192c7d6905da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:14.481343 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2031f143-31b4-47cb-9e6c-192c7d6905da admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:14.481562 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2031f143-31b4-47cb-9e6c-192c7d6905da admin admin] PATH_INFO: `/v3/users/4413b1d4506943c9b305d7700d0da045` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:14.484484 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2031f143-31b4-47cb-9e6c-192c7d6905da admin admin] RBAC: Authorizing `identity:delete_user(user_id=4413b1d4506943c9b305d7700d0da045)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:14.490240 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2031f143-31b4-47cb-9e6c-192c7d6905da admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:14.607574 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-2031f143-31b4-47cb-9e6c-192c7d6905da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4413b1d4506943c9b305d7700d0da045'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:14.650577 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-2031f143-31b4-47cb-9e6c-192c7d6905da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4413b1d4506943c9b305d7700d0da045'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:14.675072 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-2031f143-31b4-47cb-9e6c-192c7d6905da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4413b1d4506943c9b305d7700d0da045'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:14.689902 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-2031f143-31b4-47cb-9e6c-192c7d6905da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4413b1d4506943c9b305d7700d0da045'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:14.690816 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-2031f143-31b4-47cb-9e6c-192c7d6905da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4413b1d4506943c9b305d7700d0da045'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:14.703050 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1096/2179] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Sep 19 14:58:14 2022] DELETE /identity/v3/users/4413b1d4506943c9b305d7700d0da045 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:58:14.707111 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b1dd2f-b1c2-4604-8e33-353a9dd9bd6d None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:14.708034 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b1dd2f-b1c2-4604-8e33-353a9dd9bd6d None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:14.708812 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b1dd2f-b1c2-4604-8e33-353a9dd9bd6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:14.760040 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-94b1dd2f-b1c2-4604-8e33-353a9dd9bd6d None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:58:14.763925 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-94b1dd2f-b1c2-4604-8e33-353a9dd9bd6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:14.822321 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:14.924186 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1084/2180] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:58:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 14:58:14.937379 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2031f143-31b4-47cb-9e6c-192c7d6905da admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:14.939445 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-2031f143-31b4-47cb-9e6c-192c7d6905da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:15.064865 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:15.081154 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2031f143-31b4-47cb-9e6c-192c7d6905da admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:15.089217 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58001e29-a35e-4853-9e83-51f38e4d6005 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c2b78646374cb79ded4b7b59ba49c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:15.089941 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58001e29-a35e-4853-9e83-51f38e4d6005 service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:15.091160 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58001e29-a35e-4853-9e83-51f38e4d6005 service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:15.091521 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58001e29-a35e-4853-9e83-51f38e4d6005 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:15.108685 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b1dd2f-b1c2-4604-8e33-353a9dd9bd6d None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:15.110767 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-94b1dd2f-b1c2-4604-8e33-353a9dd9bd6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:15.111208 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58001e29-a35e-4853-9e83-51f38e4d6005 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:15.112895 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58001e29-a35e-4853-9e83-51f38e4d6005 service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:15.130780 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1097/2181] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:58:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:58:15.136447 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b1dd2f-b1c2-4604-8e33-353a9dd9bd6d None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:15.148139 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf6001f-16f7-425b-ba52-4cb62de8c3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:15.148816 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf6001f-16f7-425b-ba52-4cb62de8c3aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:15.149102 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf6001f-16f7-425b-ba52-4cb62de8c3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:15.149377 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf6001f-16f7-425b-ba52-4cb62de8c3aa admin admin] PATH_INFO: `/v3/users/46018b24e97e4c75b5561aac3405180c` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:15.153084 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf6001f-16f7-425b-ba52-4cb62de8c3aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=46018b24e97e4c75b5561aac3405180c)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:15.154312 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf6001f-16f7-425b-ba52-4cb62de8c3aa admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:15.282628 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-dcf6001f-16f7-425b-ba52-4cb62de8c3aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46018b24e97e4c75b5561aac3405180c'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:15.322000 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-dcf6001f-16f7-425b-ba52-4cb62de8c3aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46018b24e97e4c75b5561aac3405180c'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:15.342636 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-dcf6001f-16f7-425b-ba52-4cb62de8c3aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46018b24e97e4c75b5561aac3405180c'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:15.347749 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-dcf6001f-16f7-425b-ba52-4cb62de8c3aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46018b24e97e4c75b5561aac3405180c'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:15.358832 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-dcf6001f-16f7-425b-ba52-4cb62de8c3aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46018b24e97e4c75b5561aac3405180c'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:15.377343 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1085/2182] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Sep 19 14:58:15 2022] DELETE /identity/v3/users/46018b24e97e4c75b5561aac3405180c => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 14:58:15.380037 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04d15bc-f301-4184-b384-6bc9eb140464 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:15.380693 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04d15bc-f301-4184-b384-6bc9eb140464 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:15.380693 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04d15bc-f301-4184-b384-6bc9eb140464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:15.407188 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf6001f-16f7-425b-ba52-4cb62de8c3aa admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:15.409049 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-dcf6001f-16f7-425b-ba52-4cb62de8c3aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:15.410935 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-b04d15bc-f301-4184-b384-6bc9eb140464 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:58:15.413095 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-b04d15bc-f301-4184-b384-6bc9eb140464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:15.541429 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1098/2183] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:58:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:58:15.547673 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04d15bc-f301-4184-b384-6bc9eb140464 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:15.549328 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-b04d15bc-f301-4184-b384-6bc9eb140464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:15.561826 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf6001f-16f7-425b-ba52-4cb62de8c3aa admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:15.575920 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeb4620-52c3-4313-ac49-11c1d1af3b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:15.576690 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeb4620-52c3-4313-ac49-11c1d1af3b13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:15.577535 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeb4620-52c3-4313-ac49-11c1d1af3b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:15.579028 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeb4620-52c3-4313-ac49-11c1d1af3b13 admin admin] PATH_INFO: `/v3/users/3315180c2bca4677adb5c69d4b43bee2` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:15.582198 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aeb4620-52c3-4313-ac49-11c1d1af3b13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3315180c2bca4677adb5c69d4b43bee2)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:15.586442 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aeb4620-52c3-4313-ac49-11c1d1af3b13 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:15.652254 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04d15bc-f301-4184-b384-6bc9eb140464 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:15.663074 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568a5257-0142-4ae7-a873-e7c1911fab40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c2b78646374cb79ded4b7b59ba49c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:15.663825 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a5257-0142-4ae7-a873-e7c1911fab40 service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:15.664182 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a5257-0142-4ae7-a873-e7c1911fab40 service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:15.664686 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a5257-0142-4ae7-a873-e7c1911fab40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:15.698433 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568a5257-0142-4ae7-a873-e7c1911fab40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:15.700280 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568a5257-0142-4ae7-a873-e7c1911fab40 service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:15.700466 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:15.717181 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-3aeb4620-52c3-4313-ac49-11c1d1af3b13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3315180c2bca4677adb5c69d4b43bee2'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:15.746432 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1099/2184] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:58:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 14:58:15.753158 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568a5257-0142-4ae7-a873-e7c1911fab40 service neutron] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:15.757396 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-568a5257-0142-4ae7-a873-e7c1911fab40 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:15.760503 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-3aeb4620-52c3-4313-ac49-11c1d1af3b13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3315180c2bca4677adb5c69d4b43bee2'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:15.789575 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-3aeb4620-52c3-4313-ac49-11c1d1af3b13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3315180c2bca4677adb5c69d4b43bee2'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:15.792096 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-3aeb4620-52c3-4313-ac49-11c1d1af3b13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3315180c2bca4677adb5c69d4b43bee2'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:15.795685 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568a5257-0142-4ae7-a873-e7c1911fab40 service neutron] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:15.805602 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baefe83-bb4e-4f88-b0e7-becc257ff2fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:15.806807 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baefe83-bb4e-4f88-b0e7-becc257ff2fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:15.807095 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baefe83-bb4e-4f88-b0e7-becc257ff2fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:15.807728 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baefe83-bb4e-4f88-b0e7-becc257ff2fe admin admin] PATH_INFO: `/v3/projects/0917ba3911fe475c9894ba638a3cfe8f` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:15.809178 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-3aeb4620-52c3-4313-ac49-11c1d1af3b13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3315180c2bca4677adb5c69d4b43bee2'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:15.815125 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baefe83-bb4e-4f88-b0e7-becc257ff2fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=0917ba3911fe475c9894ba638a3cfe8f)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:15.820244 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1086/2185] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Sep 19 14:58:15 2022] DELETE /identity/v3/users/3315180c2bca4677adb5c69d4b43bee2 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:58:15.824785 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1221fc-dd11-4335-a87f-eb6a5c1e0125 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:15.825275 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1221fc-dd11-4335-a87f-eb6a5c1e0125 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:15.825694 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1221fc-dd11-4335-a87f-eb6a5c1e0125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:15.825878 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baefe83-bb4e-4f88-b0e7-becc257ff2fe admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:15.887886 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-3b1221fc-dd11-4335-a87f-eb6a5c1e0125 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:58:15.890205 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-3b1221fc-dd11-4335-a87f-eb6a5c1e0125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:15.988279 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-0baefe83-bb4e-4f88-b0e7-becc257ff2fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0917ba3911fe475c9894ba638a3cfe8f', 'request_id': 'req-0baefe83-bb4e-4f88-b0e7-becc257ff2fe'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:16.010876 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-0baefe83-bb4e-4f88-b0e7-becc257ff2fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0917ba3911fe475c9894ba638a3cfe8f', 'request_id': 'req-0baefe83-bb4e-4f88-b0e7-becc257ff2fe'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:16.019704 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-0baefe83-bb4e-4f88-b0e7-becc257ff2fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0917ba3911fe475c9894ba638a3cfe8f', 'request_id': 'req-0baefe83-bb4e-4f88-b0e7-becc257ff2fe'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:16.051357 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-0baefe83-bb4e-4f88-b0e7-becc257ff2fe admin admin] The token cache is being invalidate because project 0917ba3911fe475c9894ba638a3cfe8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 14:58:16.051746 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-0baefe83-bb4e-4f88-b0e7-becc257ff2fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:16.052537 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-0baefe83-bb4e-4f88-b0e7-becc257ff2fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:16.055622 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1100/2186] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Sep 19 14:58:15 2022] DELETE /identity/v3/projects/0917ba3911fe475c9894ba638a3cfe8f => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:58:16.062305 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1087/2187] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:58:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:58:16.063343 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1221fc-dd11-4335-a87f-eb6a5c1e0125 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:16.064722 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-3b1221fc-dd11-4335-a87f-eb6a5c1e0125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:16.070377 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df92d19a-91d5-4e15-95ed-cc26ad7337b8 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:16.070716 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df92d19a-91d5-4e15-95ed-cc26ad7337b8 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:16.071091 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df92d19a-91d5-4e15-95ed-cc26ad7337b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:16.094715 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1221fc-dd11-4335-a87f-eb6a5c1e0125 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:16.098055 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-df92d19a-91d5-4e15-95ed-cc26ad7337b8 None None] MFA Rules not processed for user `b5fbe11b49b24fdb80257652ed9fe298`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:58:16.099472 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-df92d19a-91d5-4e15-95ed-cc26ad7337b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:16.122174 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:16.208880 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1101/2188] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:58:16 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:58:16.209784 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df92d19a-91d5-4e15-95ed-cc26ad7337b8 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:16.211632 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-df92d19a-91d5-4e15-95ed-cc26ad7337b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:16.237375 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39653cc-5d72-4101-8535-843c37583f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:16.239451 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39653cc-5d72-4101-8535-843c37583f4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:16.239755 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39653cc-5d72-4101-8535-843c37583f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:16.240037 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39653cc-5d72-4101-8535-843c37583f4e admin admin] PATH_INFO: `/v3/users/70cd86580fb84b6e94c8f714ac8a492b` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:16.242821 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39653cc-5d72-4101-8535-843c37583f4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=70cd86580fb84b6e94c8f714ac8a492b)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:16.245787 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39653cc-5d72-4101-8535-843c37583f4e admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:16.335756 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-c39653cc-5d72-4101-8535-843c37583f4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70cd86580fb84b6e94c8f714ac8a492b'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:16.352099 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:16.361015 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-c39653cc-5d72-4101-8535-843c37583f4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70cd86580fb84b6e94c8f714ac8a492b'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:16.370663 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-c39653cc-5d72-4101-8535-843c37583f4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70cd86580fb84b6e94c8f714ac8a492b'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:16.372458 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-c39653cc-5d72-4101-8535-843c37583f4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70cd86580fb84b6e94c8f714ac8a492b'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:16.392073 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df92d19a-91d5-4e15-95ed-cc26ad7337b8 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:16.395596 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-c39653cc-5d72-4101-8535-843c37583f4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70cd86580fb84b6e94c8f714ac8a492b'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:16.399269 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a34309-f273-406d-a0f0-27e0babcd487 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c2b78646374cb79ded4b7b59ba49c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:16.400600 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a34309-f273-406d-a0f0-27e0babcd487 service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:16.401240 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a34309-f273-406d-a0f0-27e0babcd487 service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:16.401680 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a34309-f273-406d-a0f0-27e0babcd487 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:16.405612 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-77a34309-f273-406d-a0f0-27e0babcd487 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:16.416905 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1088/2189] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Sep 19 14:58:16 2022] DELETE /identity/v3/users/70cd86580fb84b6e94c8f714ac8a492b => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:58:16.440590 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a34309-f273-406d-a0f0-27e0babcd487 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:16.443547 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a34309-f273-406d-a0f0-27e0babcd487 service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:16.461074 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1102/2190] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:58:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:58:16.682504 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39653cc-5d72-4101-8535-843c37583f4e admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:16.685328 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-c39653cc-5d72-4101-8535-843c37583f4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:16.806575 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39653cc-5d72-4101-8535-843c37583f4e admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:16.812392 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a4ff75-8942-4b7f-87c1-6da8ef165f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:16.813161 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a4ff75-8942-4b7f-87c1-6da8ef165f9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:16.813565 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a4ff75-8942-4b7f-87c1-6da8ef165f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:16.813944 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a4ff75-8942-4b7f-87c1-6da8ef165f9e admin admin] PATH_INFO: `/v3/projects/46db57ace97b427ebcfc9d91df98ac21` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:16.815478 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a4ff75-8942-4b7f-87c1-6da8ef165f9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=46db57ace97b427ebcfc9d91df98ac21)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:16.818004 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a4ff75-8942-4b7f-87c1-6da8ef165f9e admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:16.929364 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-34a4ff75-8942-4b7f-87c1-6da8ef165f9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46db57ace97b427ebcfc9d91df98ac21', 'request_id': 'req-34a4ff75-8942-4b7f-87c1-6da8ef165f9e'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:16.940513 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-34a4ff75-8942-4b7f-87c1-6da8ef165f9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46db57ace97b427ebcfc9d91df98ac21', 'request_id': 'req-34a4ff75-8942-4b7f-87c1-6da8ef165f9e'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:16.951683 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-34a4ff75-8942-4b7f-87c1-6da8ef165f9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46db57ace97b427ebcfc9d91df98ac21', 'request_id': 'req-34a4ff75-8942-4b7f-87c1-6da8ef165f9e'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:16.966458 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-34a4ff75-8942-4b7f-87c1-6da8ef165f9e admin admin] The token cache is being invalidate because project 46db57ace97b427ebcfc9d91df98ac21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 14:58:16.966841 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-34a4ff75-8942-4b7f-87c1-6da8ef165f9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:16.967949 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-34a4ff75-8942-4b7f-87c1-6da8ef165f9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:16.969832 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1089/2191] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Sep 19 14:58:16 2022] DELETE /identity/v3/projects/46db57ace97b427ebcfc9d91df98ac21 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:58:16.974456 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a34309-f273-406d-a0f0-27e0babcd487 service neutron] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:16.990788 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a34309-f273-406d-a0f0-27e0babcd487 service neutron] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:17.089329 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cab6870-d013-4da2-ab0b-1500fe3c70cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:17.090021 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cab6870-d013-4da2-ab0b-1500fe3c70cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:17.090304 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cab6870-d013-4da2-ab0b-1500fe3c70cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:17.090665 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cab6870-d013-4da2-ab0b-1500fe3c70cc admin admin] PATH_INFO: `/v3/users/44241c828a4d4e08a1ebd5af6991d6df` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:17.092414 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cab6870-d013-4da2-ab0b-1500fe3c70cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=44241c828a4d4e08a1ebd5af6991d6df)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:17.096757 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cab6870-d013-4da2-ab0b-1500fe3c70cc admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:17.201336 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-1cab6870-d013-4da2-ab0b-1500fe3c70cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44241c828a4d4e08a1ebd5af6991d6df'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:17.235444 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-1cab6870-d013-4da2-ab0b-1500fe3c70cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44241c828a4d4e08a1ebd5af6991d6df'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:17.237723 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:17.247774 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-1cab6870-d013-4da2-ab0b-1500fe3c70cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44241c828a4d4e08a1ebd5af6991d6df'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:17.268139 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-1cab6870-d013-4da2-ab0b-1500fe3c70cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44241c828a4d4e08a1ebd5af6991d6df'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:17.270091 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-1cab6870-d013-4da2-ab0b-1500fe3c70cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44241c828a4d4e08a1ebd5af6991d6df'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:17.282830 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1103/2192] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Sep 19 14:58:16 2022] DELETE /identity/v3/users/44241c828a4d4e08a1ebd5af6991d6df => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:58:17.433264 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a4ff75-8942-4b7f-87c1-6da8ef165f9e admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:17.439406 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-34a4ff75-8942-4b7f-87c1-6da8ef165f9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:17.468166 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a4ff75-8942-4b7f-87c1-6da8ef165f9e admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:17.605310 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a30ea76-546f-43e7-97e1-b6e8e4453d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:17.605982 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a30ea76-546f-43e7-97e1-b6e8e4453d43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:17.606261 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a30ea76-546f-43e7-97e1-b6e8e4453d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:17.606536 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a30ea76-546f-43e7-97e1-b6e8e4453d43 admin admin] PATH_INFO: `/v3/projects/4825e649d2d64dc58dd7141bcc168c45` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:17.612912 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a30ea76-546f-43e7-97e1-b6e8e4453d43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4825e649d2d64dc58dd7141bcc168c45)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:17.615664 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a30ea76-546f-43e7-97e1-b6e8e4453d43 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:17.625883 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:17.770763 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-4a30ea76-546f-43e7-97e1-b6e8e4453d43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4825e649d2d64dc58dd7141bcc168c45', 'request_id': 'req-4a30ea76-546f-43e7-97e1-b6e8e4453d43'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:17.783770 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-4a30ea76-546f-43e7-97e1-b6e8e4453d43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4825e649d2d64dc58dd7141bcc168c45', 'request_id': 'req-4a30ea76-546f-43e7-97e1-b6e8e4453d43'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:17.794021 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-4a30ea76-546f-43e7-97e1-b6e8e4453d43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4825e649d2d64dc58dd7141bcc168c45', 'request_id': 'req-4a30ea76-546f-43e7-97e1-b6e8e4453d43'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:17.835395 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-4a30ea76-546f-43e7-97e1-b6e8e4453d43 admin admin] The token cache is being invalidate because project 4825e649d2d64dc58dd7141bcc168c45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 14:58:17.838429 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-4a30ea76-546f-43e7-97e1-b6e8e4453d43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:17.846161 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-4a30ea76-546f-43e7-97e1-b6e8e4453d43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:17.848549 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1090/2193] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Sep 19 14:58:17 2022] DELETE /identity/v3/projects/4825e649d2d64dc58dd7141bcc168c45 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:58:17.876253 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cab6870-d013-4da2-ab0b-1500fe3c70cc admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:17.882220 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-1cab6870-d013-4da2-ab0b-1500fe3c70cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:17.932045 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cab6870-d013-4da2-ab0b-1500fe3c70cc admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:17.966371 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a30ea76-546f-43e7-97e1-b6e8e4453d43 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:17.970500 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-4a30ea76-546f-43e7-97e1-b6e8e4453d43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:18.145707 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9cfe23-a437-4936-a95d-e651f151d497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:18.146083 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9cfe23-a437-4936-a95d-e651f151d497 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:18.149636 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9cfe23-a437-4936-a95d-e651f151d497 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:18.149923 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9cfe23-a437-4936-a95d-e651f151d497 admin admin] PATH_INFO: `/v3/users/44d3719a40e84dd891e1804b5e49bd36` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:18.151687 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9cfe23-a437-4936-a95d-e651f151d497 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44d3719a40e84dd891e1804b5e49bd36)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:18.154694 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9cfe23-a437-4936-a95d-e651f151d497 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:18.179178 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a30ea76-546f-43e7-97e1-b6e8e4453d43 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:18.185615 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72314162-49ff-4e06-a8dd-ded731f19fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:18.187041 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72314162-49ff-4e06-a8dd-ded731f19fd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:18.187387 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72314162-49ff-4e06-a8dd-ded731f19fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:18.187722 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72314162-49ff-4e06-a8dd-ded731f19fd6 admin admin] PATH_INFO: `/v3/projects/81150adc5cf844aea9849d70078df603` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:18.189192 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72314162-49ff-4e06-a8dd-ded731f19fd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81150adc5cf844aea9849d70078df603)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:18.191918 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72314162-49ff-4e06-a8dd-ded731f19fd6 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:18.237400 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-9c9cfe23-a437-4936-a95d-e651f151d497 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44d3719a40e84dd891e1804b5e49bd36'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:18.260174 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-9c9cfe23-a437-4936-a95d-e651f151d497 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44d3719a40e84dd891e1804b5e49bd36'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:18.269259 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-72314162-49ff-4e06-a8dd-ded731f19fd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81150adc5cf844aea9849d70078df603', 'request_id': 'req-72314162-49ff-4e06-a8dd-ded731f19fd6'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:18.278750 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-9c9cfe23-a437-4936-a95d-e651f151d497 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44d3719a40e84dd891e1804b5e49bd36'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:18.290661 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-72314162-49ff-4e06-a8dd-ded731f19fd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81150adc5cf844aea9849d70078df603', 'request_id': 'req-72314162-49ff-4e06-a8dd-ded731f19fd6'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:18.295422 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-9c9cfe23-a437-4936-a95d-e651f151d497 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44d3719a40e84dd891e1804b5e49bd36'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:18.296821 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-9c9cfe23-a437-4936-a95d-e651f151d497 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44d3719a40e84dd891e1804b5e49bd36'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:18.300677 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-72314162-49ff-4e06-a8dd-ded731f19fd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81150adc5cf844aea9849d70078df603', 'request_id': 'req-72314162-49ff-4e06-a8dd-ded731f19fd6'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:18.303904 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1104/2194] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Sep 19 14:58:17 2022] DELETE /identity/v3/users/44d3719a40e84dd891e1804b5e49bd36 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:58:18.304633 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9cfe23-a437-4936-a95d-e651f151d497 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:18.306018 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-9c9cfe23-a437-4936-a95d-e651f151d497 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:18.324855 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-72314162-49ff-4e06-a8dd-ded731f19fd6 admin admin] The token cache is being invalidate because project 81150adc5cf844aea9849d70078df603 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 14:58:18.325148 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-72314162-49ff-4e06-a8dd-ded731f19fd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:18.325821 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-72314162-49ff-4e06-a8dd-ded731f19fd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:18.327384 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1091/2195] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Sep 19 14:58:17 2022] DELETE /identity/v3/projects/81150adc5cf844aea9849d70078df603 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:58:18.333261 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4e5b51-63f7-43ae-be39-674fcfd1200e None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:18.333983 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4e5b51-63f7-43ae-be39-674fcfd1200e None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:18.334469 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4e5b51-63f7-43ae-be39-674fcfd1200e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:18.378468 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-bb4e5b51-63f7-43ae-be39-674fcfd1200e None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:58:18.384587 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-bb4e5b51-63f7-43ae-be39-674fcfd1200e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:18.421544 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9cfe23-a437-4936-a95d-e651f151d497 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:18.427911 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea72d255-385d-4a79-84c9-a672abafc02e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:18.428676 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea72d255-385d-4a79-84c9-a672abafc02e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:18.429230 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea72d255-385d-4a79-84c9-a672abafc02e admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:18.429626 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea72d255-385d-4a79-84c9-a672abafc02e admin admin] PATH_INFO: `/v3/projects/6cd9350b6c65485b9f43092c23f14456` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:18.430712 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea72d255-385d-4a79-84c9-a672abafc02e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cd9350b6c65485b9f43092c23f14456)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:18.432771 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea72d255-385d-4a79-84c9-a672abafc02e admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:18.443344 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:18.447510 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:18.531635 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1092/2196] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:58:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 14:58:18.535893 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4e5b51-63f7-43ae-be39-674fcfd1200e None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:18.537428 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-bb4e5b51-63f7-43ae-be39-674fcfd1200e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:18.547060 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-ea72d255-385d-4a79-84c9-a672abafc02e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cd9350b6c65485b9f43092c23f14456', 'request_id': 'req-ea72d255-385d-4a79-84c9-a672abafc02e'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:18.553435 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4e5b51-63f7-43ae-be39-674fcfd1200e None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:18.562214 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-ea72d255-385d-4a79-84c9-a672abafc02e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cd9350b6c65485b9f43092c23f14456', 'request_id': 'req-ea72d255-385d-4a79-84c9-a672abafc02e'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:18.576382 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-ea72d255-385d-4a79-84c9-a672abafc02e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cd9350b6c65485b9f43092c23f14456', 'request_id': 'req-ea72d255-385d-4a79-84c9-a672abafc02e'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:18.606646 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-ea72d255-385d-4a79-84c9-a672abafc02e admin admin] The token cache is being invalidate because project 6cd9350b6c65485b9f43092c23f14456 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 14:58:18.607441 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-ea72d255-385d-4a79-84c9-a672abafc02e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:18.609122 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-ea72d255-385d-4a79-84c9-a672abafc02e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:18.612066 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1105/2197] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Sep 19 14:58:18 2022] DELETE /identity/v3/projects/6cd9350b6c65485b9f43092c23f14456 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:58:18.613715 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7a139a-ed5a-44b5-87dd-ab4cbaaf88e4 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:18.614336 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7a139a-ed5a-44b5-87dd-ab4cbaaf88e4 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:18.615036 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7a139a-ed5a-44b5-87dd-ab4cbaaf88e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:18.649963 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-0e7a139a-ed5a-44b5-87dd-ab4cbaaf88e4 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:58:18.652050 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-0e7a139a-ed5a-44b5-87dd-ab4cbaaf88e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:18.652537 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af273ba-f61d-48b4-ac92-afd0b55b255a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:18.653182 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af273ba-f61d-48b4-ac92-afd0b55b255a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:18.653459 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af273ba-f61d-48b4-ac92-afd0b55b255a admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:18.653733 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af273ba-f61d-48b4-ac92-afd0b55b255a admin admin] PATH_INFO: `/v3/users/57fbe36bca234ea485749b218935cf0f` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:18.655506 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af273ba-f61d-48b4-ac92-afd0b55b255a admin admin] RBAC: Authorizing `identity:delete_user(user_id=57fbe36bca234ea485749b218935cf0f)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:18.657537 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af273ba-f61d-48b4-ac92-afd0b55b255a admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:18.678384 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1106/2198] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:58:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:58:18.679638 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7a139a-ed5a-44b5-87dd-ab4cbaaf88e4 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:18.681308 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-0e7a139a-ed5a-44b5-87dd-ab4cbaaf88e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:18.721760 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7a139a-ed5a-44b5-87dd-ab4cbaaf88e4 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:18.727691 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c69709-00ba-4ed0-86d9-a7b6a4dc6ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:18.729465 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c69709-00ba-4ed0-86d9-a7b6a4dc6ac4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:18.729970 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c69709-00ba-4ed0-86d9-a7b6a4dc6ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:18.730414 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c69709-00ba-4ed0-86d9-a7b6a4dc6ac4 admin admin] PATH_INFO: `/v3/users/f5e3fd54f1fb4e9081da60b729b8eae0` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:18.732233 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c69709-00ba-4ed0-86d9-a7b6a4dc6ac4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5e3fd54f1fb4e9081da60b729b8eae0)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:18.736242 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c69709-00ba-4ed0-86d9-a7b6a4dc6ac4 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:18.767157 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-1af273ba-f61d-48b4-ac92-afd0b55b255a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57fbe36bca234ea485749b218935cf0f'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:18.787052 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-1af273ba-f61d-48b4-ac92-afd0b55b255a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57fbe36bca234ea485749b218935cf0f'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:18.801066 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-1af273ba-f61d-48b4-ac92-afd0b55b255a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57fbe36bca234ea485749b218935cf0f'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:18.801874 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-1af273ba-f61d-48b4-ac92-afd0b55b255a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57fbe36bca234ea485749b218935cf0f'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:18.822934 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-1af273ba-f61d-48b4-ac92-afd0b55b255a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57fbe36bca234ea485749b218935cf0f'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:18.840218 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1093/2199] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Sep 19 14:58:18 2022] DELETE /identity/v3/users/57fbe36bca234ea485749b218935cf0f => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 14:58:18.841458 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-34c69709-00ba-4ed0-86d9-a7b6a4dc6ac4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5e3fd54f1fb4e9081da60b729b8eae0'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:18.841705 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af273ba-f61d-48b4-ac92-afd0b55b255a admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:18.843492 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-1af273ba-f61d-48b4-ac92-afd0b55b255a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:18.857119 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-34c69709-00ba-4ed0-86d9-a7b6a4dc6ac4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5e3fd54f1fb4e9081da60b729b8eae0'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:18.874702 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-34c69709-00ba-4ed0-86d9-a7b6a4dc6ac4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5e3fd54f1fb4e9081da60b729b8eae0'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:18.903741 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-34c69709-00ba-4ed0-86d9-a7b6a4dc6ac4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5e3fd54f1fb4e9081da60b729b8eae0'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:18.907040 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-34c69709-00ba-4ed0-86d9-a7b6a4dc6ac4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5e3fd54f1fb4e9081da60b729b8eae0'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:18.925105 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1107/2200] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Sep 19 14:58:18 2022] DELETE /identity/v3/users/f5e3fd54f1fb4e9081da60b729b8eae0 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:58:18.929858 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b46d7c4-44d6-44fa-a3be-1273f5e16d83 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:18.930190 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b46d7c4-44d6-44fa-a3be-1273f5e16d83 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:18.930479 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b46d7c4-44d6-44fa-a3be-1273f5e16d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:18.984095 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-4b46d7c4-44d6-44fa-a3be-1273f5e16d83 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:58:18.986009 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-4b46d7c4-44d6-44fa-a3be-1273f5e16d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:19.004778 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:19.058713 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af273ba-f61d-48b4-ac92-afd0b55b255a admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:19.065663 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:19.083845 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1108/2201] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:58:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:58:19.085011 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b46d7c4-44d6-44fa-a3be-1273f5e16d83 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:19.090708 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-4b46d7c4-44d6-44fa-a3be-1273f5e16d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:19.131731 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b46d7c4-44d6-44fa-a3be-1273f5e16d83 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:19.146543 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443a4cdd-8d10-4fad-818c-1beebcb8a16e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:19.147320 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443a4cdd-8d10-4fad-818c-1beebcb8a16e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:19.148440 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443a4cdd-8d10-4fad-818c-1beebcb8a16e admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:19.150194 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443a4cdd-8d10-4fad-818c-1beebcb8a16e admin admin] PATH_INFO: `/v3/projects/2812bb9a5a444f629dcd793d73ea0527` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:19.153640 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443a4cdd-8d10-4fad-818c-1beebcb8a16e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2812bb9a5a444f629dcd793d73ea0527)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:19.155702 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443a4cdd-8d10-4fad-818c-1beebcb8a16e admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:19.212898 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a382e49-ff4b-4330-b02f-236196b508e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:19.214399 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a382e49-ff4b-4330-b02f-236196b508e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:19.214674 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a382e49-ff4b-4330-b02f-236196b508e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:19.215047 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a382e49-ff4b-4330-b02f-236196b508e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:19.216344 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a382e49-ff4b-4330-b02f-236196b508e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:58:19.216747 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a382e49-ff4b-4330-b02f-236196b508e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:19.220696 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a382e49-ff4b-4330-b02f-236196b508e0 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:19.246212 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1094/2202] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Sep 19 14:58:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 405 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:58:19.247105 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a382e49-ff4b-4330-b02f-236196b508e0 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:19.248956 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-2a382e49-ff4b-4330-b02f-236196b508e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:19.266851 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-443a4cdd-8d10-4fad-818c-1beebcb8a16e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2812bb9a5a444f629dcd793d73ea0527', 'request_id': 'req-443a4cdd-8d10-4fad-818c-1beebcb8a16e'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:19.276426 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-443a4cdd-8d10-4fad-818c-1beebcb8a16e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2812bb9a5a444f629dcd793d73ea0527', 'request_id': 'req-443a4cdd-8d10-4fad-818c-1beebcb8a16e'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:19.286300 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-443a4cdd-8d10-4fad-818c-1beebcb8a16e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2812bb9a5a444f629dcd793d73ea0527', 'request_id': 'req-443a4cdd-8d10-4fad-818c-1beebcb8a16e'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:19.302199 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-443a4cdd-8d10-4fad-818c-1beebcb8a16e admin admin] The token cache is being invalidate because project 2812bb9a5a444f629dcd793d73ea0527 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 14:58:19.302816 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-443a4cdd-8d10-4fad-818c-1beebcb8a16e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:19.303599 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-443a4cdd-8d10-4fad-818c-1beebcb8a16e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:19.305617 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1109/2203] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Sep 19 14:58:19 2022] DELETE /identity/v3/projects/2812bb9a5a444f629dcd793d73ea0527 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:58:19.310746 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443a4cdd-8d10-4fad-818c-1beebcb8a16e admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:19.314038 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-443a4cdd-8d10-4fad-818c-1beebcb8a16e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:19.328199 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a382e49-ff4b-4330-b02f-236196b508e0 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:19.401531 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67376e73-67c4-49eb-9020-3bb13a842557 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c2b78646374cb79ded4b7b59ba49c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:19.402593 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67376e73-67c4-49eb-9020-3bb13a842557 service neutron] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:19.403077 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67376e73-67c4-49eb-9020-3bb13a842557 service neutron] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:19.403549 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67376e73-67c4-49eb-9020-3bb13a842557 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:19.406722 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-67376e73-67c4-49eb-9020-3bb13a842557 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:19.421311 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443a4cdd-8d10-4fad-818c-1beebcb8a16e admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:19.421517 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67376e73-67c4-49eb-9020-3bb13a842557 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:19.426183 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67376e73-67c4-49eb-9020-3bb13a842557 service neutron] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:19.430068 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7ffb0a-7993-4119-8ecc-385aa6db0225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:19.433278 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7ffb0a-7993-4119-8ecc-385aa6db0225 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:19.433694 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7ffb0a-7993-4119-8ecc-385aa6db0225 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:19.434093 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7ffb0a-7993-4119-8ecc-385aa6db0225 admin admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:19.435071 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7ffb0a-7993-4119-8ecc-385aa6db0225 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:19.438075 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7ffb0a-7993-4119-8ecc-385aa6db0225 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:19.457346 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1095/2204] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:58:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:58:19.462730 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb17701-d75d-48a6-976b-a41ffcfdbeac None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:19.463108 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb17701-d75d-48a6-976b-a41ffcfdbeac None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:19.463301 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb17701-d75d-48a6-976b-a41ffcfdbeac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:19.481672 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1110/2205] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Sep 19 14:58:19 2022] POST /identity/v3/projects => generated 379 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:58:19.482627 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7ffb0a-7993-4119-8ecc-385aa6db0225 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:19.502010 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-8d7ffb0a-7993-4119-8ecc-385aa6db0225 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:19.512084 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-deb17701-d75d-48a6-976b-a41ffcfdbeac None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:58:19.514287 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-deb17701-d75d-48a6-976b-a41ffcfdbeac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:19.574661 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:19.604746 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1096/2206] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:58:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:58:19.612687 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb17701-d75d-48a6-976b-a41ffcfdbeac None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:19.623126 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7ffb0a-7993-4119-8ecc-385aa6db0225 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:19.629186 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb17701-d75d-48a6-976b-a41ffcfdbeac None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:19.632587 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e73d71-3f6c-4e14-b3a3-cd67377fe285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:19.633405 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e73d71-3f6c-4e14-b3a3-cd67377fe285 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:19.633787 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e73d71-3f6c-4e14-b3a3-cd67377fe285 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:19.634238 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e73d71-3f6c-4e14-b3a3-cd67377fe285 admin admin] PATH_INFO: `/v3/projects/0997ee8a702e44f7b4a35c297b2e4ddf` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:19.635044 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ff7bf6-d4da-4721-bda5-d3128a06925b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:19.635726 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ff7bf6-d4da-4721-bda5-d3128a06925b admin admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:19.636081 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ff7bf6-d4da-4721-bda5-d3128a06925b admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:19.636462 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ff7bf6-d4da-4721-bda5-d3128a06925b admin admin] PATH_INFO: `/v3/users` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:19.636571 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e73d71-3f6c-4e14-b3a3-cd67377fe285 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0997ee8a702e44f7b4a35c297b2e4ddf)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:19.637181 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ff7bf6-d4da-4721-bda5-d3128a06925b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:19.638458 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e73d71-3f6c-4e14-b3a3-cd67377fe285 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:19.639769 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ff7bf6-d4da-4721-bda5-d3128a06925b admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:19.654344 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:19.685556 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1097/2207] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Sep 19 14:58:19 2022] POST /identity/v3/users => generated 290 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:58:19.689801 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842cf7bb-c513-4fca-993e-6304886d05ca None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:19.690082 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842cf7bb-c513-4fca-993e-6304886d05ca None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:19.690353 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842cf7bb-c513-4fca-993e-6304886d05ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:19.714489 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-842cf7bb-c513-4fca-993e-6304886d05ca None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:58:19.715903 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-842cf7bb-c513-4fca-993e-6304886d05ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:19.726663 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-09e73d71-3f6c-4e14-b3a3-cd67377fe285 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0997ee8a702e44f7b4a35c297b2e4ddf', 'request_id': 'req-09e73d71-3f6c-4e14-b3a3-cd67377fe285'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:19.737313 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-09e73d71-3f6c-4e14-b3a3-cd67377fe285 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0997ee8a702e44f7b4a35c297b2e4ddf', 'request_id': 'req-09e73d71-3f6c-4e14-b3a3-cd67377fe285'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:19.745391 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-09e73d71-3f6c-4e14-b3a3-cd67377fe285 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0997ee8a702e44f7b4a35c297b2e4ddf', 'request_id': 'req-09e73d71-3f6c-4e14-b3a3-cd67377fe285'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:19.759306 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-09e73d71-3f6c-4e14-b3a3-cd67377fe285 admin admin] The token cache is being invalidate because project 0997ee8a702e44f7b4a35c297b2e4ddf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 14:58:19.759615 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-09e73d71-3f6c-4e14-b3a3-cd67377fe285 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:19.760298 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-09e73d71-3f6c-4e14-b3a3-cd67377fe285 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:19.765744 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1111/2208] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Sep 19 14:58:19 2022] DELETE /identity/v3/projects/0997ee8a702e44f7b4a35c297b2e4ddf => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:58:19.765744 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e73d71-3f6c-4e14-b3a3-cd67377fe285 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:19.767356 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-09e73d71-3f6c-4e14-b3a3-cd67377fe285 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:19.792389 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1098/2209] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:58:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:58:19.792389 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cd3bce-9a41-4a39-868c-48b0822c8c51 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:19.792389 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cd3bce-9a41-4a39-868c-48b0822c8c51 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:19.792760 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cd3bce-9a41-4a39-868c-48b0822c8c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:19.821761 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-c8cd3bce-9a41-4a39-868c-48b0822c8c51 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:58:19.823456 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-c8cd3bce-9a41-4a39-868c-48b0822c8c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:19.840475 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1099/2210] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:58:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:58:19.840475 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cd3bce-9a41-4a39-868c-48b0822c8c51 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:19.846779 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e73d71-3f6c-4e14-b3a3-cd67377fe285 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:19.851830 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb1c601-91d2-411c-b9a2-06fb9b562a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:19.852582 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb1c601-91d2-411c-b9a2-06fb9b562a1f admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:19.852934 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb1c601-91d2-411c-b9a2-06fb9b562a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:19.853293 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb1c601-91d2-411c-b9a2-06fb9b562a1f admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:19.854006 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cd3bce-9a41-4a39-868c-48b0822c8c51 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:19.854119 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb1c601-91d2-411c-b9a2-06fb9b562a1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:19.855746 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb1c601-91d2-411c-b9a2-06fb9b562a1f admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:19.860517 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7999ad18-d853-4241-8bf9-0fa8606b8576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:19.861230 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7999ad18-d853-4241-8bf9-0fa8606b8576 admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:19.861588 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7999ad18-d853-4241-8bf9-0fa8606b8576 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:19.862543 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7999ad18-d853-4241-8bf9-0fa8606b8576 admin admin] PATH_INFO: `/v3/domains` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:19.863272 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7999ad18-d853-4241-8bf9-0fa8606b8576 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:58:19.863657 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7999ad18-d853-4241-8bf9-0fa8606b8576 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:19.865848 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7999ad18-d853-4241-8bf9-0fa8606b8576 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:19.870977 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1112/2211] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:58:19 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:58:19.872291 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f130133-addb-49c7-b524-4a8bf49e24e8 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:19.872643 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f130133-addb-49c7-b524-4a8bf49e24e8 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:19.873414 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f130133-addb-49c7-b524-4a8bf49e24e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:19.886665 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1100/2212] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Sep 19 14:58:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:58:19.886665 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7999ad18-d853-4241-8bf9-0fa8606b8576 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:19.895982 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-3f130133-addb-49c7-b524-4a8bf49e24e8 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:58:19.897275 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-3f130133-addb-49c7-b524-4a8bf49e24e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:19.901448 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7999ad18-d853-4241-8bf9-0fa8606b8576 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:19.911389 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53d3d31-fe5e-4e4a-a1d0-9ff6ec6ab65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:19.912012 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d3d31-fe5e-4e4a-a1d0-9ff6ec6ab65f admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:19.912374 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d3d31-fe5e-4e4a-a1d0-9ff6ec6ab65f admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:19.912650 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d3d31-fe5e-4e4a-a1d0-9ff6ec6ab65f admin admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:19.913296 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53d3d31-fe5e-4e4a-a1d0-9ff6ec6ab65f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:19.914177 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1113/2213] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:58:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:58:19.917233 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f130133-addb-49c7-b524-4a8bf49e24e8 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:19.917381 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53d3d31-fe5e-4e4a-a1d0-9ff6ec6ab65f admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:19.929451 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f130133-addb-49c7-b524-4a8bf49e24e8 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:19.932197 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1101/2214] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:58:19 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:58:19.933107 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53d3d31-fe5e-4e4a-a1d0-9ff6ec6ab65f admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:19.947444 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53d3d31-fe5e-4e4a-a1d0-9ff6ec6ab65f admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:19.947704 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51ec7ce-f17b-4081-9c3f-843ec2d8d067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:19.948369 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51ec7ce-f17b-4081-9c3f-843ec2d8d067 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:19.948597 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51ec7ce-f17b-4081-9c3f-843ec2d8d067 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:19.948875 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51ec7ce-f17b-4081-9c3f-843ec2d8d067 admin admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:19.949525 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51ec7ce-f17b-4081-9c3f-843ec2d8d067 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:19.952797 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51ec7ce-f17b-4081-9c3f-843ec2d8d067 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:19.954360 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c50dae-59e1-4d56-a30f-c82bf0b99668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:19.954941 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c50dae-59e1-4d56-a30f-c82bf0b99668 admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:19.955222 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c50dae-59e1-4d56-a30f-c82bf0b99668 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:19.955544 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c50dae-59e1-4d56-a30f-c82bf0b99668 admin admin] PATH_INFO: `/v3/domains` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:19.957357 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c50dae-59e1-4d56-a30f-c82bf0b99668 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:58:19.957357 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c50dae-59e1-4d56-a30f-c82bf0b99668 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:19.958277 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c50dae-59e1-4d56-a30f-c82bf0b99668 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:19.983347 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1102/2215] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Sep 19 14:58:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:58:19.988165 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c50dae-59e1-4d56-a30f-c82bf0b99668 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:19.998069 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1114/2216] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Sep 19 14:58:19 2022] POST /identity/v3/projects => generated 385 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:58:19.999730 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51ec7ce-f17b-4081-9c3f-843ec2d8d067 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:20.000424 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c50dae-59e1-4d56-a30f-c82bf0b99668 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:20.001844 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-b51ec7ce-f17b-4081-9c3f-843ec2d8d067 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:20.073289 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46160f8-bf92-4f6a-aecf-742ab842017a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:20.074219 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46160f8-bf92-4f6a-aecf-742ab842017a admin admin] REQUEST_METHOD: `PUT` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:20.074509 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46160f8-bf92-4f6a-aecf-742ab842017a admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:20.074790 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46160f8-bf92-4f6a-aecf-742ab842017a admin admin] PATH_INFO: `/v3/projects/c2819168434f435b907ecd7cd318e831/users/b508e3485fea480aadfa480b487e7288/roles/efa0e5b3413748dc828a89b12d67df79` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:20.099695 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46160f8-bf92-4f6a-aecf-742ab842017a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2819168434f435b907ecd7cd318e831, user_id=b508e3485fea480aadfa480b487e7288, role_id=efa0e5b3413748dc828a89b12d67df79)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:20.100590 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51ec7ce-f17b-4081-9c3f-843ec2d8d067 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:20.102641 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46160f8-bf92-4f6a-aecf-742ab842017a admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:20.109909 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2556a2-5159-4c9c-93fa-a5fe8a4d224f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:20.110862 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2556a2-5159-4c9c-93fa-a5fe8a4d224f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:20.111263 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2556a2-5159-4c9c-93fa-a5fe8a4d224f admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:20.111521 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2556a2-5159-4c9c-93fa-a5fe8a4d224f admin admin] PATH_INFO: `/v3/projects/61ccb9e83fc24e25981eef71f5991db3` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:20.112959 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2556a2-5159-4c9c-93fa-a5fe8a4d224f admin admin] RBAC: Authorizing `identity:delete_project(project_id=61ccb9e83fc24e25981eef71f5991db3)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:20.116161 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2556a2-5159-4c9c-93fa-a5fe8a4d224f admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:20.122479 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1103/2217] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 14:58:19 2022] PUT /identity/v3/projects/c2819168434f435b907ecd7cd318e831/users/b508e3485fea480aadfa480b487e7288/roles/efa0e5b3413748dc828a89b12d67df79 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:58:20.123483 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46160f8-bf92-4f6a-aecf-742ab842017a admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:20.130130 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:20.144710 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:20.227196 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-3f2556a2-5159-4c9c-93fa-a5fe8a4d224f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61ccb9e83fc24e25981eef71f5991db3', 'request_id': 'req-3f2556a2-5159-4c9c-93fa-a5fe8a4d224f'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:20.248440 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-3f2556a2-5159-4c9c-93fa-a5fe8a4d224f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61ccb9e83fc24e25981eef71f5991db3', 'request_id': 'req-3f2556a2-5159-4c9c-93fa-a5fe8a4d224f'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:20.263771 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46160f8-bf92-4f6a-aecf-742ab842017a admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:20.265296 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-3f2556a2-5159-4c9c-93fa-a5fe8a4d224f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61ccb9e83fc24e25981eef71f5991db3', 'request_id': 'req-3f2556a2-5159-4c9c-93fa-a5fe8a4d224f'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:20.297985 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-3f2556a2-5159-4c9c-93fa-a5fe8a4d224f admin admin] The token cache is being invalidate because project 61ccb9e83fc24e25981eef71f5991db3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 14:58:20.303220 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-3f2556a2-5159-4c9c-93fa-a5fe8a4d224f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:20.304380 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-3f2556a2-5159-4c9c-93fa-a5fe8a4d224f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:20.307875 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1115/2218] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Sep 19 14:58:19 2022] DELETE /identity/v3/projects/61ccb9e83fc24e25981eef71f5991db3 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:58:20.313270 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2556a2-5159-4c9c-93fa-a5fe8a4d224f admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:20.315073 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-3f2556a2-5159-4c9c-93fa-a5fe8a4d224f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:20.345601 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d333a4d-5dc4-4e80-85a6-2c4c4a7ff1f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:20.346224 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d333a4d-5dc4-4e80-85a6-2c4c4a7ff1f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:20.346508 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d333a4d-5dc4-4e80-85a6-2c4c4a7ff1f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:20.346778 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d333a4d-5dc4-4e80-85a6-2c4c4a7ff1f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:20.347410 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d333a4d-5dc4-4e80-85a6-2c4c4a7ff1f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:20.349384 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d333a4d-5dc4-4e80-85a6-2c4c4a7ff1f4 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:20.389889 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1104/2219] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Sep 19 14:58:20 2022] POST /identity/v3/projects => generated 369 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:58:20.391807 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e517a9b-3189-4693-b2e0-ffe68572ea59 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:20.392400 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e517a9b-3189-4693-b2e0-ffe68572ea59 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:20.392890 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e517a9b-3189-4693-b2e0-ffe68572ea59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:20.420695 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2556a2-5159-4c9c-93fa-a5fe8a4d224f admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:20.432625 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-5e517a9b-3189-4693-b2e0-ffe68572ea59 None None] MFA Rules not processed for user `b508e3485fea480aadfa480b487e7288`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:58:20.433859 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-5e517a9b-3189-4693-b2e0-ffe68572ea59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:20.488244 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81540057-ae4a-4205-9759-32a04d5b4cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:20.488818 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81540057-ae4a-4205-9759-32a04d5b4cdb admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:20.489103 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81540057-ae4a-4205-9759-32a04d5b4cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:20.489380 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81540057-ae4a-4205-9759-32a04d5b4cdb admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:20.490018 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81540057-ae4a-4205-9759-32a04d5b4cdb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:20.491975 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81540057-ae4a-4205-9759-32a04d5b4cdb admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:20.516601 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1116/2220] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Sep 19 14:58:20 2022] POST /identity/v3/users => generated 293 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:58:20.518549 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f213503-62db-4096-aaf3-f87be3daa47a None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:20.519068 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f213503-62db-4096-aaf3-f87be3daa47a None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:20.519457 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f213503-62db-4096-aaf3-f87be3daa47a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:20.526321 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1105/2221] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:58:20 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:58:20.527248 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e517a9b-3189-4693-b2e0-ffe68572ea59 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:20.528635 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-5e517a9b-3189-4693-b2e0-ffe68572ea59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:20.550930 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e517a9b-3189-4693-b2e0-ffe68572ea59 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:20.552907 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-1f213503-62db-4096-aaf3-f87be3daa47a None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:58:20.554124 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-1f213503-62db-4096-aaf3-f87be3daa47a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:20.557328 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9912c824-a4c6-4039-9c32-ef4d83e9c62b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:20.558291 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9912c824-a4c6-4039-9c32-ef4d83e9c62b admin admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:20.558738 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9912c824-a4c6-4039-9c32-ef4d83e9c62b admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:20.559022 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9912c824-a4c6-4039-9c32-ef4d83e9c62b admin admin] PATH_INFO: `/v3/users` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:20.560191 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9912c824-a4c6-4039-9c32-ef4d83e9c62b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:20.562813 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9912c824-a4c6-4039-9c32-ef4d83e9c62b admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:20.562945 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1117/2222] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:58:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:58:20.563944 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f213503-62db-4096-aaf3-f87be3daa47a None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:20.582330 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f213503-62db-4096-aaf3-f87be3daa47a None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:20.587820 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050cd9ef-7f98-47c3-845f-95c9b6802850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:20.588457 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050cd9ef-7f98-47c3-845f-95c9b6802850 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:20.589824 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050cd9ef-7f98-47c3-845f-95c9b6802850 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:20.589824 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050cd9ef-7f98-47c3-845f-95c9b6802850 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:20.590155 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1106/2223] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Sep 19 14:58:20 2022] POST /identity/v3/users => generated 285 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:58:20.590271 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050cd9ef-7f98-47c3-845f-95c9b6802850 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:20.591051 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9912c824-a4c6-4039-9c32-ef4d83e9c62b admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:20.592634 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050cd9ef-7f98-47c3-845f-95c9b6802850 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:20.594877 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-9912c824-a4c6-4039-9c32-ef4d83e9c62b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:20.607676 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1118/2224] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:58:20 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:58:20.607676 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940ef636-456d-4df3-8a71-9c291c12bb2a None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:20.607676 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940ef636-456d-4df3-8a71-9c291c12bb2a None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:20.607676 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940ef636-456d-4df3-8a71-9c291c12bb2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:20.608858 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9912c824-a4c6-4039-9c32-ef4d83e9c62b admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:20.614782 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d07fa7a-1f1f-43c0-855d-88024027e38e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:20.615650 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d07fa7a-1f1f-43c0-855d-88024027e38e admin admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:20.616024 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d07fa7a-1f1f-43c0-855d-88024027e38e admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:20.616670 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d07fa7a-1f1f-43c0-855d-88024027e38e admin admin] PATH_INFO: `/v3/projects` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:20.618543 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d07fa7a-1f1f-43c0-855d-88024027e38e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:20.620708 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d07fa7a-1f1f-43c0-855d-88024027e38e admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:20.630925 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-940ef636-456d-4df3-8a71-9c291c12bb2a None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:58:20.632266 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-940ef636-456d-4df3-8a71-9c291c12bb2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:20.633486 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:20.645473 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1119/2225] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:58:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:58:20.646922 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940ef636-456d-4df3-8a71-9c291c12bb2a None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:20.657817 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940ef636-456d-4df3-8a71-9c291c12bb2a None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:20.665661 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1107/2226] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Sep 19 14:58:20 2022] POST /identity/v3/projects => generated 377 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:58:20.665661 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d07fa7a-1f1f-43c0-855d-88024027e38e admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:20.666787 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f48b44-fe1e-4c31-a0d3-422edb32caed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:20.667358 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f48b44-fe1e-4c31-a0d3-422edb32caed admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:20.667642 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f48b44-fe1e-4c31-a0d3-422edb32caed admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:20.667915 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f48b44-fe1e-4c31-a0d3-422edb32caed admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:20.668588 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f48b44-fe1e-4c31-a0d3-422edb32caed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:20.670319 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f48b44-fe1e-4c31-a0d3-422edb32caed admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:20.672758 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:20.689351 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1120/2227] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:58:20 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:58:20.690247 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f48b44-fe1e-4c31-a0d3-422edb32caed admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:20.705258 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f48b44-fe1e-4c31-a0d3-422edb32caed admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:20.777879 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d07fa7a-1f1f-43c0-855d-88024027e38e admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:20.785408 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29670cb3-9c2d-4b3a-84b9-147c7e8c6f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:20.787389 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29670cb3-9c2d-4b3a-84b9-147c7e8c6f58 admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:20.787693 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29670cb3-9c2d-4b3a-84b9-147c7e8c6f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:20.787972 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29670cb3-9c2d-4b3a-84b9-147c7e8c6f58 admin admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:20.789520 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29670cb3-9c2d-4b3a-84b9-147c7e8c6f58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:20.791341 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29670cb3-9c2d-4b3a-84b9-147c7e8c6f58 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:20.795510 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef347843-f420-442b-8eb3-7ba42875fd25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:20.796721 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef347843-f420-442b-8eb3-7ba42875fd25 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:20.797074 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef347843-f420-442b-8eb3-7ba42875fd25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:20.797425 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef347843-f420-442b-8eb3-7ba42875fd25 admin admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:20.798483 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef347843-f420-442b-8eb3-7ba42875fd25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:58:20.798877 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef347843-f420-442b-8eb3-7ba42875fd25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:20.800661 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef347843-f420-442b-8eb3-7ba42875fd25 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:20.817981 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1108/2228] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:58:20 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:58:20.819798 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29670cb3-9c2d-4b3a-84b9-147c7e8c6f58 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:20.820003 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1121/2229] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Sep 19 14:58:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:58:20.821151 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef347843-f420-442b-8eb3-7ba42875fd25 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:20.834481 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29670cb3-9c2d-4b3a-84b9-147c7e8c6f58 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:20.839741 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70265944-c4a6-41e3-9cca-cb83b95460b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:20.840604 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70265944-c4a6-41e3-9cca-cb83b95460b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:20.841160 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70265944-c4a6-41e3-9cca-cb83b95460b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:20.841160 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70265944-c4a6-41e3-9cca-cb83b95460b5 admin admin] PATH_INFO: `/v3/users` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:20.842877 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70265944-c4a6-41e3-9cca-cb83b95460b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:20.843062 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef347843-f420-442b-8eb3-7ba42875fd25 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:20.844313 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70265944-c4a6-41e3-9cca-cb83b95460b5 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:20.850610 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8046a3-a84c-4043-ac27-7ae492a7e3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:20.851893 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8046a3-a84c-4043-ac27-7ae492a7e3ab admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:20.851893 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8046a3-a84c-4043-ac27-7ae492a7e3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:20.852104 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8046a3-a84c-4043-ac27-7ae492a7e3ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:20.856835 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8046a3-a84c-4043-ac27-7ae492a7e3ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:20.859256 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8046a3-a84c-4043-ac27-7ae492a7e3ab admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:20.872589 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1109/2230] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Sep 19 14:58:20 2022] POST /identity/v3/users => generated 295 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:58:20.873405 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70265944-c4a6-41e3-9cca-cb83b95460b5 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:20.879199 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1122/2231] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:58:20 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:58:20.879199 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8046a3-a84c-4043-ac27-7ae492a7e3ab admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:20.885657 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70265944-c4a6-41e3-9cca-cb83b95460b5 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:20.888853 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8046a3-a84c-4043-ac27-7ae492a7e3ab admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:20.901147 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2c389a-b5ed-499f-99d4-545ecdd6a6a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:20.901395 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517b1da2-2804-401c-ac9e-f5edbae1d76a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:20.901877 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2c389a-b5ed-499f-99d4-545ecdd6a6a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:20.901993 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517b1da2-2804-401c-ac9e-f5edbae1d76a admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:20.902153 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517b1da2-2804-401c-ac9e-f5edbae1d76a admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:20.902263 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2c389a-b5ed-499f-99d4-545ecdd6a6a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:20.902432 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2c389a-b5ed-499f-99d4-545ecdd6a6a5 admin admin] PATH_INFO: `/v3/projects/752147d150bf44d8b3b5254994b86cbb/users/7c0b6b91890c4ecabc1e533e4645fac8/roles/efa0e5b3413748dc828a89b12d67df79` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:20.902628 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517b1da2-2804-401c-ac9e-f5edbae1d76a admin admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:20.904169 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517b1da2-2804-401c-ac9e-f5edbae1d76a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:20.906947 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517b1da2-2804-401c-ac9e-f5edbae1d76a admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:20.931356 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2c389a-b5ed-499f-99d4-545ecdd6a6a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=752147d150bf44d8b3b5254994b86cbb, user_id=7c0b6b91890c4ecabc1e533e4645fac8, role_id=efa0e5b3413748dc828a89b12d67df79)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:20.933749 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2c389a-b5ed-499f-99d4-545ecdd6a6a5 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:20.949368 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1123/2232] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Sep 19 14:58:20 2022] POST /identity/v3/projects => generated 373 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:58:20.950084 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517b1da2-2804-401c-ac9e-f5edbae1d76a admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:20.952088 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1110/2233] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 14:58:20 2022] PUT /identity/v3/projects/752147d150bf44d8b3b5254994b86cbb/users/7c0b6b91890c4ecabc1e533e4645fac8/roles/efa0e5b3413748dc828a89b12d67df79 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:58:20.960372 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2c389a-b5ed-499f-99d4-545ecdd6a6a5 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:21.048274 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517b1da2-2804-401c-ac9e-f5edbae1d76a admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:21.052047 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2c389a-b5ed-499f-99d4-545ecdd6a6a5 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:21.054034 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11694a4d-ce25-42f4-9da9-68e8087b3ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:21.055010 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11694a4d-ce25-42f4-9da9-68e8087b3ac2 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:21.055438 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11694a4d-ce25-42f4-9da9-68e8087b3ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:21.055969 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11694a4d-ce25-42f4-9da9-68e8087b3ac2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:21.056824 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11694a4d-ce25-42f4-9da9-68e8087b3ac2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:21.059102 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645b83b3-0109-47ad-b812-64bfe0c3cfb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:21.060150 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11694a4d-ce25-42f4-9da9-68e8087b3ac2 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:21.060286 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645b83b3-0109-47ad-b812-64bfe0c3cfb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:21.060483 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645b83b3-0109-47ad-b812-64bfe0c3cfb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:21.061513 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645b83b3-0109-47ad-b812-64bfe0c3cfb1 admin admin] PATH_INFO: `/v3/projects/be623ed394164492b7ba4ae1b56d1bcc/users/6db433cb08bb4a40b944eddf1b6defd8/roles/efa0e5b3413748dc828a89b12d67df79` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:21.084114 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1124/2234] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:58:20 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:58:21.085022 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11694a4d-ce25-42f4-9da9-68e8087b3ac2 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:21.088037 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645b83b3-0109-47ad-b812-64bfe0c3cfb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be623ed394164492b7ba4ae1b56d1bcc, user_id=6db433cb08bb4a40b944eddf1b6defd8, role_id=efa0e5b3413748dc828a89b12d67df79)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:21.091616 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645b83b3-0109-47ad-b812-64bfe0c3cfb1 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:21.097014 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11694a4d-ce25-42f4-9da9-68e8087b3ac2 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:21.103668 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d950d5f-bd06-4493-b634-2b3ea693c9b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:21.104415 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d950d5f-bd06-4493-b634-2b3ea693c9b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:21.104786 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d950d5f-bd06-4493-b634-2b3ea693c9b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:21.105149 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d950d5f-bd06-4493-b634-2b3ea693c9b2 admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:21.110787 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d950d5f-bd06-4493-b634-2b3ea693c9b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:21.110787 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d950d5f-bd06-4493-b634-2b3ea693c9b2 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:21.120883 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1111/2235] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 14:58:20 2022] PUT /identity/v3/projects/be623ed394164492b7ba4ae1b56d1bcc/users/6db433cb08bb4a40b944eddf1b6defd8/roles/efa0e5b3413748dc828a89b12d67df79 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:58:21.122472 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42eb0f4-14dc-446a-9a1e-d526513ea71f None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:21.122749 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42eb0f4-14dc-446a-9a1e-d526513ea71f None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:21.123024 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42eb0f4-14dc-446a-9a1e-d526513ea71f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:21.156349 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1125/2236] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Sep 19 14:58:21 2022] POST /identity/v3/users => generated 287 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:58:21.157584 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d950d5f-bd06-4493-b634-2b3ea693c9b2 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:21.162298 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-c42eb0f4-14dc-446a-9a1e-d526513ea71f None None] MFA Rules not processed for user `7c0b6b91890c4ecabc1e533e4645fac8`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:58:21.163548 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-c42eb0f4-14dc-446a-9a1e-d526513ea71f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:21.172466 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d950d5f-bd06-4493-b634-2b3ea693c9b2 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:21.189520 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:21.220370 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:21.259671 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1af4c6-04b7-46cf-9782-fd4e3907001c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:21.260571 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1af4c6-04b7-46cf-9782-fd4e3907001c admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:21.260990 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1af4c6-04b7-46cf-9782-fd4e3907001c admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:21.261343 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1af4c6-04b7-46cf-9782-fd4e3907001c admin admin] PATH_INFO: `/v3/projects/fb5de7e074884e30ad438d79c339a426/users/6eefb6e41e514559a285eb8757e76834/roles/ddb643577b2e4e478100ec370decfaeb` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:21.284924 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1112/2237] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:58:21 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:58:21.286026 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2308a08c-aa64-4711-9816-bcb8969b5a85 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:21.286373 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2308a08c-aa64-4711-9816-bcb8969b5a85 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:21.286708 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2308a08c-aa64-4711-9816-bcb8969b5a85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:21.289371 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1af4c6-04b7-46cf-9782-fd4e3907001c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb5de7e074884e30ad438d79c339a426, user_id=6eefb6e41e514559a285eb8757e76834, role_id=ddb643577b2e4e478100ec370decfaeb)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:21.293135 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1af4c6-04b7-46cf-9782-fd4e3907001c admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:21.324274 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1126/2238] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 14:58:21 2022] PUT /identity/v3/projects/fb5de7e074884e30ad438d79c339a426/users/6eefb6e41e514559a285eb8757e76834/roles/ddb643577b2e4e478100ec370decfaeb => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:58:21.329368 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-2308a08c-aa64-4711-9816-bcb8969b5a85 None None] MFA Rules not processed for user `6db433cb08bb4a40b944eddf1b6defd8`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:58:21.329507 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1af4c6-04b7-46cf-9782-fd4e3907001c admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:21.329608 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-2308a08c-aa64-4711-9816-bcb8969b5a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:21.413719 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1113/2239] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:58:21 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:58:21.414873 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2308a08c-aa64-4711-9816-bcb8969b5a85 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:21.419059 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-2308a08c-aa64-4711-9816-bcb8969b5a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:21.460795 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1af4c6-04b7-46cf-9782-fd4e3907001c admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:21.469240 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4283e3-b250-4faa-9854-dd215db1411b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:21.470437 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4283e3-b250-4faa-9854-dd215db1411b admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:21.470564 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4283e3-b250-4faa-9854-dd215db1411b admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:21.470851 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4283e3-b250-4faa-9854-dd215db1411b admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:21.471582 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4283e3-b250-4faa-9854-dd215db1411b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:21.474192 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4283e3-b250-4faa-9854-dd215db1411b admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:21.489059 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2308a08c-aa64-4711-9816-bcb8969b5a85 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:21.490643 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1127/2240] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:58:21 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:58:21.493609 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4283e3-b250-4faa-9854-dd215db1411b admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:21.493850 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d283ef-bf8a-4bbc-9946-70b36011dfff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139dc7a4f1dc48fe8faea848bd1ac0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:21.494557 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d283ef-bf8a-4bbc-9946-70b36011dfff service cinder] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:21.494956 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d283ef-bf8a-4bbc-9946-70b36011dfff service cinder] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:21.495323 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d283ef-bf8a-4bbc-9946-70b36011dfff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:21.504949 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4283e3-b250-4faa-9854-dd215db1411b admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:21.519349 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f6ff86-f3ff-4261-af96-7f28a1da776e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:21.520102 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f6ff86-f3ff-4261-af96-7f28a1da776e admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:21.520418 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f6ff86-f3ff-4261-af96-7f28a1da776e admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:21.520704 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f6ff86-f3ff-4261-af96-7f28a1da776e admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:21.521505 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f6ff86-f3ff-4261-af96-7f28a1da776e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:21.523690 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f6ff86-f3ff-4261-af96-7f28a1da776e admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:21.539793 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1128/2241] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:58:21 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:58:21.540529 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f6ff86-f3ff-4261-af96-7f28a1da776e admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:21.542306 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-f0f6ff86-f3ff-4261-af96-7f28a1da776e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:21.561829 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d283ef-bf8a-4bbc-9946-70b36011dfff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:21.563365 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d283ef-bf8a-4bbc-9946-70b36011dfff service cinder] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:21.570403 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:21.577677 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1114/2242] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:58:21 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:58:21.578439 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d283ef-bf8a-4bbc-9946-70b36011dfff service cinder] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:21.592874 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d283ef-bf8a-4bbc-9946-70b36011dfff service cinder] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:21.598517 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6870bd74-720b-4574-aab6-17015d9254c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:21.602362 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6870bd74-720b-4574-aab6-17015d9254c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:21.602362 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6870bd74-720b-4574-aab6-17015d9254c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:21.602362 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6870bd74-720b-4574-aab6-17015d9254c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:21.602362 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6870bd74-720b-4574-aab6-17015d9254c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:21.602362 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6870bd74-720b-4574-aab6-17015d9254c5 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:21.614534 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1115/2243] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:58:21 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:58:21.615667 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6870bd74-720b-4574-aab6-17015d9254c5 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:21.627387 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f6ff86-f3ff-4261-af96-7f28a1da776e admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:21.628816 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6870bd74-720b-4574-aab6-17015d9254c5 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:21.633659 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c63ee0d-fa27-4727-9b95-9225f702d538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:21.634484 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c63ee0d-fa27-4727-9b95-9225f702d538 admin admin] REQUEST_METHOD: `PUT` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:21.634794 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c63ee0d-fa27-4727-9b95-9225f702d538 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:21.635063 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c63ee0d-fa27-4727-9b95-9225f702d538 admin admin] PATH_INFO: `/v3/projects/fb5de7e074884e30ad438d79c339a426/users/6eefb6e41e514559a285eb8757e76834/roles/ddb643577b2e4e478100ec370decfaeb` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:21.635761 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0464d4-71dd-4217-901e-2dff0eb75f99 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d6d4ecf8f4849939d6510a6228b29dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:21.636583 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0464d4-71dd-4217-901e-2dff0eb75f99 service glance] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:21.636913 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0464d4-71dd-4217-901e-2dff0eb75f99 service glance] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:21.637171 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0464d4-71dd-4217-901e-2dff0eb75f99 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:21.637368 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c63ee0d-fa27-4727-9b95-9225f702d538 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb5de7e074884e30ad438d79c339a426, user_id=6eefb6e41e514559a285eb8757e76834, role_id=ddb643577b2e4e478100ec370decfaeb)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:21.640087 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c63ee0d-fa27-4727-9b95-9225f702d538 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:21.647480 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0464d4-71dd-4217-901e-2dff0eb75f99 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:21.649058 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0464d4-71dd-4217-901e-2dff0eb75f99 service glance] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:21.658561 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1116/2244] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 14:58:21 2022] PUT /identity/v3/projects/fb5de7e074884e30ad438d79c339a426/users/6eefb6e41e514559a285eb8757e76834/roles/ddb643577b2e4e478100ec370decfaeb => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:58:21.659811 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c63ee0d-fa27-4727-9b95-9225f702d538 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:21.661582 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1129/2245] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:58:21 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:58:21.673559 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4723c4-b94e-45a8-aadb-02012450e38e None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:21.673932 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4723c4-b94e-45a8-aadb-02012450e38e None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:21.674274 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4723c4-b94e-45a8-aadb-02012450e38e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:21.726849 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-ee4723c4-b94e-45a8-aadb-02012450e38e None None] MFA Rules not processed for user `6eefb6e41e514559a285eb8757e76834`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:58:21.728139 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-ee4723c4-b94e-45a8-aadb-02012450e38e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:21.785579 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:21.790691 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c63ee0d-fa27-4727-9b95-9225f702d538 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:21.805649 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502ccab7-af8f-40ad-9a11-bb5ab4c639ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:21.806406 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502ccab7-af8f-40ad-9a11-bb5ab4c639ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:21.806756 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502ccab7-af8f-40ad-9a11-bb5ab4c639ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:21.807106 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502ccab7-af8f-40ad-9a11-bb5ab4c639ff admin admin] PATH_INFO: `/v3/projects/4ca84c3ef8ef423f930b5d09a209da18/users/86726678c6544ed9877d281ad2acf262/roles/efa0e5b3413748dc828a89b12d67df79` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:21.825719 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1130/2246] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:58:21 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 14:58:21.846590 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502ccab7-af8f-40ad-9a11-bb5ab4c639ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ca84c3ef8ef423f930b5d09a209da18, user_id=86726678c6544ed9877d281ad2acf262, role_id=efa0e5b3413748dc828a89b12d67df79)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:21.850788 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502ccab7-af8f-40ad-9a11-bb5ab4c639ff admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:21.900386 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1117/2247] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 14:58:21 2022] PUT /identity/v3/projects/4ca84c3ef8ef423f930b5d09a209da18/users/86726678c6544ed9877d281ad2acf262/roles/efa0e5b3413748dc828a89b12d67df79 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:58:21.913903 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246e90ce-2928-45a7-9e09-092525406c59 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:21.914652 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246e90ce-2928-45a7-9e09-092525406c59 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:21.915241 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246e90ce-2928-45a7-9e09-092525406c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:21.962869 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-246e90ce-2928-45a7-9e09-092525406c59 None None] MFA Rules not processed for user `86726678c6544ed9877d281ad2acf262`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:58:21.964350 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-246e90ce-2928-45a7-9e09-092525406c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:22.096275 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502ccab7-af8f-40ad-9a11-bb5ab4c639ff admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:22.111686 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1131/2248] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:58:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:58:22.208382 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502ccab7-af8f-40ad-9a11-bb5ab4c639ff admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:22.214788 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f033db67-fdd9-4269-849a-8e29f6ece871 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139dc7a4f1dc48fe8faea848bd1ac0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:22.215413 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f033db67-fdd9-4269-849a-8e29f6ece871 service cinder] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:22.215696 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f033db67-fdd9-4269-849a-8e29f6ece871 service cinder] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:22.216154 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f033db67-fdd9-4269-849a-8e29f6ece871 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:22.335436 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f033db67-fdd9-4269-849a-8e29f6ece871 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:22.336950 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f033db67-fdd9-4269-849a-8e29f6ece871 service cinder] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:22.357939 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1118/2249] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:58:22 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 14:58:22.445211 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246e90ce-2928-45a7-9e09-092525406c59 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:22.446810 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-246e90ce-2928-45a7-9e09-092525406c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:22.468072 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246e90ce-2928-45a7-9e09-092525406c59 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:22.472917 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7ebdf8-46ec-422f-b6d3-9c492f550508 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139dc7a4f1dc48fe8faea848bd1ac0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:22.475702 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7ebdf8-46ec-422f-b6d3-9c492f550508 service cinder] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:22.477014 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7ebdf8-46ec-422f-b6d3-9c492f550508 service cinder] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:22.477827 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7ebdf8-46ec-422f-b6d3-9c492f550508 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:22.491516 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7ebdf8-46ec-422f-b6d3-9c492f550508 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:22.493181 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7ebdf8-46ec-422f-b6d3-9c492f550508 service cinder] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:22.517232 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1132/2250] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:58:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:58:22.542012 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f033db67-fdd9-4269-849a-8e29f6ece871 service cinder] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:22.560042 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:22.692824 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f033db67-fdd9-4269-849a-8e29f6ece871 service cinder] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:22.699185 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a77b9e-5869-457b-95c2-2194fb7f5e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:22.699845 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a77b9e-5869-457b-95c2-2194fb7f5e52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:22.700285 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a77b9e-5869-457b-95c2-2194fb7f5e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:22.700805 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a77b9e-5869-457b-95c2-2194fb7f5e52 admin admin] PATH_INFO: `/v3/users/86726678c6544ed9877d281ad2acf262` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:22.702134 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a77b9e-5869-457b-95c2-2194fb7f5e52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86726678c6544ed9877d281ad2acf262)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:22.704540 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a77b9e-5869-457b-95c2-2194fb7f5e52 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:22.779643 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-68a77b9e-5869-457b-95c2-2194fb7f5e52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86726678c6544ed9877d281ad2acf262'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:22.813611 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-68a77b9e-5869-457b-95c2-2194fb7f5e52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86726678c6544ed9877d281ad2acf262'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:22.825188 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-68a77b9e-5869-457b-95c2-2194fb7f5e52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86726678c6544ed9877d281ad2acf262'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:22.826200 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-68a77b9e-5869-457b-95c2-2194fb7f5e52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86726678c6544ed9877d281ad2acf262'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:22.837489 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-68a77b9e-5869-457b-95c2-2194fb7f5e52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86726678c6544ed9877d281ad2acf262'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:22.849775 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1119/2251] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Sep 19 14:58:22 2022] DELETE /identity/v3/users/86726678c6544ed9877d281ad2acf262 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:58:22.852245 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0034b2ce-5a74-41e3-b055-3d42b2d1a9dd None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:22.852614 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0034b2ce-5a74-41e3-b055-3d42b2d1a9dd None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:22.852916 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0034b2ce-5a74-41e3-b055-3d42b2d1a9dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:22.914578 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-0034b2ce-5a74-41e3-b055-3d42b2d1a9dd None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:58:22.916956 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-0034b2ce-5a74-41e3-b055-3d42b2d1a9dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:23.067001 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a77b9e-5869-457b-95c2-2194fb7f5e52 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:23.067279 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1133/2252] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:58:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 14:58:23.067772 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-68a77b9e-5869-457b-95c2-2194fb7f5e52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:23.073916 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0034b2ce-5a74-41e3-b055-3d42b2d1a9dd None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:23.075377 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-0034b2ce-5a74-41e3-b055-3d42b2d1a9dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:23.145002 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:23.145737 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a77b9e-5869-457b-95c2-2194fb7f5e52 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:23.149309 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0034b2ce-5a74-41e3-b055-3d42b2d1a9dd None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:23.151885 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654ca40f-4ad2-4a0b-b9fd-535f16bb87b2 tempest-VolumeQuotaClassesTest-43442738 tempest-VolumeQuotaClassesTest-43442738-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eefb6e41e514559a285eb8757e76834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb5de7e074884e30ad438d79c339a426', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:23.152766 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654ca40f-4ad2-4a0b-b9fd-535f16bb87b2 tempest-VolumeQuotaClassesTest-43442738 tempest-VolumeQuotaClassesTest-43442738-project-admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:23.153075 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654ca40f-4ad2-4a0b-b9fd-535f16bb87b2 tempest-VolumeQuotaClassesTest-43442738 tempest-VolumeQuotaClassesTest-43442738-project-admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:23.153351 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654ca40f-4ad2-4a0b-b9fd-535f16bb87b2 tempest-VolumeQuotaClassesTest-43442738 tempest-VolumeQuotaClassesTest-43442738-project-admin] PATH_INFO: `/v3/domains` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:23.154246 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654ca40f-4ad2-4a0b-b9fd-535f16bb87b2 tempest-VolumeQuotaClassesTest-43442738 tempest-VolumeQuotaClassesTest-43442738-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:58:23.154651 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654ca40f-4ad2-4a0b-b9fd-535f16bb87b2 tempest-VolumeQuotaClassesTest-43442738 tempest-VolumeQuotaClassesTest-43442738-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:23.154800 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08788561-b690-4a94-86bd-0a8d0d6e931d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c2b78646374cb79ded4b7b59ba49c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:23.155516 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08788561-b690-4a94-86bd-0a8d0d6e931d service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:23.155798 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08788561-b690-4a94-86bd-0a8d0d6e931d service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:23.156073 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08788561-b690-4a94-86bd-0a8d0d6e931d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:23.156881 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654ca40f-4ad2-4a0b-b9fd-535f16bb87b2 tempest-VolumeQuotaClassesTest-43442738 tempest-VolumeQuotaClassesTest-43442738-project-admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:23.166679 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08788561-b690-4a94-86bd-0a8d0d6e931d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:23.168211 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08788561-b690-4a94-86bd-0a8d0d6e931d service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:23.169931 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1120/2253] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Sep 19 14:58:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:58:23.175381 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654ca40f-4ad2-4a0b-b9fd-535f16bb87b2 tempest-VolumeQuotaClassesTest-43442738 tempest-VolumeQuotaClassesTest-43442738-project-admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:23.180290 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1134/2254] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:58:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 14:58:23.188706 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654ca40f-4ad2-4a0b-b9fd-535f16bb87b2 tempest-VolumeQuotaClassesTest-43442738 tempest-VolumeQuotaClassesTest-43442738-project-admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:23.193848 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51e0b8b-8665-4978-a3d1-e858f55a9c28 tempest-VolumeQuotaClassesTest-43442738 tempest-VolumeQuotaClassesTest-43442738-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eefb6e41e514559a285eb8757e76834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb5de7e074884e30ad438d79c339a426', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:23.194717 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51e0b8b-8665-4978-a3d1-e858f55a9c28 tempest-VolumeQuotaClassesTest-43442738 tempest-VolumeQuotaClassesTest-43442738-project-admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:23.195003 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51e0b8b-8665-4978-a3d1-e858f55a9c28 tempest-VolumeQuotaClassesTest-43442738 tempest-VolumeQuotaClassesTest-43442738-project-admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:23.195319 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51e0b8b-8665-4978-a3d1-e858f55a9c28 tempest-VolumeQuotaClassesTest-43442738 tempest-VolumeQuotaClassesTest-43442738-project-admin] PATH_INFO: `/v3/projects` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:23.195920 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51e0b8b-8665-4978-a3d1-e858f55a9c28 tempest-VolumeQuotaClassesTest-43442738 tempest-VolumeQuotaClassesTest-43442738-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:23.197851 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51e0b8b-8665-4978-a3d1-e858f55a9c28 tempest-VolumeQuotaClassesTest-43442738 tempest-VolumeQuotaClassesTest-43442738-project-admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:23.224795 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:23.233411 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1121/2255] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Sep 19 14:58:23 2022] POST /identity/v3/projects => generated 353 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 14:58:23.237798 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08788561-b690-4a94-86bd-0a8d0d6e931d service neutron] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:23.255505 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08788561-b690-4a94-86bd-0a8d0d6e931d service neutron] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:23.331965 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4645bf83-8529-4db1-b077-bef6170831a9 tempest-VolumeQuotaClassesTest-43442738 tempest-VolumeQuotaClassesTest-43442738-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eefb6e41e514559a285eb8757e76834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb5de7e074884e30ad438d79c339a426', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:23.332522 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4645bf83-8529-4db1-b077-bef6170831a9 tempest-VolumeQuotaClassesTest-43442738 tempest-VolumeQuotaClassesTest-43442738-project-admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:23.332813 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4645bf83-8529-4db1-b077-bef6170831a9 tempest-VolumeQuotaClassesTest-43442738 tempest-VolumeQuotaClassesTest-43442738-project-admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:23.333085 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4645bf83-8529-4db1-b077-bef6170831a9 tempest-VolumeQuotaClassesTest-43442738 tempest-VolumeQuotaClassesTest-43442738-project-admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:23.333729 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4645bf83-8529-4db1-b077-bef6170831a9 tempest-VolumeQuotaClassesTest-43442738 tempest-VolumeQuotaClassesTest-43442738-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:58:23.334036 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4645bf83-8529-4db1-b077-bef6170831a9 tempest-VolumeQuotaClassesTest-43442738 tempest-VolumeQuotaClassesTest-43442738-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:23.335635 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4645bf83-8529-4db1-b077-bef6170831a9 tempest-VolumeQuotaClassesTest-43442738 tempest-VolumeQuotaClassesTest-43442738-project-admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:23.350014 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1135/2256] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Sep 19 14:58:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:58:23.393685 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51e0b8b-8665-4978-a3d1-e858f55a9c28 tempest-VolumeQuotaClassesTest-43442738 tempest-VolumeQuotaClassesTest-43442738-project-admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:23.404761 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51e0b8b-8665-4978-a3d1-e858f55a9c28 tempest-VolumeQuotaClassesTest-43442738 tempest-VolumeQuotaClassesTest-43442738-project-admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:23.411113 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62a04f4-1e9f-4557-b363-c7db73735f11 tempest-VolumeQuotaClassesTest-43442738 tempest-VolumeQuotaClassesTest-43442738-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eefb6e41e514559a285eb8757e76834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb5de7e074884e30ad438d79c339a426', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:23.412282 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62a04f4-1e9f-4557-b363-c7db73735f11 tempest-VolumeQuotaClassesTest-43442738 tempest-VolumeQuotaClassesTest-43442738-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:23.412282 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62a04f4-1e9f-4557-b363-c7db73735f11 tempest-VolumeQuotaClassesTest-43442738 tempest-VolumeQuotaClassesTest-43442738-project-admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:23.412668 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62a04f4-1e9f-4557-b363-c7db73735f11 tempest-VolumeQuotaClassesTest-43442738 tempest-VolumeQuotaClassesTest-43442738-project-admin] PATH_INFO: `/v3/projects/828da57b158544c78aa36ac557a9a96f` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:23.413933 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62a04f4-1e9f-4557-b363-c7db73735f11 tempest-VolumeQuotaClassesTest-43442738 tempest-VolumeQuotaClassesTest-43442738-project-admin] RBAC: Authorizing `identity:delete_project(project_id=828da57b158544c78aa36ac557a9a96f)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:23.415943 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62a04f4-1e9f-4557-b363-c7db73735f11 tempest-VolumeQuotaClassesTest-43442738 tempest-VolumeQuotaClassesTest-43442738-project-admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:23.483268 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-c62a04f4-1e9f-4557-b363-c7db73735f11 tempest-VolumeQuotaClassesTest-43442738 tempest-VolumeQuotaClassesTest-43442738-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '828da57b158544c78aa36ac557a9a96f', 'request_id': 'req-c62a04f4-1e9f-4557-b363-c7db73735f11'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:23.493884 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-c62a04f4-1e9f-4557-b363-c7db73735f11 tempest-VolumeQuotaClassesTest-43442738 tempest-VolumeQuotaClassesTest-43442738-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '828da57b158544c78aa36ac557a9a96f', 'request_id': 'req-c62a04f4-1e9f-4557-b363-c7db73735f11'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:23.502581 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-c62a04f4-1e9f-4557-b363-c7db73735f11 tempest-VolumeQuotaClassesTest-43442738 tempest-VolumeQuotaClassesTest-43442738-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '828da57b158544c78aa36ac557a9a96f', 'request_id': 'req-c62a04f4-1e9f-4557-b363-c7db73735f11'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:23.519366 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-c62a04f4-1e9f-4557-b363-c7db73735f11 tempest-VolumeQuotaClassesTest-43442738 tempest-VolumeQuotaClassesTest-43442738-project-admin] The token cache is being invalidate because project 828da57b158544c78aa36ac557a9a96f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 14:58:23.523809 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-c62a04f4-1e9f-4557-b363-c7db73735f11 tempest-VolumeQuotaClassesTest-43442738 tempest-VolumeQuotaClassesTest-43442738-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:23.524697 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-c62a04f4-1e9f-4557-b363-c7db73735f11 tempest-VolumeQuotaClassesTest-43442738 tempest-VolumeQuotaClassesTest-43442738-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:23.526554 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1122/2257] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Sep 19 14:58:23 2022] DELETE /identity/v3/projects/828da57b158544c78aa36ac557a9a96f => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:58:23.565952 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4645bf83-8529-4db1-b077-bef6170831a9 tempest-VolumeQuotaClassesTest-43442738 tempest-VolumeQuotaClassesTest-43442738-project-admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:23.570986 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-4645bf83-8529-4db1-b077-bef6170831a9 tempest-VolumeQuotaClassesTest-43442738 tempest-VolumeQuotaClassesTest-43442738-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:23.671570 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4645bf83-8529-4db1-b077-bef6170831a9 tempest-VolumeQuotaClassesTest-43442738 tempest-VolumeQuotaClassesTest-43442738-project-admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:23.749689 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c14ee00-e4d0-4599-b258-d263e0ee1393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:23.750388 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c14ee00-e4d0-4599-b258-d263e0ee1393 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:23.750615 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c14ee00-e4d0-4599-b258-d263e0ee1393 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:23.750883 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c14ee00-e4d0-4599-b258-d263e0ee1393 admin admin] PATH_INFO: `/v3/projects/4ca84c3ef8ef423f930b5d09a209da18` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:23.752037 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c14ee00-e4d0-4599-b258-d263e0ee1393 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ca84c3ef8ef423f930b5d09a209da18)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:23.754019 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c14ee00-e4d0-4599-b258-d263e0ee1393 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:23.816038 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:23.828596 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62a04f4-1e9f-4557-b363-c7db73735f11 tempest-VolumeQuotaClassesTest-43442738 tempest-VolumeQuotaClassesTest-43442738-project-admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:23.830187 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-c62a04f4-1e9f-4557-b363-c7db73735f11 tempest-VolumeQuotaClassesTest-43442738 tempest-VolumeQuotaClassesTest-43442738-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:23.837895 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-0c14ee00-e4d0-4599-b258-d263e0ee1393 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ca84c3ef8ef423f930b5d09a209da18', 'request_id': 'req-0c14ee00-e4d0-4599-b258-d263e0ee1393'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:23.846910 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62a04f4-1e9f-4557-b363-c7db73735f11 tempest-VolumeQuotaClassesTest-43442738 tempest-VolumeQuotaClassesTest-43442738-project-admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:23.847926 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-0c14ee00-e4d0-4599-b258-d263e0ee1393 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ca84c3ef8ef423f930b5d09a209da18', 'request_id': 'req-0c14ee00-e4d0-4599-b258-d263e0ee1393'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:23.854836 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-0c14ee00-e4d0-4599-b258-d263e0ee1393 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ca84c3ef8ef423f930b5d09a209da18', 'request_id': 'req-0c14ee00-e4d0-4599-b258-d263e0ee1393'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:23.879796 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-0c14ee00-e4d0-4599-b258-d263e0ee1393 admin admin] The token cache is being invalidate because project 4ca84c3ef8ef423f930b5d09a209da18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 14:58:23.880183 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-0c14ee00-e4d0-4599-b258-d263e0ee1393 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:23.880985 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-0c14ee00-e4d0-4599-b258-d263e0ee1393 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:23.883046 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1136/2258] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Sep 19 14:58:23 2022] DELETE /identity/v3/projects/4ca84c3ef8ef423f930b5d09a209da18 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:58:23.887780 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5eebe6-f423-4a89-9b93-b0fb01e8b2ae None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:23.888067 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5eebe6-f423-4a89-9b93-b0fb01e8b2ae None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:23.888365 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5eebe6-f423-4a89-9b93-b0fb01e8b2ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:23.916788 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-3b5eebe6-f423-4a89-9b93-b0fb01e8b2ae None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:58:23.919307 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-3b5eebe6-f423-4a89-9b93-b0fb01e8b2ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:23.927511 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d15acba-69fa-4c00-b285-21496d2114a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:23.928201 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d15acba-69fa-4c00-b285-21496d2114a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:23.928518 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d15acba-69fa-4c00-b285-21496d2114a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:23.928798 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d15acba-69fa-4c00-b285-21496d2114a1 admin admin] PATH_INFO: `/v3/users/b508e3485fea480aadfa480b487e7288` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:23.929980 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d15acba-69fa-4c00-b285-21496d2114a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b508e3485fea480aadfa480b487e7288)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:23.931905 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d15acba-69fa-4c00-b285-21496d2114a1 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:23.987722 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1137/2259] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:58:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:58:23.996438 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b810c09-ff5b-4f1f-b1ec-bfe9073d7d93 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:23.996824 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b810c09-ff5b-4f1f-b1ec-bfe9073d7d93 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:23.997091 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b810c09-ff5b-4f1f-b1ec-bfe9073d7d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:23.998013 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-5d15acba-69fa-4c00-b285-21496d2114a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b508e3485fea480aadfa480b487e7288'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:24.015297 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-5d15acba-69fa-4c00-b285-21496d2114a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b508e3485fea480aadfa480b487e7288'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:24.019251 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-3b810c09-ff5b-4f1f-b1ec-bfe9073d7d93 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:58:24.021200 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-3b810c09-ff5b-4f1f-b1ec-bfe9073d7d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:24.022645 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-5d15acba-69fa-4c00-b285-21496d2114a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b508e3485fea480aadfa480b487e7288'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:24.023344 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-5d15acba-69fa-4c00-b285-21496d2114a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b508e3485fea480aadfa480b487e7288'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:24.032803 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1138/2260] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:58:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 14:58:24.034989 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-5d15acba-69fa-4c00-b285-21496d2114a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b508e3485fea480aadfa480b487e7288'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:24.038267 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b810c09-ff5b-4f1f-b1ec-bfe9073d7d93 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:24.043023 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1123/2261] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Sep 19 14:58:23 2022] DELETE /identity/v3/users/b508e3485fea480aadfa480b487e7288 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:58:24.048931 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a592fc-ac8e-46df-879f-a8bb371101c8 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:24.049236 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a592fc-ac8e-46df-879f-a8bb371101c8 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:24.049519 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a592fc-ac8e-46df-879f-a8bb371101c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:24.055128 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b810c09-ff5b-4f1f-b1ec-bfe9073d7d93 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:24.058853 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:24.078855 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-a8a592fc-ac8e-46df-879f-a8bb371101c8 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:58:24.080657 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-a8a592fc-ac8e-46df-879f-a8bb371101c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:24.158534 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1124/2262] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:58:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 14:58:24.160650 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e2453e-dc51-40ce-9d5d-7b32243d3708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:24.164664 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e2453e-dc51-40ce-9d5d-7b32243d3708 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:24.165195 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e2453e-dc51-40ce-9d5d-7b32243d3708 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:24.165703 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e2453e-dc51-40ce-9d5d-7b32243d3708 admin admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:24.166479 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e2453e-dc51-40ce-9d5d-7b32243d3708 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:58:24.166902 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e2453e-dc51-40ce-9d5d-7b32243d3708 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:24.169566 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e2453e-dc51-40ce-9d5d-7b32243d3708 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:24.194620 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1139/2263] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Sep 19 14:58:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:58:24.199110 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a592fc-ac8e-46df-879f-a8bb371101c8 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:24.210696 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a592fc-ac8e-46df-879f-a8bb371101c8 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:24.215439 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e2453e-dc51-40ce-9d5d-7b32243d3708 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:24.216092 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062521a0-13a3-4a61-9e46-fe7057cec457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:24.217616 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062521a0-13a3-4a61-9e46-fe7057cec457 admin admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:24.217988 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062521a0-13a3-4a61-9e46-fe7057cec457 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:24.218356 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062521a0-13a3-4a61-9e46-fe7057cec457 admin admin] PATH_INFO: `/v3/projects` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:24.218510 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-d7e2453e-dc51-40ce-9d5d-7b32243d3708 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:24.219135 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062521a0-13a3-4a61-9e46-fe7057cec457 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:24.221378 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062521a0-13a3-4a61-9e46-fe7057cec457 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:24.261439 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1125/2264] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Sep 19 14:58:24 2022] POST /identity/v3/projects => generated 381 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:58:24.262156 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062521a0-13a3-4a61-9e46-fe7057cec457 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:24.339765 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062521a0-13a3-4a61-9e46-fe7057cec457 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:24.353085 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aaba7f-8d2b-472d-82dc-e6a81317ef2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:24.353715 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aaba7f-8d2b-472d-82dc-e6a81317ef2b admin admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:24.354033 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aaba7f-8d2b-472d-82dc-e6a81317ef2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:24.354267 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aaba7f-8d2b-472d-82dc-e6a81317ef2b admin admin] PATH_INFO: `/v3/users` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:24.354908 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aaba7f-8d2b-472d-82dc-e6a81317ef2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:24.355039 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e2453e-dc51-40ce-9d5d-7b32243d3708 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:24.357253 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aaba7f-8d2b-472d-82dc-e6a81317ef2b admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:24.359348 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:24.394505 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1126/2265] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Sep 19 14:58:24 2022] POST /identity/v3/users => generated 291 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:58:24.398827 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aaba7f-8d2b-472d-82dc-e6a81317ef2b admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:24.409585 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aaba7f-8d2b-472d-82dc-e6a81317ef2b admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:24.415426 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeae4a19-cd33-4977-8eb4-a600ca62046c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:24.416125 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeae4a19-cd33-4977-8eb4-a600ca62046c admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:24.416446 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeae4a19-cd33-4977-8eb4-a600ca62046c admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:24.416928 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeae4a19-cd33-4977-8eb4-a600ca62046c admin admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:24.417596 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeae4a19-cd33-4977-8eb4-a600ca62046c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:24.419546 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeae4a19-cd33-4977-8eb4-a600ca62046c admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:24.422858 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa9296d-2cf7-43d2-a12b-6f49c6db7103 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c2b78646374cb79ded4b7b59ba49c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:24.423685 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa9296d-2cf7-43d2-a12b-6f49c6db7103 service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:24.424005 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa9296d-2cf7-43d2-a12b-6f49c6db7103 service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:24.424490 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa9296d-2cf7-43d2-a12b-6f49c6db7103 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:24.432617 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1127/2266] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:58:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:58:24.435960 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeae4a19-cd33-4977-8eb4-a600ca62046c admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:24.437460 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa9296d-2cf7-43d2-a12b-6f49c6db7103 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:24.438914 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa9296d-2cf7-43d2-a12b-6f49c6db7103 service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:24.449115 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeae4a19-cd33-4977-8eb4-a600ca62046c admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:24.449917 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1140/2267] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:58:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:58:24.456588 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ca1ce7-7da1-4cf2-8886-c8049ea80d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:24.457537 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ca1ce7-7da1-4cf2-8886-c8049ea80d7b admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:24.457993 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ca1ce7-7da1-4cf2-8886-c8049ea80d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:24.458469 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ca1ce7-7da1-4cf2-8886-c8049ea80d7b admin admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:24.459614 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ca1ce7-7da1-4cf2-8886-c8049ea80d7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:24.462220 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ca1ce7-7da1-4cf2-8886-c8049ea80d7b admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:24.474608 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1128/2268] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:58:24 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 14:58:24.478948 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa9296d-2cf7-43d2-a12b-6f49c6db7103 service neutron] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:24.492269 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa9296d-2cf7-43d2-a12b-6f49c6db7103 service neutron] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:24.497801 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74810fa5-61c4-4087-8328-5deaa320918a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:24.498989 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74810fa5-61c4-4087-8328-5deaa320918a admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:24.499451 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74810fa5-61c4-4087-8328-5deaa320918a admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:24.499886 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74810fa5-61c4-4087-8328-5deaa320918a admin admin] PATH_INFO: `/v3/projects/3c6e8449bf9c41cc88c8775bd609efe0/users/5982227628a54ff2942c058addf107bd/roles/efa0e5b3413748dc828a89b12d67df79` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:24.534165 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74810fa5-61c4-4087-8328-5deaa320918a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c6e8449bf9c41cc88c8775bd609efe0, user_id=5982227628a54ff2942c058addf107bd, role_id=efa0e5b3413748dc828a89b12d67df79)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:24.537024 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74810fa5-61c4-4087-8328-5deaa320918a admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:24.554934 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1141/2269] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 14:58:24 2022] PUT /identity/v3/projects/3c6e8449bf9c41cc88c8775bd609efe0/users/5982227628a54ff2942c058addf107bd/roles/efa0e5b3413748dc828a89b12d67df79 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:58:24.560002 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768cb669-5660-420c-8caf-de9e90494b67 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:24.560284 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768cb669-5660-420c-8caf-de9e90494b67 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:24.560698 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768cb669-5660-420c-8caf-de9e90494b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:24.583603 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-768cb669-5660-420c-8caf-de9e90494b67 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:58:24.584843 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-768cb669-5660-420c-8caf-de9e90494b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:24.640288 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:24.657552 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1129/2270] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:58:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:58:24.667196 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74810fa5-61c4-4087-8328-5deaa320918a admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:24.668996 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-74810fa5-61c4-4087-8328-5deaa320918a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:24.738772 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74810fa5-61c4-4087-8328-5deaa320918a admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:24.743540 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6b5d31-92cd-4f58-b5ae-83ce453c9a2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c2b78646374cb79ded4b7b59ba49c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:24.744470 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b5d31-92cd-4f58-b5ae-83ce453c9a2c service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:24.744746 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b5d31-92cd-4f58-b5ae-83ce453c9a2c service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:24.745014 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b5d31-92cd-4f58-b5ae-83ce453c9a2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:24.755532 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6b5d31-92cd-4f58-b5ae-83ce453c9a2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:24.757285 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6b5d31-92cd-4f58-b5ae-83ce453c9a2c service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:24.767402 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1142/2271] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:58:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:58:24.928365 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768cb669-5660-420c-8caf-de9e90494b67 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:24.932882 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-768cb669-5660-420c-8caf-de9e90494b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:24.950565 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768cb669-5660-420c-8caf-de9e90494b67 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:24.971714 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b098c7-7417-4dbf-82d5-b7cb62ececdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:24.974679 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b098c7-7417-4dbf-82d5-b7cb62ececdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:24.975390 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b098c7-7417-4dbf-82d5-b7cb62ececdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:24.976309 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b098c7-7417-4dbf-82d5-b7cb62ececdc admin admin] PATH_INFO: `/v3/users/7c0b6b91890c4ecabc1e533e4645fac8` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:24.979260 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b098c7-7417-4dbf-82d5-b7cb62ececdc admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c0b6b91890c4ecabc1e533e4645fac8)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:24.982933 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b098c7-7417-4dbf-82d5-b7cb62ececdc admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:25.011415 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6b5d31-92cd-4f58-b5ae-83ce453c9a2c service neutron] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:25.013091 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-9f6b5d31-92cd-4f58-b5ae-83ce453c9a2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:25.037903 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6b5d31-92cd-4f58-b5ae-83ce453c9a2c service neutron] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:25.045866 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb677141-293c-425e-96d8-cede9d5eaa5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:25.046948 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb677141-293c-425e-96d8-cede9d5eaa5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:25.047429 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb677141-293c-425e-96d8-cede9d5eaa5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:25.047823 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb677141-293c-425e-96d8-cede9d5eaa5a admin admin] PATH_INFO: `/v3/projects/c2819168434f435b907ecd7cd318e831` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:25.049212 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb677141-293c-425e-96d8-cede9d5eaa5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2819168434f435b907ecd7cd318e831)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:25.051292 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb677141-293c-425e-96d8-cede9d5eaa5a admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:25.060812 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-c0b098c7-7417-4dbf-82d5-b7cb62ececdc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c0b6b91890c4ecabc1e533e4645fac8'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:25.078219 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-c0b098c7-7417-4dbf-82d5-b7cb62ececdc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c0b6b91890c4ecabc1e533e4645fac8'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:25.087536 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-c0b098c7-7417-4dbf-82d5-b7cb62ececdc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c0b6b91890c4ecabc1e533e4645fac8'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:25.088366 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-c0b098c7-7417-4dbf-82d5-b7cb62ececdc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c0b6b91890c4ecabc1e533e4645fac8'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:25.098283 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-c0b098c7-7417-4dbf-82d5-b7cb62ececdc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c0b6b91890c4ecabc1e533e4645fac8'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:25.105255 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1130/2272] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Sep 19 14:58:24 2022] DELETE /identity/v3/users/7c0b6b91890c4ecabc1e533e4645fac8 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:58:25.110643 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb62404d-33f2-44ef-8ddf-d8c919073fbd None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:25.110930 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb62404d-33f2-44ef-8ddf-d8c919073fbd None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:25.111213 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb62404d-33f2-44ef-8ddf-d8c919073fbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:25.112636 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-eb677141-293c-425e-96d8-cede9d5eaa5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2819168434f435b907ecd7cd318e831', 'request_id': 'req-eb677141-293c-425e-96d8-cede9d5eaa5a'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:25.125406 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-eb677141-293c-425e-96d8-cede9d5eaa5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2819168434f435b907ecd7cd318e831', 'request_id': 'req-eb677141-293c-425e-96d8-cede9d5eaa5a'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:25.135097 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-eb677141-293c-425e-96d8-cede9d5eaa5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2819168434f435b907ecd7cd318e831', 'request_id': 'req-eb677141-293c-425e-96d8-cede9d5eaa5a'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:25.136403 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-eb62404d-33f2-44ef-8ddf-d8c919073fbd None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:58:25.137719 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-eb62404d-33f2-44ef-8ddf-d8c919073fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:25.148877 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-eb677141-293c-425e-96d8-cede9d5eaa5a admin admin] The token cache is being invalidate because project c2819168434f435b907ecd7cd318e831 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 14:58:25.149484 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-eb677141-293c-425e-96d8-cede9d5eaa5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:25.150397 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-eb677141-293c-425e-96d8-cede9d5eaa5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:25.152492 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1143/2273] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Sep 19 14:58:25 2022] DELETE /identity/v3/projects/c2819168434f435b907ecd7cd318e831 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 14:58:25.157068 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb677141-293c-425e-96d8-cede9d5eaa5a admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:25.158625 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-eb677141-293c-425e-96d8-cede9d5eaa5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:25.179763 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:25.219675 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1131/2274] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:58:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 14:58:25.242505 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb62404d-33f2-44ef-8ddf-d8c919073fbd None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:25.248376 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-eb62404d-33f2-44ef-8ddf-d8c919073fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:25.265143 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb677141-293c-425e-96d8-cede9d5eaa5a admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:25.270416 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82364498-62ef-44be-94a2-e6aff77cd6c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:25.271168 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82364498-62ef-44be-94a2-e6aff77cd6c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:25.271547 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82364498-62ef-44be-94a2-e6aff77cd6c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:25.271921 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82364498-62ef-44be-94a2-e6aff77cd6c3 admin admin] PATH_INFO: `/v3/users/6eefb6e41e514559a285eb8757e76834` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:25.273260 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82364498-62ef-44be-94a2-e6aff77cd6c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6eefb6e41e514559a285eb8757e76834)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:25.275682 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82364498-62ef-44be-94a2-e6aff77cd6c3 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:25.354028 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-82364498-62ef-44be-94a2-e6aff77cd6c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6eefb6e41e514559a285eb8757e76834'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:25.363672 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb62404d-33f2-44ef-8ddf-d8c919073fbd None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:25.368936 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc856537-ce11-4080-8189-05d4d072842b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c2b78646374cb79ded4b7b59ba49c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:25.369716 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc856537-ce11-4080-8189-05d4d072842b service neutron] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:25.371952 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc856537-ce11-4080-8189-05d4d072842b service neutron] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:25.371952 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc856537-ce11-4080-8189-05d4d072842b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:25.376769 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-82364498-62ef-44be-94a2-e6aff77cd6c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6eefb6e41e514559a285eb8757e76834'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:25.385644 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc856537-ce11-4080-8189-05d4d072842b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:25.387900 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-82364498-62ef-44be-94a2-e6aff77cd6c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6eefb6e41e514559a285eb8757e76834'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:25.393435 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc856537-ce11-4080-8189-05d4d072842b service neutron] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:25.403431 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-82364498-62ef-44be-94a2-e6aff77cd6c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6eefb6e41e514559a285eb8757e76834'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:25.404231 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-82364498-62ef-44be-94a2-e6aff77cd6c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6eefb6e41e514559a285eb8757e76834'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:25.411546 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1132/2275] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:58:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:58:25.411768 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1144/2276] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Sep 19 14:58:25 2022] DELETE /identity/v3/users/6eefb6e41e514559a285eb8757e76834 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 14:58:25.704748 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49a0ec5-6eec-4ed2-bd98-57a98af942de None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:25.705041 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49a0ec5-6eec-4ed2-bd98-57a98af942de None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:25.705574 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49a0ec5-6eec-4ed2-bd98-57a98af942de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:25.756960 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-a49a0ec5-6eec-4ed2-bd98-57a98af942de None None] MFA Rules not processed for user `5982227628a54ff2942c058addf107bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:58:25.761904 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-a49a0ec5-6eec-4ed2-bd98-57a98af942de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:25.839845 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc856537-ce11-4080-8189-05d4d072842b service neutron] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:25.843137 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-fc856537-ce11-4080-8189-05d4d072842b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:25.862515 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:25.866801 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc856537-ce11-4080-8189-05d4d072842b service neutron] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:25.932801 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1145/2277] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:58:25 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:58:25.934832 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49a0ec5-6eec-4ed2-bd98-57a98af942de None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:25.940533 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-a49a0ec5-6eec-4ed2-bd98-57a98af942de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:25.985913 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f173f55-73d7-4018-9d39-70396d65c6ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:25.986665 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f173f55-73d7-4018-9d39-70396d65c6ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:25.986948 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f173f55-73d7-4018-9d39-70396d65c6ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:25.987235 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f173f55-73d7-4018-9d39-70396d65c6ab admin admin] PATH_INFO: `/v3/projects/752147d150bf44d8b3b5254994b86cbb` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:25.989402 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f173f55-73d7-4018-9d39-70396d65c6ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=752147d150bf44d8b3b5254994b86cbb)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:25.991306 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f173f55-73d7-4018-9d39-70396d65c6ab admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:25.997058 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:26.063732 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-2f173f55-73d7-4018-9d39-70396d65c6ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '752147d150bf44d8b3b5254994b86cbb', 'request_id': 'req-2f173f55-73d7-4018-9d39-70396d65c6ab'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:26.073144 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49a0ec5-6eec-4ed2-bd98-57a98af942de None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:26.073787 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-2f173f55-73d7-4018-9d39-70396d65c6ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '752147d150bf44d8b3b5254994b86cbb', 'request_id': 'req-2f173f55-73d7-4018-9d39-70396d65c6ab'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:26.082440 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-2f173f55-73d7-4018-9d39-70396d65c6ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '752147d150bf44d8b3b5254994b86cbb', 'request_id': 'req-2f173f55-73d7-4018-9d39-70396d65c6ab'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:26.096466 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-2f173f55-73d7-4018-9d39-70396d65c6ab admin admin] The token cache is being invalidate because project 752147d150bf44d8b3b5254994b86cbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 14:58:26.097032 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-2f173f55-73d7-4018-9d39-70396d65c6ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:26.098182 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-2f173f55-73d7-4018-9d39-70396d65c6ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:26.103689 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1133/2278] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Sep 19 14:58:25 2022] DELETE /identity/v3/projects/752147d150bf44d8b3b5254994b86cbb => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:58:26.103689 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f173f55-73d7-4018-9d39-70396d65c6ab admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:26.109966 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-2f173f55-73d7-4018-9d39-70396d65c6ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:26.152619 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c55527-7e58-488c-8102-2ea2bf39aeae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:26.153359 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c55527-7e58-488c-8102-2ea2bf39aeae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:26.153773 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c55527-7e58-488c-8102-2ea2bf39aeae admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:26.154114 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c55527-7e58-488c-8102-2ea2bf39aeae admin admin] PATH_INFO: `/v3/projects/fb5de7e074884e30ad438d79c339a426` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:26.155757 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c55527-7e58-488c-8102-2ea2bf39aeae admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb5de7e074884e30ad438d79c339a426)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:26.157916 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c55527-7e58-488c-8102-2ea2bf39aeae admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:26.189622 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f173f55-73d7-4018-9d39-70396d65c6ab admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:26.194453 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddbbc42-24e2-41de-a851-3896976a617d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139dc7a4f1dc48fe8faea848bd1ac0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:26.195272 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddbbc42-24e2-41de-a851-3896976a617d service cinder] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:26.195681 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddbbc42-24e2-41de-a851-3896976a617d service cinder] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:26.196048 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddbbc42-24e2-41de-a851-3896976a617d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:26.198525 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-4ddbbc42-24e2-41de-a851-3896976a617d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:26.214439 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-39c55527-7e58-488c-8102-2ea2bf39aeae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb5de7e074884e30ad438d79c339a426', 'request_id': 'req-39c55527-7e58-488c-8102-2ea2bf39aeae'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:26.222632 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-39c55527-7e58-488c-8102-2ea2bf39aeae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb5de7e074884e30ad438d79c339a426', 'request_id': 'req-39c55527-7e58-488c-8102-2ea2bf39aeae'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:26.228561 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-39c55527-7e58-488c-8102-2ea2bf39aeae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb5de7e074884e30ad438d79c339a426', 'request_id': 'req-39c55527-7e58-488c-8102-2ea2bf39aeae'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:26.239950 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-39c55527-7e58-488c-8102-2ea2bf39aeae admin admin] The token cache is being invalidate because project fb5de7e074884e30ad438d79c339a426 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 14:58:26.240245 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-39c55527-7e58-488c-8102-2ea2bf39aeae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:26.240920 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-39c55527-7e58-488c-8102-2ea2bf39aeae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:26.242638 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1146/2279] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Sep 19 14:58:25 2022] DELETE /identity/v3/projects/fb5de7e074884e30ad438d79c339a426 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:58:26.243973 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dcb781-976d-468e-b1fa-651af4982e23 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:26.244121 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dcb781-976d-468e-b1fa-651af4982e23 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:26.244430 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dcb781-976d-468e-b1fa-651af4982e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:26.256200 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:26.266600 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-a6dcb781-976d-468e-b1fa-651af4982e23 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:58:26.268006 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-a6dcb781-976d-468e-b1fa-651af4982e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:26.271087 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddbbc42-24e2-41de-a851-3896976a617d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:26.274905 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddbbc42-24e2-41de-a851-3896976a617d service cinder] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:26.285121 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1134/2280] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:58:26 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:58:26.286464 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf70e72e-237c-4ed7-bb78-27a5eceb3acc None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:26.286757 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf70e72e-237c-4ed7-bb78-27a5eceb3acc None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:26.287137 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf70e72e-237c-4ed7-bb78-27a5eceb3acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:26.308105 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-bf70e72e-237c-4ed7-bb78-27a5eceb3acc None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:58:26.309380 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-bf70e72e-237c-4ed7-bb78-27a5eceb3acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:26.330171 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:26.343362 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1147/2281] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:58:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:58:26.351736 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9475f1-a54b-4f78-a741-cd4d64427938 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:26.352075 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9475f1-a54b-4f78-a741-cd4d64427938 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:26.352365 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9475f1-a54b-4f78-a741-cd4d64427938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:26.379608 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-1e9475f1-a54b-4f78-a741-cd4d64427938 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:58:26.380835 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-1e9475f1-a54b-4f78-a741-cd4d64427938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:26.389175 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1148/2282] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:58:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:58:26.393182 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9475f1-a54b-4f78-a741-cd4d64427938 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:26.397170 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1135/2283] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:58:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:58:26.404855 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c54f827-23f4-44e9-9937-3f3b9f3a7219 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:26.405226 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c54f827-23f4-44e9-9937-3f3b9f3a7219 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:26.405646 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c54f827-23f4-44e9-9937-3f3b9f3a7219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:26.410619 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9475f1-a54b-4f78-a741-cd4d64427938 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:26.416478 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c457b0-263b-430e-840e-893643a99de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:26.417114 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c457b0-263b-430e-840e-893643a99de9 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:26.417416 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c457b0-263b-430e-840e-893643a99de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:26.417692 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c457b0-263b-430e-840e-893643a99de9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:26.418342 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c457b0-263b-430e-840e-893643a99de9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:58:26.418648 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c457b0-263b-430e-840e-893643a99de9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:26.422293 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c457b0-263b-430e-840e-893643a99de9 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:26.428594 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-2c54f827-23f4-44e9-9937-3f3b9f3a7219 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:58:26.429977 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-2c54f827-23f4-44e9-9937-3f3b9f3a7219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:26.440099 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1149/2284] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Sep 19 14:58:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:58:26.443522 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1136/2285] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:58:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:58:26.444577 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c457b0-263b-430e-840e-893643a99de9 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:26.446972 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c54f827-23f4-44e9-9937-3f3b9f3a7219 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:26.455749 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c457b0-263b-430e-840e-893643a99de9 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:26.460592 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c54f827-23f4-44e9-9937-3f3b9f3a7219 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:26.461591 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8fd2e6-2b20-4452-8e9f-3583074a8a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:26.462521 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8fd2e6-2b20-4452-8e9f-3583074a8a89 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:26.462868 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8fd2e6-2b20-4452-8e9f-3583074a8a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:26.463313 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8fd2e6-2b20-4452-8e9f-3583074a8a89 admin admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:26.463925 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8fd2e6-2b20-4452-8e9f-3583074a8a89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:26.466238 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8fd2e6-2b20-4452-8e9f-3583074a8a89 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:26.474045 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb743ac-315a-4eb1-954f-f9f991f0383d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:26.475519 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb743ac-315a-4eb1-954f-f9f991f0383d admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:26.476100 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb743ac-315a-4eb1-954f-f9f991f0383d admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:26.476630 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb743ac-315a-4eb1-954f-f9f991f0383d admin admin] PATH_INFO: `/v3/domains` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:26.477623 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb743ac-315a-4eb1-954f-f9f991f0383d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:58:26.478225 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb743ac-315a-4eb1-954f-f9f991f0383d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:26.480520 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb743ac-315a-4eb1-954f-f9f991f0383d admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:26.500989 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1137/2286] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Sep 19 14:58:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:58:26.505969 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1150/2287] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Sep 19 14:58:26 2022] POST /identity/v3/projects => generated 371 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:58:26.506114 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb743ac-315a-4eb1-954f-f9f991f0383d admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:26.506974 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8fd2e6-2b20-4452-8e9f-3583074a8a89 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:26.534178 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb743ac-315a-4eb1-954f-f9f991f0383d admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:26.646285 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be18da-fc2e-4b19-a8b2-db2370b3132c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:26.646977 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be18da-fc2e-4b19-a8b2-db2370b3132c admin admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:26.647260 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be18da-fc2e-4b19-a8b2-db2370b3132c admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:26.647529 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be18da-fc2e-4b19-a8b2-db2370b3132c admin admin] PATH_INFO: `/v3/projects` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:26.649311 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04be18da-fc2e-4b19-a8b2-db2370b3132c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:26.652062 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8fd2e6-2b20-4452-8e9f-3583074a8a89 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:26.654307 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04be18da-fc2e-4b19-a8b2-db2370b3132c admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:26.668258 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee45c65-4abc-4f07-99be-133a19f8a96b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:26.668944 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee45c65-4abc-4f07-99be-133a19f8a96b admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:26.669200 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee45c65-4abc-4f07-99be-133a19f8a96b admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:26.669472 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee45c65-4abc-4f07-99be-133a19f8a96b admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:26.670340 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee45c65-4abc-4f07-99be-133a19f8a96b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:26.676240 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee45c65-4abc-4f07-99be-133a19f8a96b admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:26.727431 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1138/2288] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Sep 19 14:58:26 2022] POST /identity/v3/projects => generated 367 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 14:58:26.727688 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1151/2289] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Sep 19 14:58:26 2022] POST /identity/v3/users => generated 286 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:58:26.729631 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be18da-fc2e-4b19-a8b2-db2370b3132c admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:26.731098 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee45c65-4abc-4f07-99be-133a19f8a96b admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:26.749013 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee45c65-4abc-4f07-99be-133a19f8a96b admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:26.832446 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:26.848926 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be18da-fc2e-4b19-a8b2-db2370b3132c admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:26.853246 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87d9c00-9ade-4fe6-bdfd-65b771347d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:26.854005 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d9c00-9ade-4fe6-bdfd-65b771347d0a admin admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:26.854420 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d9c00-9ade-4fe6-bdfd-65b771347d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:26.854762 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d9c00-9ade-4fe6-bdfd-65b771347d0a admin admin] PATH_INFO: `/v3/users` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:26.855912 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87d9c00-9ade-4fe6-bdfd-65b771347d0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:26.858242 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87d9c00-9ade-4fe6-bdfd-65b771347d0a admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:26.860193 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7151c0-eeec-42cc-b1a9-d3f49837bf01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:26.860995 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7151c0-eeec-42cc-b1a9-d3f49837bf01 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:26.861281 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7151c0-eeec-42cc-b1a9-d3f49837bf01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:26.861696 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7151c0-eeec-42cc-b1a9-d3f49837bf01 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:26.862361 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7151c0-eeec-42cc-b1a9-d3f49837bf01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:26.864015 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7151c0-eeec-42cc-b1a9-d3f49837bf01 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:26.884985 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1152/2290] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:58:26 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 14:58:26.888317 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7151c0-eeec-42cc-b1a9-d3f49837bf01 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:26.900193 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1139/2291] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Sep 19 14:58:26 2022] POST /identity/v3/users => generated 284 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 14:58:26.904126 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87d9c00-9ade-4fe6-bdfd-65b771347d0a admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:26.910336 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7151c0-eeec-42cc-b1a9-d3f49837bf01 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:26.915918 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bcccde-c2fe-4747-a818-9dce33ffc62c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:26.916659 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bcccde-c2fe-4747-a818-9dce33ffc62c admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:26.917004 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bcccde-c2fe-4747-a818-9dce33ffc62c admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:26.917348 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bcccde-c2fe-4747-a818-9dce33ffc62c admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:26.917658 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87d9c00-9ade-4fe6-bdfd-65b771347d0a admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:26.918113 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bcccde-c2fe-4747-a818-9dce33ffc62c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:26.919783 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bcccde-c2fe-4747-a818-9dce33ffc62c admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:26.923680 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c19649-8ee7-479c-93fd-413285dd11e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:26.924316 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c19649-8ee7-479c-93fd-413285dd11e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:26.924619 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c19649-8ee7-479c-93fd-413285dd11e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:26.924891 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c19649-8ee7-479c-93fd-413285dd11e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:26.925571 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c19649-8ee7-479c-93fd-413285dd11e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:26.927639 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c19649-8ee7-479c-93fd-413285dd11e2 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:26.933663 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1153/2292] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:58:26 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 14:58:26.937733 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bcccde-c2fe-4747-a818-9dce33ffc62c admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:26.940378 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1140/2293] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:58:26 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:58:26.943041 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c19649-8ee7-479c-93fd-413285dd11e2 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:26.949095 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bcccde-c2fe-4747-a818-9dce33ffc62c admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:26.955269 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c19649-8ee7-479c-93fd-413285dd11e2 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:26.957681 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b16b69-1c1e-407e-846c-ff629334c80e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:26.959132 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b16b69-1c1e-407e-846c-ff629334c80e admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:26.959535 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b16b69-1c1e-407e-846c-ff629334c80e admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:26.960663 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b16b69-1c1e-407e-846c-ff629334c80e admin admin] PATH_INFO: `/v3/projects/ba53f89c05d840b2968884c5f4cb39e4/users/c46d1b8b7dc74f82a1911f8edcd6271a/roles/efa0e5b3413748dc828a89b12d67df79` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:26.964520 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a86a06-f976-4333-8f74-dbe4b85c05b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:26.965310 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a86a06-f976-4333-8f74-dbe4b85c05b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:26.965598 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a86a06-f976-4333-8f74-dbe4b85c05b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:26.965870 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a86a06-f976-4333-8f74-dbe4b85c05b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:26.966637 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a86a06-f976-4333-8f74-dbe4b85c05b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:26.968916 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a86a06-f976-4333-8f74-dbe4b85c05b0 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:26.982681 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1141/2294] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:58:26 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 14:58:26.991407 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b16b69-1c1e-407e-846c-ff629334c80e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba53f89c05d840b2968884c5f4cb39e4, user_id=c46d1b8b7dc74f82a1911f8edcd6271a, role_id=efa0e5b3413748dc828a89b12d67df79)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:26.992452 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a86a06-f976-4333-8f74-dbe4b85c05b0 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:26.994704 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b16b69-1c1e-407e-846c-ff629334c80e admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:27.005744 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a86a06-f976-4333-8f74-dbe4b85c05b0 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:27.009069 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1154/2295] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 14:58:26 2022] PUT /identity/v3/projects/ba53f89c05d840b2968884c5f4cb39e4/users/c46d1b8b7dc74f82a1911f8edcd6271a/roles/efa0e5b3413748dc828a89b12d67df79 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 14:58:27.014651 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff60b9c-66d0-4a04-b9db-d9239aa2d1c0 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:27.015257 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff60b9c-66d0-4a04-b9db-d9239aa2d1c0 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:27.015804 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff60b9c-66d0-4a04-b9db-d9239aa2d1c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:27.031878 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:27.047651 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-6ff60b9c-66d0-4a04-b9db-d9239aa2d1c0 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:58:27.050280 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-6ff60b9c-66d0-4a04-b9db-d9239aa2d1c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:27.078146 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1baeb8-2e53-41e5-a392-ebc2e22ace34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:27.078883 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1baeb8-2e53-41e5-a392-ebc2e22ace34 admin admin] REQUEST_METHOD: `PUT` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:27.079168 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1baeb8-2e53-41e5-a392-ebc2e22ace34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:27.079492 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1baeb8-2e53-41e5-a392-ebc2e22ace34 admin admin] PATH_INFO: `/v3/projects/bfef7a00b3b04fdd8032ca2ccc1ab420/users/3f72218c6831432986128c054476c553/roles/efa0e5b3413748dc828a89b12d67df79` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:27.108946 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1baeb8-2e53-41e5-a392-ebc2e22ace34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfef7a00b3b04fdd8032ca2ccc1ab420, user_id=3f72218c6831432986128c054476c553, role_id=efa0e5b3413748dc828a89b12d67df79)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:27.113051 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1baeb8-2e53-41e5-a392-ebc2e22ace34 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:27.129951 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1142/2296] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 14:58:26 2022] PUT /identity/v3/projects/bfef7a00b3b04fdd8032ca2ccc1ab420/users/3f72218c6831432986128c054476c553/roles/efa0e5b3413748dc828a89b12d67df79 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:58:27.130417 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1155/2297] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:58:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:58:27.140784 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff60b9c-66d0-4a04-b9db-d9239aa2d1c0 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:27.141119 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6310d182-b977-48c5-bedd-89e0a988319b None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:27.141846 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6310d182-b977-48c5-bedd-89e0a988319b None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:27.142211 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-6ff60b9c-66d0-4a04-b9db-d9239aa2d1c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:27.142318 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6310d182-b977-48c5-bedd-89e0a988319b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:27.177500 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-6310d182-b977-48c5-bedd-89e0a988319b None None] MFA Rules not processed for user `3f72218c6831432986128c054476c553`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:58:27.178826 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-6310d182-b977-48c5-bedd-89e0a988319b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:27.216905 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff60b9c-66d0-4a04-b9db-d9239aa2d1c0 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:27.266073 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1143/2298] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:58:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:58:27.270805 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6310d182-b977-48c5-bedd-89e0a988319b None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:27.293079 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36ffe6a-7a78-4a8c-8184-20edf155e6ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c2b78646374cb79ded4b7b59ba49c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:27.294125 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ffe6a-7a78-4a8c-8184-20edf155e6ae service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:27.296309 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ffe6a-7a78-4a8c-8184-20edf155e6ae service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:27.296874 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ffe6a-7a78-4a8c-8184-20edf155e6ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:27.325071 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:27.365066 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6310d182-b977-48c5-bedd-89e0a988319b None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:27.373121 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36ffe6a-7a78-4a8c-8184-20edf155e6ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:27.374521 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0419656e-03ca-4314-82bd-25cda89dfd91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:27.375217 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36ffe6a-7a78-4a8c-8184-20edf155e6ae service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:27.375858 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0419656e-03ca-4314-82bd-25cda89dfd91 admin admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:27.376493 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0419656e-03ca-4314-82bd-25cda89dfd91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:27.376908 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0419656e-03ca-4314-82bd-25cda89dfd91 admin admin] PATH_INFO: `/v3/projects` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:27.378036 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0419656e-03ca-4314-82bd-25cda89dfd91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:27.384384 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0419656e-03ca-4314-82bd-25cda89dfd91 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:27.388142 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1156/2299] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:58:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 14:58:27.417958 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1144/2300] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Sep 19 14:58:27 2022] POST /identity/v3/projects => generated 367 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 14:58:27.428120 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36ffe6a-7a78-4a8c-8184-20edf155e6ae service neutron] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:27.442900 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36ffe6a-7a78-4a8c-8184-20edf155e6ae service neutron] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:27.453103 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:27.509889 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf55df4-aa47-4fa6-ac6c-a770ce5145b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:27.510768 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf55df4-aa47-4fa6-ac6c-a770ce5145b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:27.511124 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf55df4-aa47-4fa6-ac6c-a770ce5145b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:27.511570 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf55df4-aa47-4fa6-ac6c-a770ce5145b3 admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:27.512291 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf55df4-aa47-4fa6-ac6c-a770ce5145b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:27.514278 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf55df4-aa47-4fa6-ac6c-a770ce5145b3 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:27.539942 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1157/2301] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Sep 19 14:58:27 2022] POST /identity/v3/users => generated 290 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 14:58:27.543834 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0419656e-03ca-4314-82bd-25cda89dfd91 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:27.556420 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0419656e-03ca-4314-82bd-25cda89dfd91 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:27.561693 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28986996-1bfd-4fb4-b636-8d25e6734e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:27.563966 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28986996-1bfd-4fb4-b636-8d25e6734e65 admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:27.563966 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28986996-1bfd-4fb4-b636-8d25e6734e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:27.563966 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28986996-1bfd-4fb4-b636-8d25e6734e65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:27.563966 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28986996-1bfd-4fb4-b636-8d25e6734e65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:27.564837 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28986996-1bfd-4fb4-b636-8d25e6734e65 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:27.576104 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1145/2302] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:58:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 14:58:27.587148 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf55df4-aa47-4fa6-ac6c-a770ce5145b3 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:27.601823 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf55df4-aa47-4fa6-ac6c-a770ce5145b3 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:27.607575 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafbc680-19ca-4ed1-99ea-033d38e391f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:27.609675 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafbc680-19ca-4ed1-99ea-033d38e391f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:27.610100 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafbc680-19ca-4ed1-99ea-033d38e391f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:27.610560 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafbc680-19ca-4ed1-99ea-033d38e391f1 admin admin] PATH_INFO: `/v3/projects/98a3e2f149f041cc88cd623212bd088c/users/46b7e68b2ab3433bbd8bd6435f91f91e/roles/ddb643577b2e4e478100ec370decfaeb` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:27.633600 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafbc680-19ca-4ed1-99ea-033d38e391f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98a3e2f149f041cc88cd623212bd088c, user_id=46b7e68b2ab3433bbd8bd6435f91f91e, role_id=ddb643577b2e4e478100ec370decfaeb)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:27.637145 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafbc680-19ca-4ed1-99ea-033d38e391f1 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:27.651850 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1158/2303] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 14:58:27 2022] PUT /identity/v3/projects/98a3e2f149f041cc88cd623212bd088c/users/46b7e68b2ab3433bbd8bd6435f91f91e/roles/ddb643577b2e4e478100ec370decfaeb => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:58:27.656916 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28986996-1bfd-4fb4-b636-8d25e6734e65 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:27.671748 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28986996-1bfd-4fb4-b636-8d25e6734e65 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:27.748318 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00c8f59-755e-48bf-a19c-9724b8b2a9f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:27.749288 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00c8f59-755e-48bf-a19c-9724b8b2a9f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:27.749572 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00c8f59-755e-48bf-a19c-9724b8b2a9f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:27.750038 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00c8f59-755e-48bf-a19c-9724b8b2a9f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:27.750728 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00c8f59-755e-48bf-a19c-9724b8b2a9f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:27.752357 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00c8f59-755e-48bf-a19c-9724b8b2a9f3 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:27.767913 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1146/2304] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:58:27 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 14:58:27.769091 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafbc680-19ca-4ed1-99ea-033d38e391f1 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:27.782804 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafbc680-19ca-4ed1-99ea-033d38e391f1 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:27.788808 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63120ba2-fbe0-46ce-b5ae-42b90e01c2c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:27.789994 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63120ba2-fbe0-46ce-b5ae-42b90e01c2c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:27.790771 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63120ba2-fbe0-46ce-b5ae-42b90e01c2c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:27.791246 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63120ba2-fbe0-46ce-b5ae-42b90e01c2c5 admin admin] PATH_INFO: `/v3/projects/98a3e2f149f041cc88cd623212bd088c/users/46b7e68b2ab3433bbd8bd6435f91f91e/roles/ddb643577b2e4e478100ec370decfaeb` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:27.793713 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63120ba2-fbe0-46ce-b5ae-42b90e01c2c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98a3e2f149f041cc88cd623212bd088c, user_id=46b7e68b2ab3433bbd8bd6435f91f91e, role_id=ddb643577b2e4e478100ec370decfaeb)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:27.797840 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63120ba2-fbe0-46ce-b5ae-42b90e01c2c5 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:27.836370 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6495f14c-b48b-4bde-8bb6-f53e49e8fccf None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:27.836370 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6495f14c-b48b-4bde-8bb6-f53e49e8fccf None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:27.836370 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6495f14c-b48b-4bde-8bb6-f53e49e8fccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:27.839873 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1159/2305] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 14:58:27 2022] PUT /identity/v3/projects/98a3e2f149f041cc88cd623212bd088c/users/46b7e68b2ab3433bbd8bd6435f91f91e/roles/ddb643577b2e4e478100ec370decfaeb => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:58:27.845313 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aee8c7-05bb-42b6-920b-b1f4b73aca81 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:27.845626 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aee8c7-05bb-42b6-920b-b1f4b73aca81 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:27.845937 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aee8c7-05bb-42b6-920b-b1f4b73aca81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:27.878873 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-6495f14c-b48b-4bde-8bb6-f53e49e8fccf None None] MFA Rules not processed for user `5982227628a54ff2942c058addf107bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:58:27.883091 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-6495f14c-b48b-4bde-8bb6-f53e49e8fccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:27.896901 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-88aee8c7-05bb-42b6-920b-b1f4b73aca81 None None] MFA Rules not processed for user `46b7e68b2ab3433bbd8bd6435f91f91e`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:58:27.898359 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-88aee8c7-05bb-42b6-920b-b1f4b73aca81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:27.972083 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1147/2306] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:58:27 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 14:58:27.998093 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1160/2307] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:58:27 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 14:58:28.012780 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6495f14c-b48b-4bde-8bb6-f53e49e8fccf None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:28.014354 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-6495f14c-b48b-4bde-8bb6-f53e49e8fccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:28.135184 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6495f14c-b48b-4bde-8bb6-f53e49e8fccf None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:28.139217 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f9e263-b528-4ab8-81ce-7de5b4840c94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139dc7a4f1dc48fe8faea848bd1ac0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:28.139985 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f9e263-b528-4ab8-81ce-7de5b4840c94 service cinder] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:28.140476 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f9e263-b528-4ab8-81ce-7de5b4840c94 service cinder] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:28.140756 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f9e263-b528-4ab8-81ce-7de5b4840c94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:28.147883 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:28.157155 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f9e263-b528-4ab8-81ce-7de5b4840c94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:28.158617 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f9e263-b528-4ab8-81ce-7de5b4840c94 service cinder] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:28.171120 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1148/2308] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:58:28 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 14:58:28.270646 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aee8c7-05bb-42b6-920b-b1f4b73aca81 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:28.284701 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aee8c7-05bb-42b6-920b-b1f4b73aca81 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:28.289073 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7d4c59-1286-406a-a573-1315a57e78fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139dc7a4f1dc48fe8faea848bd1ac0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:28.289819 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d4c59-1286-406a-a573-1315a57e78fa service cinder] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:28.290128 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d4c59-1286-406a-a573-1315a57e78fa service cinder] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:28.290427 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d4c59-1286-406a-a573-1315a57e78fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:28.373751 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:28.390707 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7d4c59-1286-406a-a573-1315a57e78fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:28.392553 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7d4c59-1286-406a-a573-1315a57e78fa service cinder] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:28.405805 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1161/2309] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:58:28 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:58:34.360978 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc7c1d-9799-42fd-8aec-f5aad1906ddb None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:34.362362 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc7c1d-9799-42fd-8aec-f5aad1906ddb None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:34.362885 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc7c1d-9799-42fd-8aec-f5aad1906ddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:34.419029 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-5edc7c1d-9799-42fd-8aec-f5aad1906ddb None None] MFA Rules not processed for user `c46d1b8b7dc74f82a1911f8edcd6271a`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:58:34.420564 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-5edc7c1d-9799-42fd-8aec-f5aad1906ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:34.503442 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1149/2310] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:58:34 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:58:34.507925 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7d4c59-1286-406a-a573-1315a57e78fa service cinder] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:34.610551 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7d4c59-1286-406a-a573-1315a57e78fa service cinder] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:34.620194 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6524d28-9912-4c3b-a0c4-08866fed1856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:34.621255 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6524d28-9912-4c3b-a0c4-08866fed1856 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:34.621726 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6524d28-9912-4c3b-a0c4-08866fed1856 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:34.622514 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6524d28-9912-4c3b-a0c4-08866fed1856 admin admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:34.623842 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6524d28-9912-4c3b-a0c4-08866fed1856 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:34.630883 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6524d28-9912-4c3b-a0c4-08866fed1856 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:34.716013 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1162/2311] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Sep 19 14:58:34 2022] POST /identity/v3/projects => generated 371 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:58:34.722594 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edc7c1d-9799-42fd-8aec-f5aad1906ddb None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:34.749048 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edc7c1d-9799-42fd-8aec-f5aad1906ddb None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:34.785026 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6524d28-9912-4c3b-a0c4-08866fed1856 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:34.831329 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9f0405-3cc4-4796-af23-88d545c9f27e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:34.832130 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9f0405-3cc4-4796-af23-88d545c9f27e admin admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:34.832595 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9f0405-3cc4-4796-af23-88d545c9f27e admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:34.833163 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9f0405-3cc4-4796-af23-88d545c9f27e admin admin] PATH_INFO: `/v3/users` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:34.834113 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9f0405-3cc4-4796-af23-88d545c9f27e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:34.837577 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9f0405-3cc4-4796-af23-88d545c9f27e admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:34.867356 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1150/2312] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Sep 19 14:58:34 2022] POST /identity/v3/users => generated 292 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:58:34.885591 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9f0405-3cc4-4796-af23-88d545c9f27e admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:34.902980 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9f0405-3cc4-4796-af23-88d545c9f27e admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:34.932268 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dc66c6-e746-4923-abd3-ed4bf4dcfaf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:34.933197 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dc66c6-e746-4923-abd3-ed4bf4dcfaf6 admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:34.933719 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dc66c6-e746-4923-abd3-ed4bf4dcfaf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:34.934201 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dc66c6-e746-4923-abd3-ed4bf4dcfaf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:34.935093 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dc66c6-e746-4923-abd3-ed4bf4dcfaf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:34.938196 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dc66c6-e746-4923-abd3-ed4bf4dcfaf6 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:34.944023 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6524d28-9912-4c3b-a0c4-08866fed1856 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:34.958282 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1151/2313] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:58:34 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:58:34.961148 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dc66c6-e746-4923-abd3-ed4bf4dcfaf6 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:34.962060 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8813885-d909-4473-b6ae-25e21f7135a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:34.962707 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8813885-d909-4473-b6ae-25e21f7135a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:34.963660 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8813885-d909-4473-b6ae-25e21f7135a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:34.963660 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8813885-d909-4473-b6ae-25e21f7135a1 admin admin] PATH_INFO: `/v3/users/3f72218c6831432986128c054476c553` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:34.966876 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8813885-d909-4473-b6ae-25e21f7135a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f72218c6831432986128c054476c553)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:34.969630 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8813885-d909-4473-b6ae-25e21f7135a1 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:35.000409 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dc66c6-e746-4923-abd3-ed4bf4dcfaf6 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:35.016556 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a45b5c-cc9b-493b-b1dc-cbb50f87e9ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:35.019616 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a45b5c-cc9b-493b-b1dc-cbb50f87e9ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:35.020316 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a45b5c-cc9b-493b-b1dc-cbb50f87e9ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:35.020848 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a45b5c-cc9b-493b-b1dc-cbb50f87e9ff admin admin] PATH_INFO: `/v3/projects/5ca457777a8f4bf7bea435859add346f/users/e1c795967682473da65e9d2bb78a5ff1/roles/ddb643577b2e4e478100ec370decfaeb` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:35.091438 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-b8813885-d909-4473-b6ae-25e21f7135a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f72218c6831432986128c054476c553'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:35.093301 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a45b5c-cc9b-493b-b1dc-cbb50f87e9ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ca457777a8f4bf7bea435859add346f, user_id=e1c795967682473da65e9d2bb78a5ff1, role_id=ddb643577b2e4e478100ec370decfaeb)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:35.096817 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a45b5c-cc9b-493b-b1dc-cbb50f87e9ff admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:35.112394 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-b8813885-d909-4473-b6ae-25e21f7135a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f72218c6831432986128c054476c553'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:35.122027 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-b8813885-d909-4473-b6ae-25e21f7135a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f72218c6831432986128c054476c553'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:35.126319 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:35.129577 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1152/2314] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 14:58:34 2022] PUT /identity/v3/projects/5ca457777a8f4bf7bea435859add346f/users/e1c795967682473da65e9d2bb78a5ff1/roles/ddb643577b2e4e478100ec370decfaeb => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:58:35.133032 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a45b5c-cc9b-493b-b1dc-cbb50f87e9ff admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:35.144368 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-b8813885-d909-4473-b6ae-25e21f7135a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f72218c6831432986128c054476c553'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:35.145511 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-b8813885-d909-4473-b6ae-25e21f7135a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f72218c6831432986128c054476c553'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:35.157880 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1163/2315] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Sep 19 14:58:34 2022] DELETE /identity/v3/users/3f72218c6831432986128c054476c553 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 14:58:35.163124 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ea86e2-19b8-4576-826c-80a5bdbaefc5 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:35.163743 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ea86e2-19b8-4576-826c-80a5bdbaefc5 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:35.164385 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ea86e2-19b8-4576-826c-80a5bdbaefc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:35.197864 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-f1ea86e2-19b8-4576-826c-80a5bdbaefc5 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:58:35.200677 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-f1ea86e2-19b8-4576-826c-80a5bdbaefc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:35.274499 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:35.314777 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a45b5c-cc9b-493b-b1dc-cbb50f87e9ff admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:35.321749 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15470cce-0889-4302-98d3-8d94e57fd102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:35.322315 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1164/2316] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:58:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:58:35.323578 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15470cce-0889-4302-98d3-8d94e57fd102 admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:35.324113 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15470cce-0889-4302-98d3-8d94e57fd102 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:35.324490 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15470cce-0889-4302-98d3-8d94e57fd102 admin admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:35.325342 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15470cce-0889-4302-98d3-8d94e57fd102 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:35.337458 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15470cce-0889-4302-98d3-8d94e57fd102 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:35.354117 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1153/2317] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:58:35 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:58:35.362649 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ea86e2-19b8-4576-826c-80a5bdbaefc5 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:35.364282 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-f1ea86e2-19b8-4576-826c-80a5bdbaefc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:35.371661 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15470cce-0889-4302-98d3-8d94e57fd102 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:35.377469 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-15470cce-0889-4302-98d3-8d94e57fd102 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:35.377698 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ea86e2-19b8-4576-826c-80a5bdbaefc5 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:35.390604 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5f8af5-99a7-47e2-bd4f-4c9215241a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:35.390980 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5f8af5-99a7-47e2-bd4f-4c9215241a1e admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:35.391390 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5f8af5-99a7-47e2-bd4f-4c9215241a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:35.391662 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5f8af5-99a7-47e2-bd4f-4c9215241a1e admin admin] PATH_INFO: `/v3/projects/5ca457777a8f4bf7bea435859add346f/users/e1c795967682473da65e9d2bb78a5ff1/roles/ddb643577b2e4e478100ec370decfaeb` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:35.393880 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5f8af5-99a7-47e2-bd4f-4c9215241a1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ca457777a8f4bf7bea435859add346f, user_id=e1c795967682473da65e9d2bb78a5ff1, role_id=ddb643577b2e4e478100ec370decfaeb)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:35.398113 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5f8af5-99a7-47e2-bd4f-4c9215241a1e admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:35.426868 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1165/2318] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 14:58:35 2022] PUT /identity/v3/projects/5ca457777a8f4bf7bea435859add346f/users/e1c795967682473da65e9d2bb78a5ff1/roles/ddb643577b2e4e478100ec370decfaeb => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:58:35.493648 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15470cce-0889-4302-98d3-8d94e57fd102 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:35.621335 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b0ae05-ce78-44d1-a3c0-9ea450312ffd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c2b78646374cb79ded4b7b59ba49c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:35.623650 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b0ae05-ce78-44d1-a3c0-9ea450312ffd service neutron] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:35.623650 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b0ae05-ce78-44d1-a3c0-9ea450312ffd service neutron] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:35.624019 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b0ae05-ce78-44d1-a3c0-9ea450312ffd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:35.734491 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b0ae05-ce78-44d1-a3c0-9ea450312ffd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:35.735773 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b0ae05-ce78-44d1-a3c0-9ea450312ffd service neutron] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:35.764500 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1154/2319] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:58:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:58:37.166882 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5f8af5-99a7-47e2-bd4f-4c9215241a1e admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:37.168783 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-1e5f8af5-99a7-47e2-bd4f-4c9215241a1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:37.185027 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5f8af5-99a7-47e2-bd4f-4c9215241a1e admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:37.191715 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37b3d9f-3c8b-4c7d-87f6-6308fb9b0e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:37.195372 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b3d9f-3c8b-4c7d-87f6-6308fb9b0e92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:37.195800 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b3d9f-3c8b-4c7d-87f6-6308fb9b0e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:37.196149 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b3d9f-3c8b-4c7d-87f6-6308fb9b0e92 admin admin] PATH_INFO: `/v3/projects/bfef7a00b3b04fdd8032ca2ccc1ab420` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:37.197563 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37b3d9f-3c8b-4c7d-87f6-6308fb9b0e92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfef7a00b3b04fdd8032ca2ccc1ab420)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:37.200228 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37b3d9f-3c8b-4c7d-87f6-6308fb9b0e92 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:37.292698 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-b37b3d9f-3c8b-4c7d-87f6-6308fb9b0e92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfef7a00b3b04fdd8032ca2ccc1ab420', 'request_id': 'req-b37b3d9f-3c8b-4c7d-87f6-6308fb9b0e92'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:37.320827 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-b37b3d9f-3c8b-4c7d-87f6-6308fb9b0e92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfef7a00b3b04fdd8032ca2ccc1ab420', 'request_id': 'req-b37b3d9f-3c8b-4c7d-87f6-6308fb9b0e92'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:37.336844 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-b37b3d9f-3c8b-4c7d-87f6-6308fb9b0e92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfef7a00b3b04fdd8032ca2ccc1ab420', 'request_id': 'req-b37b3d9f-3c8b-4c7d-87f6-6308fb9b0e92'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:37.364447 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b0ae05-ce78-44d1-a3c0-9ea450312ffd service neutron] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:37.365935 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-03b0ae05-ce78-44d1-a3c0-9ea450312ffd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:37.380436 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-b37b3d9f-3c8b-4c7d-87f6-6308fb9b0e92 admin admin] The token cache is being invalidate because project bfef7a00b3b04fdd8032ca2ccc1ab420 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 14:58:37.380746 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-b37b3d9f-3c8b-4c7d-87f6-6308fb9b0e92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:37.381514 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-b37b3d9f-3c8b-4c7d-87f6-6308fb9b0e92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:37.383396 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1166/2320] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Sep 19 14:58:37 2022] DELETE /identity/v3/projects/bfef7a00b3b04fdd8032ca2ccc1ab420 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:58:37.387509 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37b3d9f-3c8b-4c7d-87f6-6308fb9b0e92 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:37.394712 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-b37b3d9f-3c8b-4c7d-87f6-6308fb9b0e92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:37.399567 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b0ae05-ce78-44d1-a3c0-9ea450312ffd service neutron] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:37.495600 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37b3d9f-3c8b-4c7d-87f6-6308fb9b0e92 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:37.502951 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd10165-e8d3-4912-9220-95a1583dba3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:37.503967 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd10165-e8d3-4912-9220-95a1583dba3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:37.504525 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd10165-e8d3-4912-9220-95a1583dba3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:37.504910 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd10165-e8d3-4912-9220-95a1583dba3b admin admin] PATH_INFO: `/v3/users/46b7e68b2ab3433bbd8bd6435f91f91e` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:37.506298 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd10165-e8d3-4912-9220-95a1583dba3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=46b7e68b2ab3433bbd8bd6435f91f91e)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:37.508523 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd10165-e8d3-4912-9220-95a1583dba3b admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:37.516952 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:37.521099 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:37.576095 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52c8d31-26e0-4c1e-9333-b97c128b4d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:37.577447 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52c8d31-26e0-4c1e-9333-b97c128b4d99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:37.577754 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52c8d31-26e0-4c1e-9333-b97c128b4d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:37.578070 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52c8d31-26e0-4c1e-9333-b97c128b4d99 admin admin] PATH_INFO: `/v3/users/11405aa07bb04e7fafc092787d5b4e9a` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:37.580104 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52c8d31-26e0-4c1e-9333-b97c128b4d99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11405aa07bb04e7fafc092787d5b4e9a)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:37.583449 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52c8d31-26e0-4c1e-9333-b97c128b4d99 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:37.632674 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-cbd10165-e8d3-4912-9220-95a1583dba3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46b7e68b2ab3433bbd8bd6435f91f91e'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:37.648174 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-c52c8d31-26e0-4c1e-9333-b97c128b4d99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11405aa07bb04e7fafc092787d5b4e9a'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:37.668496 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-c52c8d31-26e0-4c1e-9333-b97c128b4d99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11405aa07bb04e7fafc092787d5b4e9a'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:37.675394 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-cbd10165-e8d3-4912-9220-95a1583dba3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46b7e68b2ab3433bbd8bd6435f91f91e'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:37.677632 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-c52c8d31-26e0-4c1e-9333-b97c128b4d99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11405aa07bb04e7fafc092787d5b4e9a'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:37.678955 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-c52c8d31-26e0-4c1e-9333-b97c128b4d99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11405aa07bb04e7fafc092787d5b4e9a'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:37.693166 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-c52c8d31-26e0-4c1e-9333-b97c128b4d99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11405aa07bb04e7fafc092787d5b4e9a'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:37.701958 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-cbd10165-e8d3-4912-9220-95a1583dba3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46b7e68b2ab3433bbd8bd6435f91f91e'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:37.716515 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1155/2321] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Sep 19 14:58:37 2022] DELETE /identity/v3/users/11405aa07bb04e7fafc092787d5b4e9a => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:58:37.717619 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-cbd10165-e8d3-4912-9220-95a1583dba3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46b7e68b2ab3433bbd8bd6435f91f91e'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:37.719364 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-cbd10165-e8d3-4912-9220-95a1583dba3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46b7e68b2ab3433bbd8bd6435f91f91e'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:37.719647 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a8e96-89f6-42ee-bf8c-641b289d0184 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:37.719967 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a8e96-89f6-42ee-bf8c-641b289d0184 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:37.720252 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a8e96-89f6-42ee-bf8c-641b289d0184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:37.728721 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1167/2322] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Sep 19 14:58:37 2022] DELETE /identity/v3/users/46b7e68b2ab3433bbd8bd6435f91f91e => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:58:37.795979 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-2f4a8e96-89f6-42ee-bf8c-641b289d0184 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:58:37.805067 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-2f4a8e96-89f6-42ee-bf8c-641b289d0184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:37.954555 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1156/2323] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:58:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 14:58:37.998636 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd10165-e8d3-4912-9220-95a1583dba3b admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:38.008459 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-cbd10165-e8d3-4912-9220-95a1583dba3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:38.122404 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd10165-e8d3-4912-9220-95a1583dba3b admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:38.131445 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005fb9b3-f463-46a8-9efc-be1a5da5f7f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c2b78646374cb79ded4b7b59ba49c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:38.132083 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005fb9b3-f463-46a8-9efc-be1a5da5f7f9 service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:38.132518 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005fb9b3-f463-46a8-9efc-be1a5da5f7f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:38.132801 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005fb9b3-f463-46a8-9efc-be1a5da5f7f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:38.147407 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005fb9b3-f463-46a8-9efc-be1a5da5f7f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:38.150698 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005fb9b3-f463-46a8-9efc-be1a5da5f7f9 service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:38.171750 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1168/2324] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:58:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:58:38.938617 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4a8e96-89f6-42ee-bf8c-641b289d0184 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:38.941487 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-2f4a8e96-89f6-42ee-bf8c-641b289d0184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:38.962212 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4a8e96-89f6-42ee-bf8c-641b289d0184 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:38.973009 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dbf82e-d598-4f2a-b401-bdfba0231d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:38.974162 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dbf82e-d598-4f2a-b401-bdfba0231d51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:38.974871 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dbf82e-d598-4f2a-b401-bdfba0231d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:38.975514 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dbf82e-d598-4f2a-b401-bdfba0231d51 admin admin] PATH_INFO: `/v3/projects/23112d7a7c80480685ef03b90c6709d1` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:38.977583 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dbf82e-d598-4f2a-b401-bdfba0231d51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23112d7a7c80480685ef03b90c6709d1)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:38.989307 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dbf82e-d598-4f2a-b401-bdfba0231d51 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:39.075197 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005fb9b3-f463-46a8-9efc-be1a5da5f7f9 service neutron] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:39.078368 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-005fb9b3-f463-46a8-9efc-be1a5da5f7f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:39.103058 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-77dbf82e-d598-4f2a-b401-bdfba0231d51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23112d7a7c80480685ef03b90c6709d1', 'request_id': 'req-77dbf82e-d598-4f2a-b401-bdfba0231d51'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:39.104211 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005fb9b3-f463-46a8-9efc-be1a5da5f7f9 service neutron] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:39.113894 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:39.117121 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-77dbf82e-d598-4f2a-b401-bdfba0231d51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23112d7a7c80480685ef03b90c6709d1', 'request_id': 'req-77dbf82e-d598-4f2a-b401-bdfba0231d51'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:39.148076 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-77dbf82e-d598-4f2a-b401-bdfba0231d51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23112d7a7c80480685ef03b90c6709d1', 'request_id': 'req-77dbf82e-d598-4f2a-b401-bdfba0231d51'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:39.189546 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-77dbf82e-d598-4f2a-b401-bdfba0231d51 admin admin] The token cache is being invalidate because project 23112d7a7c80480685ef03b90c6709d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 14:58:39.192202 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-77dbf82e-d598-4f2a-b401-bdfba0231d51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:39.198772 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-77dbf82e-d598-4f2a-b401-bdfba0231d51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:39.204058 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1157/2325] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Sep 19 14:58:38 2022] DELETE /identity/v3/projects/23112d7a7c80480685ef03b90c6709d1 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:58:39.211989 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40cd1a3-3d61-4c20-b746-f5e7859a1807 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:39.212540 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40cd1a3-3d61-4c20-b746-f5e7859a1807 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:39.213068 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40cd1a3-3d61-4c20-b746-f5e7859a1807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:39.258215 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-a40cd1a3-3d61-4c20-b746-f5e7859a1807 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:58:39.260318 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-a40cd1a3-3d61-4c20-b746-f5e7859a1807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:39.268565 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282dfd6d-7435-4bb9-bceb-e3f50a8309b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:39.269831 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282dfd6d-7435-4bb9-bceb-e3f50a8309b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:39.272368 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282dfd6d-7435-4bb9-bceb-e3f50a8309b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:39.272871 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282dfd6d-7435-4bb9-bceb-e3f50a8309b6 admin admin] PATH_INFO: `/v3/projects/98a3e2f149f041cc88cd623212bd088c` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:39.275181 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282dfd6d-7435-4bb9-bceb-e3f50a8309b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98a3e2f149f041cc88cd623212bd088c)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:39.276751 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1158/2326] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:58:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:58:39.279320 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282dfd6d-7435-4bb9-bceb-e3f50a8309b6 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:39.290581 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0390c0-5ec6-4c7a-a9e4-e844d1a74670 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:39.291417 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0390c0-5ec6-4c7a-a9e4-e844d1a74670 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:39.292484 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0390c0-5ec6-4c7a-a9e4-e844d1a74670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:39.348158 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-db0390c0-5ec6-4c7a-a9e4-e844d1a74670 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:58:39.356000 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-db0390c0-5ec6-4c7a-a9e4-e844d1a74670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:39.358549 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:39.387898 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-282dfd6d-7435-4bb9-bceb-e3f50a8309b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98a3e2f149f041cc88cd623212bd088c', 'request_id': 'req-282dfd6d-7435-4bb9-bceb-e3f50a8309b6'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:39.401690 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-282dfd6d-7435-4bb9-bceb-e3f50a8309b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98a3e2f149f041cc88cd623212bd088c', 'request_id': 'req-282dfd6d-7435-4bb9-bceb-e3f50a8309b6'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:39.418598 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-282dfd6d-7435-4bb9-bceb-e3f50a8309b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98a3e2f149f041cc88cd623212bd088c', 'request_id': 'req-282dfd6d-7435-4bb9-bceb-e3f50a8309b6'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:39.451046 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-282dfd6d-7435-4bb9-bceb-e3f50a8309b6 admin admin] The token cache is being invalidate because project 98a3e2f149f041cc88cd623212bd088c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 14:58:39.451373 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-282dfd6d-7435-4bb9-bceb-e3f50a8309b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:39.452950 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-282dfd6d-7435-4bb9-bceb-e3f50a8309b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:39.461207 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1169/2327] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Sep 19 14:58:39 2022] DELETE /identity/v3/projects/98a3e2f149f041cc88cd623212bd088c => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 14:58:39.464697 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e239b-5fd5-4dc9-ae6b-67b268009497 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:39.465759 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e239b-5fd5-4dc9-ae6b-67b268009497 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:39.466508 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e239b-5fd5-4dc9-ae6b-67b268009497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:39.525620 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-8e0e239b-5fd5-4dc9-ae6b-67b268009497 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:58:39.530723 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-8e0e239b-5fd5-4dc9-ae6b-67b268009497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:39.537790 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1159/2328] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:58:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:58:39.548035 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0390c0-5ec6-4c7a-a9e4-e844d1a74670 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:39.575483 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1170/2329] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:58:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:58:39.590082 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac12886-f6b5-4e5e-9596-67e633d99354 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:39.592977 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac12886-f6b5-4e5e-9596-67e633d99354 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:39.593574 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac12886-f6b5-4e5e-9596-67e633d99354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:39.597766 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0390c0-5ec6-4c7a-a9e4-e844d1a74670 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:39.616793 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88953228-1341-4754-b4e5-6c4ba81e1bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:39.618697 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88953228-1341-4754-b4e5-6c4ba81e1bac admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:39.621371 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88953228-1341-4754-b4e5-6c4ba81e1bac admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:39.621801 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88953228-1341-4754-b4e5-6c4ba81e1bac admin admin] PATH_INFO: `/v3/domains` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:39.626827 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88953228-1341-4754-b4e5-6c4ba81e1bac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:58:39.627715 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88953228-1341-4754-b4e5-6c4ba81e1bac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:39.632969 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88953228-1341-4754-b4e5-6c4ba81e1bac admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:39.659932 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-0ac12886-f6b5-4e5e-9596-67e633d99354 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:58:39.662853 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-0ac12886-f6b5-4e5e-9596-67e633d99354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:39.676597 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1160/2330] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Sep 19 14:58:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:58:39.681163 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88953228-1341-4754-b4e5-6c4ba81e1bac admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:39.689213 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1171/2331] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:58:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:58:39.693891 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac12886-f6b5-4e5e-9596-67e633d99354 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:39.709237 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88953228-1341-4754-b4e5-6c4ba81e1bac admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:39.722859 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac12886-f6b5-4e5e-9596-67e633d99354 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:39.729611 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fb25af-a984-4ddf-831c-1c1ed20c2d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:39.730354 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fb25af-a984-4ddf-831c-1c1ed20c2d8d admin admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:39.730733 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fb25af-a984-4ddf-831c-1c1ed20c2d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:39.731123 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fb25af-a984-4ddf-831c-1c1ed20c2d8d admin admin] PATH_INFO: `/v3/projects` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:39.733925 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fb25af-a984-4ddf-831c-1c1ed20c2d8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:39.739039 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1df66c-d629-4e42-8ee6-88aa71eaddb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:39.742065 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fb25af-a984-4ddf-831c-1c1ed20c2d8d admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:39.742871 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1df66c-d629-4e42-8ee6-88aa71eaddb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:39.744710 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1df66c-d629-4e42-8ee6-88aa71eaddb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:39.745104 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1df66c-d629-4e42-8ee6-88aa71eaddb1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:39.745893 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1df66c-d629-4e42-8ee6-88aa71eaddb1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:58:39.747606 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1df66c-d629-4e42-8ee6-88aa71eaddb1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:39.750266 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1df66c-d629-4e42-8ee6-88aa71eaddb1 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:39.780432 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1172/2332] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Sep 19 14:58:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:58:39.782285 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1df66c-d629-4e42-8ee6-88aa71eaddb1 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:39.807949 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1161/2333] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Sep 19 14:58:39 2022] POST /identity/v3/projects => generated 385 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:58:39.809136 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fb25af-a984-4ddf-831c-1c1ed20c2d8d admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:39.813521 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1df66c-d629-4e42-8ee6-88aa71eaddb1 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:39.953632 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d47956a-95f2-483d-b735-a952e3886d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:39.954955 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d47956a-95f2-483d-b735-a952e3886d92 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:39.955399 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d47956a-95f2-483d-b735-a952e3886d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:39.955824 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d47956a-95f2-483d-b735-a952e3886d92 admin admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:39.956662 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d47956a-95f2-483d-b735-a952e3886d92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:39.961262 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d47956a-95f2-483d-b735-a952e3886d92 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:39.979247 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fb25af-a984-4ddf-831c-1c1ed20c2d8d admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:39.992793 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfc376a-d1c8-4338-af42-1d9797bc1728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:39.993426 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc376a-d1c8-4338-af42-1d9797bc1728 admin admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:39.993706 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc376a-d1c8-4338-af42-1d9797bc1728 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:39.995272 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc376a-d1c8-4338-af42-1d9797bc1728 admin admin] PATH_INFO: `/v3/users` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:39.996149 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfc376a-d1c8-4338-af42-1d9797bc1728 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:40.004832 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfc376a-d1c8-4338-af42-1d9797bc1728 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:40.013024 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1173/2334] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Sep 19 14:58:39 2022] POST /identity/v3/projects => generated 385 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:58:40.018510 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d47956a-95f2-483d-b735-a952e3886d92 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:40.091647 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1162/2335] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Sep 19 14:58:39 2022] POST /identity/v3/users => generated 293 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:58:40.093691 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfc376a-d1c8-4338-af42-1d9797bc1728 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:40.110526 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfc376a-d1c8-4338-af42-1d9797bc1728 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:40.111524 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d47956a-95f2-483d-b735-a952e3886d92 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:40.116625 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf331b37-63af-4dc7-90ae-98bbc0b167e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:40.116904 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47316dc6-8fb5-446e-842a-22a0ee69faf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:40.117295 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf331b37-63af-4dc7-90ae-98bbc0b167e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:40.117578 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf331b37-63af-4dc7-90ae-98bbc0b167e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:40.117699 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47316dc6-8fb5-446e-842a-22a0ee69faf9 admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:40.117945 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47316dc6-8fb5-446e-842a-22a0ee69faf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:40.118049 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf331b37-63af-4dc7-90ae-98bbc0b167e8 admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:40.118218 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47316dc6-8fb5-446e-842a-22a0ee69faf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:40.118745 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf331b37-63af-4dc7-90ae-98bbc0b167e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:40.118867 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47316dc6-8fb5-446e-842a-22a0ee69faf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:40.120626 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47316dc6-8fb5-446e-842a-22a0ee69faf9 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:40.120818 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf331b37-63af-4dc7-90ae-98bbc0b167e8 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:40.139513 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1163/2336] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:58:40 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:58:40.141510 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47316dc6-8fb5-446e-842a-22a0ee69faf9 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:40.156460 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1174/2337] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Sep 19 14:58:40 2022] POST /identity/v3/users => generated 293 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:58:40.160739 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf331b37-63af-4dc7-90ae-98bbc0b167e8 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:40.163402 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47316dc6-8fb5-446e-842a-22a0ee69faf9 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:40.169473 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:40.174098 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136ca73a-d4d2-4b07-a214-45210a26b865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:40.174804 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136ca73a-d4d2-4b07-a214-45210a26b865 admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:40.175311 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136ca73a-d4d2-4b07-a214-45210a26b865 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:40.175545 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf331b37-63af-4dc7-90ae-98bbc0b167e8 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:40.176223 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136ca73a-d4d2-4b07-a214-45210a26b865 admin admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:40.178077 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136ca73a-d4d2-4b07-a214-45210a26b865 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:40.180643 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136ca73a-d4d2-4b07-a214-45210a26b865 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:40.184216 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9430f6a1-1ead-4bf7-a7a8-677de30ab666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:40.185356 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9430f6a1-1ead-4bf7-a7a8-677de30ab666 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:40.185919 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9430f6a1-1ead-4bf7-a7a8-677de30ab666 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:40.186337 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9430f6a1-1ead-4bf7-a7a8-677de30ab666 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:40.187623 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9430f6a1-1ead-4bf7-a7a8-677de30ab666 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:40.190138 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9430f6a1-1ead-4bf7-a7a8-677de30ab666 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:40.201667 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1164/2338] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:58:40 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:58:40.205583 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1175/2339] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:58:40 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:58:40.208263 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136ca73a-d4d2-4b07-a214-45210a26b865 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:40.209307 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9430f6a1-1ead-4bf7-a7a8-677de30ab666 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:40.223582 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136ca73a-d4d2-4b07-a214-45210a26b865 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:40.224211 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9430f6a1-1ead-4bf7-a7a8-677de30ab666 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:40.230568 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c78d4e8-cfde-4be5-94dc-6c2bc1344f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:40.230897 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d593af1b-0a8a-4806-8ade-020f0d4ba92c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:40.231462 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c78d4e8-cfde-4be5-94dc-6c2bc1344f65 admin admin] REQUEST_METHOD: `PUT` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:40.231653 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d593af1b-0a8a-4806-8ade-020f0d4ba92c admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:40.231920 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c78d4e8-cfde-4be5-94dc-6c2bc1344f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:40.232052 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d593af1b-0a8a-4806-8ade-020f0d4ba92c admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:40.232197 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d593af1b-0a8a-4806-8ade-020f0d4ba92c admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:40.233041 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d593af1b-0a8a-4806-8ade-020f0d4ba92c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:40.233161 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c78d4e8-cfde-4be5-94dc-6c2bc1344f65 admin admin] PATH_INFO: `/v3/projects/e6bd8fe3bd294e6bac9fc3ceb6cb459a/users/b419942f414447c883ec133c7bcb0a3a/roles/efa0e5b3413748dc828a89b12d67df79` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:40.238088 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:40.246943 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d593af1b-0a8a-4806-8ade-020f0d4ba92c admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:40.262411 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1176/2340] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:58:40 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:58:40.266153 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c78d4e8-cfde-4be5-94dc-6c2bc1344f65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6bd8fe3bd294e6bac9fc3ceb6cb459a, user_id=b419942f414447c883ec133c7bcb0a3a, role_id=efa0e5b3413748dc828a89b12d67df79)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:40.268875 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c78d4e8-cfde-4be5-94dc-6c2bc1344f65 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:40.277220 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d593af1b-0a8a-4806-8ade-020f0d4ba92c admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:40.294583 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1165/2341] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 14:58:40 2022] PUT /identity/v3/projects/e6bd8fe3bd294e6bac9fc3ceb6cb459a/users/b419942f414447c883ec133c7bcb0a3a/roles/efa0e5b3413748dc828a89b12d67df79 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:58:40.296579 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d593af1b-0a8a-4806-8ade-020f0d4ba92c admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:40.297434 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be50e5-156b-4129-8698-9f7790ea8e2b None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:40.298343 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be50e5-156b-4129-8698-9f7790ea8e2b None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:40.298343 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be50e5-156b-4129-8698-9f7790ea8e2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:40.328753 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-57be50e5-156b-4129-8698-9f7790ea8e2b None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:58:40.331032 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-57be50e5-156b-4129-8698-9f7790ea8e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:40.431075 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba7e5d6-bfcb-4950-92fd-62fb9700b6cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:40.432153 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba7e5d6-bfcb-4950-92fd-62fb9700b6cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:40.432153 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba7e5d6-bfcb-4950-92fd-62fb9700b6cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:40.432589 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba7e5d6-bfcb-4950-92fd-62fb9700b6cf admin admin] PATH_INFO: `/v3/projects/dcd087b3daca46efa3339558f8ebacd1/users/e94bf43d732c4684b40fcee7d20bf6cb/roles/efa0e5b3413748dc828a89b12d67df79` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:40.447580 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1166/2342] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:58:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:58:40.457070 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba7e5d6-bfcb-4950-92fd-62fb9700b6cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcd087b3daca46efa3339558f8ebacd1, user_id=e94bf43d732c4684b40fcee7d20bf6cb, role_id=efa0e5b3413748dc828a89b12d67df79)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:40.459833 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57be50e5-156b-4129-8698-9f7790ea8e2b None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:40.460026 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba7e5d6-bfcb-4950-92fd-62fb9700b6cf admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:40.469214 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-57be50e5-156b-4129-8698-9f7790ea8e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:40.477105 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1177/2343] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 14:58:40 2022] PUT /identity/v3/projects/dcd087b3daca46efa3339558f8ebacd1/users/e94bf43d732c4684b40fcee7d20bf6cb/roles/efa0e5b3413748dc828a89b12d67df79 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:58:40.497954 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7739403a-b998-404f-8d23-cc45f9048955 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:40.499022 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7739403a-b998-404f-8d23-cc45f9048955 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:40.502434 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7739403a-b998-404f-8d23-cc45f9048955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:40.570781 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-7739403a-b998-404f-8d23-cc45f9048955 None None] MFA Rules not processed for user `e94bf43d732c4684b40fcee7d20bf6cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:58:40.572182 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-7739403a-b998-404f-8d23-cc45f9048955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:40.583723 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57be50e5-156b-4129-8698-9f7790ea8e2b None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:40.668730 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1178/2344] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:58:40 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:58:40.705391 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed1258a-7a18-4678-87eb-c1b561f28644 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c2b78646374cb79ded4b7b59ba49c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:40.705683 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7739403a-b998-404f-8d23-cc45f9048955 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:40.707355 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-7739403a-b998-404f-8d23-cc45f9048955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:40.707477 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed1258a-7a18-4678-87eb-c1b561f28644 service neutron] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:40.707879 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed1258a-7a18-4678-87eb-c1b561f28644 service neutron] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:40.718688 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed1258a-7a18-4678-87eb-c1b561f28644 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:40.809131 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:40.818175 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7739403a-b998-404f-8d23-cc45f9048955 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:40.831677 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5471cf-64c5-42bb-a747-94b4180aadb4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139dc7a4f1dc48fe8faea848bd1ac0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:40.832321 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5471cf-64c5-42bb-a747-94b4180aadb4 service cinder] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:40.832608 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5471cf-64c5-42bb-a747-94b4180aadb4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:40.832882 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5471cf-64c5-42bb-a747-94b4180aadb4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:40.838500 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed1258a-7a18-4678-87eb-c1b561f28644 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:40.840608 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed1258a-7a18-4678-87eb-c1b561f28644 service neutron] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:40.852314 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5471cf-64c5-42bb-a747-94b4180aadb4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:40.853871 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5471cf-64c5-42bb-a747-94b4180aadb4 service cinder] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:40.858592 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:40.869735 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1179/2345] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:58:40 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 14:58:40.882711 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1167/2346] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:58:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:58:44.632873 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb459a6-7065-4be0-9095-17e4747531a9 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:44.633365 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb459a6-7065-4be0-9095-17e4747531a9 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:44.633489 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb459a6-7065-4be0-9095-17e4747531a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:44.699634 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-feb459a6-7065-4be0-9095-17e4747531a9 None None] MFA Rules not processed for user `e1c795967682473da65e9d2bb78a5ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:58:44.702377 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-feb459a6-7065-4be0-9095-17e4747531a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:44.867488 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1180/2347] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:58:44 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:58:45.174901 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed1258a-7a18-4678-87eb-c1b561f28644 service neutron] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:45.176735 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-3ed1258a-7a18-4678-87eb-c1b561f28644 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:45.365663 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed1258a-7a18-4678-87eb-c1b561f28644 service neutron] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:45.376577 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815ff8f8-636e-4c6a-a8c8-8f78aad80e28 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055439dc35e946f4a82535c684f9b60d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:45.377662 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815ff8f8-636e-4c6a-a8c8-8f78aad80e28 service nova] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:45.377946 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815ff8f8-636e-4c6a-a8c8-8f78aad80e28 service nova] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:45.378281 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815ff8f8-636e-4c6a-a8c8-8f78aad80e28 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:45.380734 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-815ff8f8-636e-4c6a-a8c8-8f78aad80e28 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:45.459423 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815ff8f8-636e-4c6a-a8c8-8f78aad80e28 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:45.461088 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815ff8f8-636e-4c6a-a8c8-8f78aad80e28 service nova] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:45.489502 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1168/2348] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:58:45 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:58:47.708574 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb459a6-7065-4be0-9095-17e4747531a9 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:47.740756 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb459a6-7065-4be0-9095-17e4747531a9 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:47.769048 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d28fc9-d5ea-4f4e-9965-3ee117715e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:47.769919 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d28fc9-d5ea-4f4e-9965-3ee117715e0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:47.770354 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d28fc9-d5ea-4f4e-9965-3ee117715e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:47.770880 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d28fc9-d5ea-4f4e-9965-3ee117715e0a admin admin] PATH_INFO: `/v3/users/e94bf43d732c4684b40fcee7d20bf6cb` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:47.777482 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d28fc9-d5ea-4f4e-9965-3ee117715e0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e94bf43d732c4684b40fcee7d20bf6cb)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:47.780659 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d28fc9-d5ea-4f4e-9965-3ee117715e0a admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:47.923042 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-06d28fc9-d5ea-4f4e-9965-3ee117715e0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e94bf43d732c4684b40fcee7d20bf6cb'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:47.939825 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-06d28fc9-d5ea-4f4e-9965-3ee117715e0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e94bf43d732c4684b40fcee7d20bf6cb'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:47.950372 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-06d28fc9-d5ea-4f4e-9965-3ee117715e0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e94bf43d732c4684b40fcee7d20bf6cb'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:47.965950 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-06d28fc9-d5ea-4f4e-9965-3ee117715e0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e94bf43d732c4684b40fcee7d20bf6cb'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:47.967731 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-06d28fc9-d5ea-4f4e-9965-3ee117715e0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e94bf43d732c4684b40fcee7d20bf6cb'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:48.001140 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1181/2349] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Sep 19 14:58:47 2022] DELETE /identity/v3/users/e94bf43d732c4684b40fcee7d20bf6cb => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:58:48.005519 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb841ec-c3a1-4703-b0f7-1bc288574e3d None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:48.006051 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb841ec-c3a1-4703-b0f7-1bc288574e3d None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:48.006051 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb841ec-c3a1-4703-b0f7-1bc288574e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:48.066422 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-6bb841ec-c3a1-4703-b0f7-1bc288574e3d None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:58:48.075754 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-6bb841ec-c3a1-4703-b0f7-1bc288574e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:48.271828 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1169/2350] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:58:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:58:48.378566 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d28fc9-d5ea-4f4e-9965-3ee117715e0a admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:48.380296 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-06d28fc9-d5ea-4f4e-9965-3ee117715e0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:48.506362 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d28fc9-d5ea-4f4e-9965-3ee117715e0a admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:48.511788 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e0a4f9-075c-4497-ba9d-4cc13058589a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c2b78646374cb79ded4b7b59ba49c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:48.515702 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e0a4f9-075c-4497-ba9d-4cc13058589a service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:48.516241 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e0a4f9-075c-4497-ba9d-4cc13058589a service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:48.516746 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e0a4f9-075c-4497-ba9d-4cc13058589a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:48.529497 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e0a4f9-075c-4497-ba9d-4cc13058589a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:48.541836 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e0a4f9-075c-4497-ba9d-4cc13058589a service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:48.556649 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:48.574172 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1182/2351] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:58:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 14:58:48.875828 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71aa31a-eeee-4e07-9ff2-e48d6b184fa6 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:48.876790 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71aa31a-eeee-4e07-9ff2-e48d6b184fa6 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:48.878324 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71aa31a-eeee-4e07-9ff2-e48d6b184fa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:48.924493 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-f71aa31a-eeee-4e07-9ff2-e48d6b184fa6 None None] MFA Rules not processed for user `c46d1b8b7dc74f82a1911f8edcd6271a`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:58:48.937053 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-f71aa31a-eeee-4e07-9ff2-e48d6b184fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:48.979534 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:49.038498 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1170/2352] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:58:48 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:58:49.600434 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e0a4f9-075c-4497-ba9d-4cc13058589a service neutron] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:49.602602 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-57e0a4f9-075c-4497-ba9d-4cc13058589a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:49.642965 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e0a4f9-075c-4497-ba9d-4cc13058589a service neutron] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:49.660653 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3361fa44-fb71-4a44-ab32-61abfe10e26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:49.663422 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3361fa44-fb71-4a44-ab32-61abfe10e26c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:49.666572 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3361fa44-fb71-4a44-ab32-61abfe10e26c admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:49.674549 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3361fa44-fb71-4a44-ab32-61abfe10e26c admin admin] PATH_INFO: `/v3/projects/dcd087b3daca46efa3339558f8ebacd1` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:49.682812 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3361fa44-fb71-4a44-ab32-61abfe10e26c admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcd087b3daca46efa3339558f8ebacd1)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:49.695774 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3361fa44-fb71-4a44-ab32-61abfe10e26c admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:49.799526 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-3361fa44-fb71-4a44-ab32-61abfe10e26c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcd087b3daca46efa3339558f8ebacd1', 'request_id': 'req-3361fa44-fb71-4a44-ab32-61abfe10e26c'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:49.813159 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-3361fa44-fb71-4a44-ab32-61abfe10e26c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcd087b3daca46efa3339558f8ebacd1', 'request_id': 'req-3361fa44-fb71-4a44-ab32-61abfe10e26c'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:49.830570 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-3361fa44-fb71-4a44-ab32-61abfe10e26c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcd087b3daca46efa3339558f8ebacd1', 'request_id': 'req-3361fa44-fb71-4a44-ab32-61abfe10e26c'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:49.855069 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-3361fa44-fb71-4a44-ab32-61abfe10e26c admin admin] The token cache is being invalidate because project dcd087b3daca46efa3339558f8ebacd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 14:58:49.855442 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-3361fa44-fb71-4a44-ab32-61abfe10e26c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:49.856905 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-3361fa44-fb71-4a44-ab32-61abfe10e26c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:49.887242 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1183/2353] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Sep 19 14:58:49 2022] DELETE /identity/v3/projects/dcd087b3daca46efa3339558f8ebacd1 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:58:49.892746 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c41b64-b72f-4c0d-ad93-bb8ef9ea01de None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:49.893102 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c41b64-b72f-4c0d-ad93-bb8ef9ea01de None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:49.893368 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c41b64-b72f-4c0d-ad93-bb8ef9ea01de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:49.981146 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-d0c41b64-b72f-4c0d-ad93-bb8ef9ea01de None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:58:49.997218 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-d0c41b64-b72f-4c0d-ad93-bb8ef9ea01de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:50.167064 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c790266-06b0-4d93-9549-846f18130ea6 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:50.167388 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c790266-06b0-4d93-9549-846f18130ea6 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:50.168381 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c790266-06b0-4d93-9549-846f18130ea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:50.172520 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1171/2354] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:58:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:58:50.217985 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-6c790266-06b0-4d93-9549-846f18130ea6 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:58:50.219234 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-6c790266-06b0-4d93-9549-846f18130ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:50.244514 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1184/2355] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:58:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 14:58:50.249116 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c41b64-b72f-4c0d-ad93-bb8ef9ea01de None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:50.263544 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c41b64-b72f-4c0d-ad93-bb8ef9ea01de None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:50.276557 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff54c36-ae74-4efe-ba21-c9119d10a492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:50.277792 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff54c36-ae74-4efe-ba21-c9119d10a492 admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:50.278303 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff54c36-ae74-4efe-ba21-c9119d10a492 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:50.279671 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff54c36-ae74-4efe-ba21-c9119d10a492 admin admin] PATH_INFO: `/v3/domains` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:50.281469 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff54c36-ae74-4efe-ba21-c9119d10a492 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:58:50.282880 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff54c36-ae74-4efe-ba21-c9119d10a492 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:50.285388 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff54c36-ae74-4efe-ba21-c9119d10a492 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:50.308752 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1172/2356] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Sep 19 14:58:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:58:50.316721 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c790266-06b0-4d93-9549-846f18130ea6 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:50.346239 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c790266-06b0-4d93-9549-846f18130ea6 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:50.356881 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e643ef-a982-4844-a17b-8589bc18365f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:50.357667 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e643ef-a982-4844-a17b-8589bc18365f admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:50.357964 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e643ef-a982-4844-a17b-8589bc18365f admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:50.358242 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e643ef-a982-4844-a17b-8589bc18365f admin admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:50.359416 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e643ef-a982-4844-a17b-8589bc18365f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:50.363739 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e643ef-a982-4844-a17b-8589bc18365f admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:50.381050 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a34e10-53ce-430c-bd23-013bb3838116 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:50.381479 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a34e10-53ce-430c-bd23-013bb3838116 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:50.381857 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a34e10-53ce-430c-bd23-013bb3838116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:50.442851 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1185/2357] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Sep 19 14:58:50 2022] POST /identity/v3/projects => generated 373 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:58:50.452403 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e643ef-a982-4844-a17b-8589bc18365f admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:50.471303 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-94a34e10-53ce-430c-bd23-013bb3838116 None None] MFA Rules not processed for user `b419942f414447c883ec133c7bcb0a3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:58:50.474444 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-94a34e10-53ce-430c-bd23-013bb3838116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:50.595687 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e643ef-a982-4844-a17b-8589bc18365f admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:50.603725 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1173/2358] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:58:50 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:58:50.608209 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c875111-99af-469f-8da9-47afa0733e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:50.609017 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c875111-99af-469f-8da9-47afa0733e80 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:50.609414 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c875111-99af-469f-8da9-47afa0733e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:50.609576 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a34e10-53ce-430c-bd23-013bb3838116 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:50.610350 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c875111-99af-469f-8da9-47afa0733e80 admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:50.611158 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-94a34e10-53ce-430c-bd23-013bb3838116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:50.611490 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c875111-99af-469f-8da9-47afa0733e80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:50.614488 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c875111-99af-469f-8da9-47afa0733e80 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:50.640653 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a34e10-53ce-430c-bd23-013bb3838116 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:50.647333 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1333632e-00b6-43d2-9bec-84dacb5356b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:50.648652 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1333632e-00b6-43d2-9bec-84dacb5356b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:50.649159 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1333632e-00b6-43d2-9bec-84dacb5356b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:50.649813 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1333632e-00b6-43d2-9bec-84dacb5356b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:50.650827 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1333632e-00b6-43d2-9bec-84dacb5356b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:50.653013 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1333632e-00b6-43d2-9bec-84dacb5356b5 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:50.665123 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1186/2359] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Sep 19 14:58:50 2022] POST /identity/v3/users => generated 287 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:58:50.669167 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c875111-99af-469f-8da9-47afa0733e80 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:50.685646 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c875111-99af-469f-8da9-47afa0733e80 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:50.692662 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1174/2360] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Sep 19 14:58:50 2022] POST /identity/v3/projects => generated 383 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:58:50.696731 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1333632e-00b6-43d2-9bec-84dacb5356b5 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:50.735576 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:50.772498 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:50.793943 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1333632e-00b6-43d2-9bec-84dacb5356b5 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:50.796773 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42adb1a-e1ac-44ae-9fd6-f87eef997bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:50.797440 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42adb1a-e1ac-44ae-9fd6-f87eef997bf1 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:50.797673 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42adb1a-e1ac-44ae-9fd6-f87eef997bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:50.798122 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42adb1a-e1ac-44ae-9fd6-f87eef997bf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:50.798906 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42adb1a-e1ac-44ae-9fd6-f87eef997bf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:50.799758 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167b9b1f-d61a-4bc9-b376-839f35460b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:50.800406 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167b9b1f-d61a-4bc9-b376-839f35460b32 admin admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:50.800971 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167b9b1f-d61a-4bc9-b376-839f35460b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:50.801259 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167b9b1f-d61a-4bc9-b376-839f35460b32 admin admin] PATH_INFO: `/v3/users` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:50.801370 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42adb1a-e1ac-44ae-9fd6-f87eef997bf1 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:50.801898 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167b9b1f-d61a-4bc9-b376-839f35460b32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:50.803817 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167b9b1f-d61a-4bc9-b376-839f35460b32 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:50.813498 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1187/2361] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:58:50 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:58:50.817391 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42adb1a-e1ac-44ae-9fd6-f87eef997bf1 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:50.830151 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42adb1a-e1ac-44ae-9fd6-f87eef997bf1 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:50.855094 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a459197-a8c1-49db-b1d6-0369ddb272e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:50.855724 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a459197-a8c1-49db-b1d6-0369ddb272e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:50.856483 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a459197-a8c1-49db-b1d6-0369ddb272e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:50.857041 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a459197-a8c1-49db-b1d6-0369ddb272e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:50.858282 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a459197-a8c1-49db-b1d6-0369ddb272e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:50.860355 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a459197-a8c1-49db-b1d6-0369ddb272e0 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:50.878076 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1188/2362] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:58:50 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 14:58:50.883877 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a459197-a8c1-49db-b1d6-0369ddb272e0 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:50.884600 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1175/2363] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Sep 19 14:58:50 2022] POST /identity/v3/users => generated 298 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:58:50.887856 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167b9b1f-d61a-4bc9-b376-839f35460b32 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:50.922293 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a459197-a8c1-49db-b1d6-0369ddb272e0 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:50.927733 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0059110f-4a48-42bc-9fa7-b6f9870b385f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:50.928479 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0059110f-4a48-42bc-9fa7-b6f9870b385f admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:50.928761 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0059110f-4a48-42bc-9fa7-b6f9870b385f admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:50.929037 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0059110f-4a48-42bc-9fa7-b6f9870b385f admin admin] PATH_INFO: `/v3/projects/7d821d3321644a1c8be76353c8dbbe8e/users/14b97589bac745db8a9262e88d9b9129/roles/efa0e5b3413748dc828a89b12d67df79` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:50.938444 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167b9b1f-d61a-4bc9-b376-839f35460b32 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:50.951244 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8568ffe8-c4ec-44ed-8132-98f35f6176db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:50.952013 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8568ffe8-c4ec-44ed-8132-98f35f6176db admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:50.952469 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8568ffe8-c4ec-44ed-8132-98f35f6176db admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:50.952760 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8568ffe8-c4ec-44ed-8132-98f35f6176db admin admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:50.953450 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8568ffe8-c4ec-44ed-8132-98f35f6176db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:50.960453 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8568ffe8-c4ec-44ed-8132-98f35f6176db admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:50.971620 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1176/2364] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:58:50 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:58:50.976617 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0059110f-4a48-42bc-9fa7-b6f9870b385f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d821d3321644a1c8be76353c8dbbe8e, user_id=14b97589bac745db8a9262e88d9b9129, role_id=efa0e5b3413748dc828a89b12d67df79)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:50.980488 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8568ffe8-c4ec-44ed-8132-98f35f6176db admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:50.980923 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0059110f-4a48-42bc-9fa7-b6f9870b385f admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:50.995295 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8568ffe8-c4ec-44ed-8132-98f35f6176db admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:51.007454 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1189/2365] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 14:58:50 2022] PUT /identity/v3/projects/7d821d3321644a1c8be76353c8dbbe8e/users/14b97589bac745db8a9262e88d9b9129/roles/efa0e5b3413748dc828a89b12d67df79 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:58:51.018088 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be4fb50-04bb-454a-b5e9-61f5da3ad6d8 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:51.018442 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be4fb50-04bb-454a-b5e9-61f5da3ad6d8 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:51.018885 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be4fb50-04bb-454a-b5e9-61f5da3ad6d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:51.056794 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-3be4fb50-04bb-454a-b5e9-61f5da3ad6d8 None None] MFA Rules not processed for user `14b97589bac745db8a9262e88d9b9129`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:58:51.058082 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-3be4fb50-04bb-454a-b5e9-61f5da3ad6d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:51.086057 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf7707c-5d7a-4689-8a0e-c29954a75085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:51.087188 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf7707c-5d7a-4689-8a0e-c29954a75085 admin admin] REQUEST_METHOD: `PUT` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:51.087802 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf7707c-5d7a-4689-8a0e-c29954a75085 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:51.088700 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf7707c-5d7a-4689-8a0e-c29954a75085 admin admin] PATH_INFO: `/v3/projects/1073d723af00470f9a3daab671772bae/users/d44e7235b5c3464983a2d3cf053289e6/roles/ddb643577b2e4e478100ec370decfaeb` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:51.109765 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf7707c-5d7a-4689-8a0e-c29954a75085 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1073d723af00470f9a3daab671772bae, user_id=d44e7235b5c3464983a2d3cf053289e6, role_id=ddb643577b2e4e478100ec370decfaeb)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:51.113170 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf7707c-5d7a-4689-8a0e-c29954a75085 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:51.135909 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1177/2366] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 14:58:50 2022] PUT /identity/v3/projects/1073d723af00470f9a3daab671772bae/users/d44e7235b5c3464983a2d3cf053289e6/roles/ddb643577b2e4e478100ec370decfaeb => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:58:51.138064 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf7707c-5d7a-4689-8a0e-c29954a75085 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:51.172243 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1190/2367] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:58:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:58:51.187326 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be4fb50-04bb-454a-b5e9-61f5da3ad6d8 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:51.189926 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-3be4fb50-04bb-454a-b5e9-61f5da3ad6d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:51.234995 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf7707c-5d7a-4689-8a0e-c29954a75085 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:51.240220 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d8fb31-0579-4100-a3cc-0febe5e1da08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:51.240942 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d8fb31-0579-4100-a3cc-0febe5e1da08 admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:51.241264 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d8fb31-0579-4100-a3cc-0febe5e1da08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:51.241542 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d8fb31-0579-4100-a3cc-0febe5e1da08 admin admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:51.242363 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d8fb31-0579-4100-a3cc-0febe5e1da08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:51.243986 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d8fb31-0579-4100-a3cc-0febe5e1da08 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:51.256420 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1178/2368] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 14:58:51 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:58:51.259953 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d8fb31-0579-4100-a3cc-0febe5e1da08 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:51.267218 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be4fb50-04bb-454a-b5e9-61f5da3ad6d8 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:51.271488 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d8fb31-0579-4100-a3cc-0febe5e1da08 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:51.276856 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489b6a3c-5070-459e-9dfd-9b49dcf36f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:51.277534 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489b6a3c-5070-459e-9dfd-9b49dcf36f18 admin admin] REQUEST_METHOD: `PUT` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:51.277809 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489b6a3c-5070-459e-9dfd-9b49dcf36f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:51.278455 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489b6a3c-5070-459e-9dfd-9b49dcf36f18 admin admin] PATH_INFO: `/v3/projects/1073d723af00470f9a3daab671772bae/users/d44e7235b5c3464983a2d3cf053289e6/roles/ddb643577b2e4e478100ec370decfaeb` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:51.282110 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489b6a3c-5070-459e-9dfd-9b49dcf36f18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1073d723af00470f9a3daab671772bae, user_id=d44e7235b5c3464983a2d3cf053289e6, role_id=ddb643577b2e4e478100ec370decfaeb)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:51.285663 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489b6a3c-5070-459e-9dfd-9b49dcf36f18 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:51.301071 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1179/2369] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 14:58:51 2022] PUT /identity/v3/projects/1073d723af00470f9a3daab671772bae/users/d44e7235b5c3464983a2d3cf053289e6/roles/ddb643577b2e4e478100ec370decfaeb => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 14:58:51.337306 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:51.348055 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc4da0b-0b7e-4f70-8fec-657c6374783b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139dc7a4f1dc48fe8faea848bd1ac0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:51.349770 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc4da0b-0b7e-4f70-8fec-657c6374783b service cinder] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:51.350395 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc4da0b-0b7e-4f70-8fec-657c6374783b service cinder] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:51.351396 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc4da0b-0b7e-4f70-8fec-657c6374783b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:51.451744 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc4da0b-0b7e-4f70-8fec-657c6374783b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:51.453917 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc4da0b-0b7e-4f70-8fec-657c6374783b service cinder] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:51.468542 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1191/2370] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:58:51 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:58:53.221651 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e5a871-dee3-4939-bd72-4c81b58b1f33 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:53.222251 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e5a871-dee3-4939-bd72-4c81b58b1f33 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:53.222251 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e5a871-dee3-4939-bd72-4c81b58b1f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:53.257100 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-28e5a871-dee3-4939-bd72-4c81b58b1f33 None None] MFA Rules not processed for user `14b97589bac745db8a9262e88d9b9129`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:58:53.258966 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-28e5a871-dee3-4939-bd72-4c81b58b1f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:53.269481 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:53.414068 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc4da0b-0b7e-4f70-8fec-657c6374783b service cinder] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:53.416762 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-6cc4da0b-0b7e-4f70-8fec-657c6374783b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:53.434447 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc4da0b-0b7e-4f70-8fec-657c6374783b service cinder] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:53.444946 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1180/2371] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:58:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:58:53.527326 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b17cab7-7397-4168-bd0a-ffad5764e879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:53.529012 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b17cab7-7397-4168-bd0a-ffad5764e879 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:53.529717 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b17cab7-7397-4168-bd0a-ffad5764e879 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:53.530384 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b17cab7-7397-4168-bd0a-ffad5764e879 admin admin] PATH_INFO: `/v3/users/6db433cb08bb4a40b944eddf1b6defd8` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:53.532601 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b17cab7-7397-4168-bd0a-ffad5764e879 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6db433cb08bb4a40b944eddf1b6defd8)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:53.534969 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b17cab7-7397-4168-bd0a-ffad5764e879 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:53.679428 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-6b17cab7-7397-4168-bd0a-ffad5764e879 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6db433cb08bb4a40b944eddf1b6defd8'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:53.717617 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-6b17cab7-7397-4168-bd0a-ffad5764e879 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6db433cb08bb4a40b944eddf1b6defd8'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:53.736239 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-6b17cab7-7397-4168-bd0a-ffad5764e879 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6db433cb08bb4a40b944eddf1b6defd8'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:53.765972 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-6b17cab7-7397-4168-bd0a-ffad5764e879 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6db433cb08bb4a40b944eddf1b6defd8'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:53.766698 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-6b17cab7-7397-4168-bd0a-ffad5764e879 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6db433cb08bb4a40b944eddf1b6defd8'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:53.776186 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1192/2372] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Sep 19 14:58:53 2022] DELETE /identity/v3/users/6db433cb08bb4a40b944eddf1b6defd8 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:58:53.781067 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cddd89-d7e3-4779-85b2-907e5a2e9145 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:53.781273 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cddd89-d7e3-4779-85b2-907e5a2e9145 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:53.781498 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cddd89-d7e3-4779-85b2-907e5a2e9145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:53.822100 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-78cddd89-d7e3-4779-85b2-907e5a2e9145 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:58:53.832867 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-78cddd89-d7e3-4779-85b2-907e5a2e9145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:53.961908 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1181/2373] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:58:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 14:58:53.973934 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b17cab7-7397-4168-bd0a-ffad5764e879 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:53.980408 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-6b17cab7-7397-4168-bd0a-ffad5764e879 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:54.023945 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:54.082126 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b17cab7-7397-4168-bd0a-ffad5764e879 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:54.091095 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4134b1dd-b747-44bc-8d2c-7207e3d64585 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c2b78646374cb79ded4b7b59ba49c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:54.092846 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4134b1dd-b747-44bc-8d2c-7207e3d64585 service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:54.093517 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4134b1dd-b747-44bc-8d2c-7207e3d64585 service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:54.094177 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4134b1dd-b747-44bc-8d2c-7207e3d64585 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:54.113183 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4134b1dd-b747-44bc-8d2c-7207e3d64585 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:54.115257 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4134b1dd-b747-44bc-8d2c-7207e3d64585 service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:54.141934 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1193/2374] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:58:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:58:54.840656 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cddd89-d7e3-4779-85b2-907e5a2e9145 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:54.843830 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-78cddd89-d7e3-4779-85b2-907e5a2e9145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:54.867922 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cddd89-d7e3-4779-85b2-907e5a2e9145 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:54.879864 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0171a0cb-4c4e-4278-827d-9bfc071f9e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:54.883907 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0171a0cb-4c4e-4278-827d-9bfc071f9e73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:54.884570 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0171a0cb-4c4e-4278-827d-9bfc071f9e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:54.885328 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0171a0cb-4c4e-4278-827d-9bfc071f9e73 admin admin] PATH_INFO: `/v3/projects/be623ed394164492b7ba4ae1b56d1bcc` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:54.916558 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0171a0cb-4c4e-4278-827d-9bfc071f9e73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be623ed394164492b7ba4ae1b56d1bcc)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:54.919652 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0171a0cb-4c4e-4278-827d-9bfc071f9e73 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:55.021641 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-0171a0cb-4c4e-4278-827d-9bfc071f9e73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be623ed394164492b7ba4ae1b56d1bcc', 'request_id': 'req-0171a0cb-4c4e-4278-827d-9bfc071f9e73'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:55.037602 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-0171a0cb-4c4e-4278-827d-9bfc071f9e73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be623ed394164492b7ba4ae1b56d1bcc', 'request_id': 'req-0171a0cb-4c4e-4278-827d-9bfc071f9e73'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:55.049480 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-0171a0cb-4c4e-4278-827d-9bfc071f9e73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be623ed394164492b7ba4ae1b56d1bcc', 'request_id': 'req-0171a0cb-4c4e-4278-827d-9bfc071f9e73'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:55.071858 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-0171a0cb-4c4e-4278-827d-9bfc071f9e73 admin admin] The token cache is being invalidate because project be623ed394164492b7ba4ae1b56d1bcc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 14:58:55.072864 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-0171a0cb-4c4e-4278-827d-9bfc071f9e73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:55.075573 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-0171a0cb-4c4e-4278-827d-9bfc071f9e73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:55.078603 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1182/2375] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Sep 19 14:58:54 2022] DELETE /identity/v3/projects/be623ed394164492b7ba4ae1b56d1bcc => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:58:57.901878 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b4912-9253-4005-a2cc-d7241ed8345b None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:57.902880 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b4912-9253-4005-a2cc-d7241ed8345b None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:57.903373 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b4912-9253-4005-a2cc-d7241ed8345b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:57.937612 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-f49b4912-9253-4005-a2cc-d7241ed8345b None None] MFA Rules not processed for user `d44e7235b5c3464983a2d3cf053289e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:58:57.938998 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-f49b4912-9253-4005-a2cc-d7241ed8345b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:58.018891 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1194/2376] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:58:57 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:59:05.061624 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=73,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:59:05.989920 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0171a0cb-4c4e-4278-827d-9bfc071f9e73 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:59:05.991517 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-0171a0cb-4c4e-4278-827d-9bfc071f9e73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:59:06.062124 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0171a0cb-4c4e-4278-827d-9bfc071f9e73 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:59:06.065784 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd79b94-2602-4d6a-9385-4ec084668d12 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d6d4ecf8f4849939d6510a6228b29dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:59:06.066388 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd79b94-2602-4d6a-9385-4ec084668d12 service glance] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:59:06.066669 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd79b94-2602-4d6a-9385-4ec084668d12 service glance] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:59:06.066940 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd79b94-2602-4d6a-9385-4ec084668d12 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:59:06.068817 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-0cd79b94-2602-4d6a-9385-4ec084668d12 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:59:06.128735 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd79b94-2602-4d6a-9385-4ec084668d12 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:59:06.130084 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd79b94-2602-4d6a-9385-4ec084668d12 service glance] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:59:06.139882 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1183/2377] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:59:05 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:59:06.291118 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628fa519-32b4-4283-9545-8fede803edb8 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:59:06.291614 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628fa519-32b4-4283-9545-8fede803edb8 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:59:06.291736 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628fa519-32b4-4283-9545-8fede803edb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:59:06.312449 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-628fa519-32b4-4283-9545-8fede803edb8 None None] MFA Rules not processed for user `afbbbf11f3234297ab1dd509f064480f`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:59:06.313659 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-628fa519-32b4-4283-9545-8fede803edb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:59:06.374866 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1195/2378] 10.222.0.72 () {58 vars in 1009 bytes} [Mon Sep 19 14:59:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:59:06.419882 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd79b94-2602-4d6a-9385-4ec084668d12 service glance] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:59:06.421347 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-0cd79b94-2602-4d6a-9385-4ec084668d12 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:59:06.492530 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd79b94-2602-4d6a-9385-4ec084668d12 service glance] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:59:06.498017 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d522998-175f-4470-9fda-15a0dcf53026 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8504425c3a414608b030d0cf1af78af5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:59:06.499163 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d522998-175f-4470-9fda-15a0dcf53026 service swift] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:59:06.499439 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d522998-175f-4470-9fda-15a0dcf53026 service swift] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:59:06.499711 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d522998-175f-4470-9fda-15a0dcf53026 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:59:06.508134 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d522998-175f-4470-9fda-15a0dcf53026 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:59:06.509733 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d522998-175f-4470-9fda-15a0dcf53026 service swift] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:59:06.518137 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1184/2379] 10.222.0.72 () {60 vars in 1384 bytes} [Mon Sep 19 14:59:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 14:59:16.368740 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=75 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:59:16.514759 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=80 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:59:17.439114 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a682f64-d8a9-42b3-ba85-bfb51c94508f None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:59:17.439778 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a682f64-d8a9-42b3-ba85-bfb51c94508f None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:59:17.439870 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a682f64-d8a9-42b3-ba85-bfb51c94508f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:59:17.464433 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-7a682f64-d8a9-42b3-ba85-bfb51c94508f None None] MFA Rules not processed for user `b419942f414447c883ec133c7bcb0a3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:59:17.467371 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-7a682f64-d8a9-42b3-ba85-bfb51c94508f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:59:17.475361 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1196/2380] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:59:17 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:59:18.033160 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9561c56a-1b0e-459f-a9a8-3685fe827831 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:59:18.033704 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9561c56a-1b0e-459f-a9a8-3685fe827831 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:59:18.033932 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9561c56a-1b0e-459f-a9a8-3685fe827831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:59:18.054613 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-9561c56a-1b0e-459f-a9a8-3685fe827831 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:59:18.055972 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-9561c56a-1b0e-459f-a9a8-3685fe827831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:59:18.123822 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1185/2381] 10.222.0.85 () {58 vars in 1016 bytes} [Mon Sep 19 14:59:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:59:18.293653 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a682f64-d8a9-42b3-ba85-bfb51c94508f None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:59:18.296037 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-7a682f64-d8a9-42b3-ba85-bfb51c94508f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:59:18.374275 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a682f64-d8a9-42b3-ba85-bfb51c94508f None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:59:18.380205 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aacf1f0-8684-4042-bb49-c1a306737585 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055439dc35e946f4a82535c684f9b60d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:59:18.380965 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aacf1f0-8684-4042-bb49-c1a306737585 service nova] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:59:18.381190 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aacf1f0-8684-4042-bb49-c1a306737585 service nova] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:59:18.381458 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aacf1f0-8684-4042-bb49-c1a306737585 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:59:18.390275 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aacf1f0-8684-4042-bb49-c1a306737585 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:59:18.391886 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aacf1f0-8684-4042-bb49-c1a306737585 service nova] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:59:18.401912 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1197/2382] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:59:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:59:18.836851 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d87341-b61d-468d-8e64-47c6e8071b53 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:59:18.837224 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d87341-b61d-468d-8e64-47c6e8071b53 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:59:18.837407 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d87341-b61d-468d-8e64-47c6e8071b53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:59:18.872900 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-29d87341-b61d-468d-8e64-47c6e8071b53 None None] MFA Rules not processed for user `56875d0b48a04325a01d0d999ad186ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:59:18.875030 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-29d87341-b61d-468d-8e64-47c6e8071b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:59:18.970589 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1186/2383] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:59:18 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:59:21.222428 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e7fda8-7331-4a48-ad72-9e50793da46a None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:59:21.223002 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e7fda8-7331-4a48-ad72-9e50793da46a None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:59:21.223226 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e7fda8-7331-4a48-ad72-9e50793da46a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:59:21.262184 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-60e7fda8-7331-4a48-ad72-9e50793da46a None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:59:21.263850 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-60e7fda8-7331-4a48-ad72-9e50793da46a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:59:21.276050 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1198/2384] 10.222.0.85 () {58 vars in 1016 bytes} [Mon Sep 19 14:59:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:59:21.330618 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d87341-b61d-468d-8e64-47c6e8071b53 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:59:21.359410 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d87341-b61d-468d-8e64-47c6e8071b53 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:59:21.370154 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b81658-49d8-4f26-95c4-96346a2ce7ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055439dc35e946f4a82535c684f9b60d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:59:21.371092 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b81658-49d8-4f26-95c4-96346a2ce7ab service nova] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:59:21.371592 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b81658-49d8-4f26-95c4-96346a2ce7ab service nova] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:59:21.372117 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b81658-49d8-4f26-95c4-96346a2ce7ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:59:21.393019 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b81658-49d8-4f26-95c4-96346a2ce7ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:59:21.394991 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b81658-49d8-4f26-95c4-96346a2ce7ab service nova] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:59:21.426454 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1187/2385] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:59:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:59:23.570711 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202c33bc-fc80-4138-94f0-3bd8ff149441 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:59:23.571872 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202c33bc-fc80-4138-94f0-3bd8ff149441 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:59:23.572434 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202c33bc-fc80-4138-94f0-3bd8ff149441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:59:23.600344 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-202c33bc-fc80-4138-94f0-3bd8ff149441 None None] MFA Rules not processed for user `afbbbf11f3234297ab1dd509f064480f`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:59:23.602963 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-202c33bc-fc80-4138-94f0-3bd8ff149441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:59:23.612955 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1199/2386] 10.222.0.72 () {58 vars in 1009 bytes} [Mon Sep 19 14:59:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:59:23.626287 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b81658-49d8-4f26-95c4-96346a2ce7ab service nova] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:59:23.641279 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b81658-49d8-4f26-95c4-96346a2ce7ab service nova] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:59:23.649720 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4eb529-c85b-45e6-86fb-28790fbca938 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8504425c3a414608b030d0cf1af78af5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:59:23.650345 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4eb529-c85b-45e6-86fb-28790fbca938 service swift] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:59:23.650627 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4eb529-c85b-45e6-86fb-28790fbca938 service swift] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:59:23.650896 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4eb529-c85b-45e6-86fb-28790fbca938 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:59:23.660110 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4eb529-c85b-45e6-86fb-28790fbca938 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:59:23.661958 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4eb529-c85b-45e6-86fb-28790fbca938 service swift] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:59:23.677910 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1188/2387] 10.222.0.72 () {60 vars in 1384 bytes} [Mon Sep 19 14:59:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 14:59:25.581694 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae76a6be-1e82-40b7-bb1d-00fadc55ac0d None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:59:25.582337 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae76a6be-1e82-40b7-bb1d-00fadc55ac0d None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:59:25.582337 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae76a6be-1e82-40b7-bb1d-00fadc55ac0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:59:25.602665 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-ae76a6be-1e82-40b7-bb1d-00fadc55ac0d None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:59:25.603878 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-ae76a6be-1e82-40b7-bb1d-00fadc55ac0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:59:25.618495 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1200/2388] 10.222.0.85 () {58 vars in 1016 bytes} [Mon Sep 19 14:59:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:59:25.633464 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4eb529-c85b-45e6-86fb-28790fbca938 service swift] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:59:25.635600 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-cb4eb529-c85b-45e6-86fb-28790fbca938 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:59:25.652518 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4eb529-c85b-45e6-86fb-28790fbca938 service swift] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:59:25.659177 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef010c25-4bc0-4f49-9d72-6224be54aa52 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055439dc35e946f4a82535c684f9b60d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:59:25.659794 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef010c25-4bc0-4f49-9d72-6224be54aa52 service nova] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:59:25.660081 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef010c25-4bc0-4f49-9d72-6224be54aa52 service nova] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:59:25.660369 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef010c25-4bc0-4f49-9d72-6224be54aa52 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:59:25.669766 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef010c25-4bc0-4f49-9d72-6224be54aa52 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:59:25.671357 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef010c25-4bc0-4f49-9d72-6224be54aa52 service nova] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:59:25.681771 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1189/2389] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:59:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:59:35.596938 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=46 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:59:35.677167 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=70 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:59:39.977111 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe319b10-b6f2-4dcb-844b-022887518611 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:59:39.977725 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe319b10-b6f2-4dcb-844b-022887518611 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:59:39.977898 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe319b10-b6f2-4dcb-844b-022887518611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:59:40.001137 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-fe319b10-b6f2-4dcb-844b-022887518611 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:59:40.002364 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-fe319b10-b6f2-4dcb-844b-022887518611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:59:40.010850 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1201/2390] 10.222.0.85 () {58 vars in 1016 bytes} [Mon Sep 19 14:59:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:59:40.029732 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef010c25-4bc0-4f49-9d72-6224be54aa52 service nova] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:59:40.041126 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef010c25-4bc0-4f49-9d72-6224be54aa52 service nova] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:59:40.047294 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a651e85-bd69-4c4f-865b-d2bd4cc65274 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055439dc35e946f4a82535c684f9b60d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:59:40.048105 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a651e85-bd69-4c4f-865b-d2bd4cc65274 service nova] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:59:40.048411 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a651e85-bd69-4c4f-865b-d2bd4cc65274 service nova] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:59:40.048685 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a651e85-bd69-4c4f-865b-d2bd4cc65274 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:59:40.056957 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a651e85-bd69-4c4f-865b-d2bd4cc65274 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:59:40.058521 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a651e85-bd69-4c4f-865b-d2bd4cc65274 service nova] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:59:40.071240 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1190/2391] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:59:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:59:42.303572 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe319b10-b6f2-4dcb-844b-022887518611 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:59:42.305071 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-fe319b10-b6f2-4dcb-844b-022887518611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:59:42.364545 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe319b10-b6f2-4dcb-844b-022887518611 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:59:42.368066 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b9a330-1e39-4efb-a55d-db704e8547eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c2b78646374cb79ded4b7b59ba49c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:59:42.368698 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b9a330-1e39-4efb-a55d-db704e8547eb service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:59:42.368979 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b9a330-1e39-4efb-a55d-db704e8547eb service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:59:42.369250 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b9a330-1e39-4efb-a55d-db704e8547eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:59:42.370981 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-a1b9a330-1e39-4efb-a55d-db704e8547eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:59:42.431614 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b9a330-1e39-4efb-a55d-db704e8547eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:59:42.433063 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b9a330-1e39-4efb-a55d-db704e8547eb service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:59:42.443175 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1202/2392] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:59:42 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:59:45.295117 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc498504-61aa-4a61-98bc-c3c14c0e5a57 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:59:45.296364 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc498504-61aa-4a61-98bc-c3c14c0e5a57 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:59:45.296920 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc498504-61aa-4a61-98bc-c3c14c0e5a57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:59:45.328211 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-bc498504-61aa-4a61-98bc-c3c14c0e5a57 None None] MFA Rules not processed for user `afbbbf11f3234297ab1dd509f064480f`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:59:45.329316 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-bc498504-61aa-4a61-98bc-c3c14c0e5a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:59:45.337109 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7cbfb4-1eab-4a20-bf7c-5f2e14d4e7bb None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:59:45.337647 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1191/2393] 10.222.0.72 () {58 vars in 1009 bytes} [Mon Sep 19 14:59:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:59:45.338321 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7cbfb4-1eab-4a20-bf7c-5f2e14d4e7bb None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:59:45.338579 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7cbfb4-1eab-4a20-bf7c-5f2e14d4e7bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:59:45.351499 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc498504-61aa-4a61-98bc-c3c14c0e5a57 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:59:45.370069 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-6f7cbfb4-1eab-4a20-bf7c-5f2e14d4e7bb None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:59:45.372128 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-6f7cbfb4-1eab-4a20-bf7c-5f2e14d4e7bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:59:45.379642 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc498504-61aa-4a61-98bc-c3c14c0e5a57 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:59:45.384596 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1203/2394] 10.222.0.85 () {58 vars in 1016 bytes} [Mon Sep 19 14:59:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:59:45.388523 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7d309e-03d4-44c8-94c9-2561cda6a9d9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8504425c3a414608b030d0cf1af78af5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:59:45.389226 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7d309e-03d4-44c8-94c9-2561cda6a9d9 service swift] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:59:45.389578 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7d309e-03d4-44c8-94c9-2561cda6a9d9 service swift] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:59:45.389920 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7d309e-03d4-44c8-94c9-2561cda6a9d9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:59:45.399421 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7d309e-03d4-44c8-94c9-2561cda6a9d9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:59:45.399920 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7cbfb4-1eab-4a20-bf7c-5f2e14d4e7bb None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:59:45.402008 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7d309e-03d4-44c8-94c9-2561cda6a9d9 service swift] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:59:45.415475 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1192/2395] 10.222.0.72 () {60 vars in 1384 bytes} [Mon Sep 19 14:59:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 19 14:59:45.425120 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7cbfb4-1eab-4a20-bf7c-5f2e14d4e7bb None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:59:45.432441 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7089258f-5f86-4c76-ab97-479c8dba71e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055439dc35e946f4a82535c684f9b60d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:59:45.433171 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7089258f-5f86-4c76-ab97-479c8dba71e3 service nova] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:59:45.433557 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7089258f-5f86-4c76-ab97-479c8dba71e3 service nova] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:59:45.433735 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7089258f-5f86-4c76-ab97-479c8dba71e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:59:45.444504 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7089258f-5f86-4c76-ab97-479c8dba71e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:59:45.446490 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7089258f-5f86-4c76-ab97-479c8dba71e3 service nova] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:59:45.461261 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1204/2396] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:59:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:59:46.063068 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad67c04a-9c67-49f9-a672-817559749c89 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:59:46.063380 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad67c04a-9c67-49f9-a672-817559749c89 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:59:46.063687 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad67c04a-9c67-49f9-a672-817559749c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:59:46.084086 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-ad67c04a-9c67-49f9-a672-817559749c89 None None] MFA Rules not processed for user `afbbbf11f3234297ab1dd509f064480f`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:59:46.085567 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-ad67c04a-9c67-49f9-a672-817559749c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:59:46.093931 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1193/2397] 10.222.0.72 () {58 vars in 967 bytes} [Mon Sep 19 14:59:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:59:46.106998 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7089258f-5f86-4c76-ab97-479c8dba71e3 service nova] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:59:46.118020 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7089258f-5f86-4c76-ab97-479c8dba71e3 service nova] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:59:46.122896 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9833a7d-accb-4430-880d-e8ae13cbe98d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8504425c3a414608b030d0cf1af78af5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:59:46.123477 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9833a7d-accb-4430-880d-e8ae13cbe98d service swift] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:59:46.123776 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9833a7d-accb-4430-880d-e8ae13cbe98d service swift] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:59:46.124047 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9833a7d-accb-4430-880d-e8ae13cbe98d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:59:46.131981 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9833a7d-accb-4430-880d-e8ae13cbe98d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:59:46.133572 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9833a7d-accb-4430-880d-e8ae13cbe98d service swift] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:59:46.141617 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1205/2398] 10.222.0.72 () {60 vars in 1384 bytes} [Mon Sep 19 14:59:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 14:59:46.373966 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46073c62-cc5b-4a67-81fb-d0a7333ff702 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:59:46.374436 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46073c62-cc5b-4a67-81fb-d0a7333ff702 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:59:46.374529 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46073c62-cc5b-4a67-81fb-d0a7333ff702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:59:46.395413 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-46073c62-cc5b-4a67-81fb-d0a7333ff702 None None] MFA Rules not processed for user `afbbbf11f3234297ab1dd509f064480f`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:59:46.396746 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-46073c62-cc5b-4a67-81fb-d0a7333ff702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:59:46.404563 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1194/2399] 10.222.0.72 () {58 vars in 1009 bytes} [Mon Sep 19 14:59:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:59:46.416389 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9833a7d-accb-4430-880d-e8ae13cbe98d service swift] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:59:46.426896 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9833a7d-accb-4430-880d-e8ae13cbe98d service swift] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:59:46.431851 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44821467-0f88-49e7-b384-ffa0931c831c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8504425c3a414608b030d0cf1af78af5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:59:46.432478 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44821467-0f88-49e7-b384-ffa0931c831c service swift] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:59:46.432758 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44821467-0f88-49e7-b384-ffa0931c831c service swift] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:59:46.433028 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44821467-0f88-49e7-b384-ffa0931c831c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:59:46.440925 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44821467-0f88-49e7-b384-ffa0931c831c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:59:46.442484 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44821467-0f88-49e7-b384-ffa0931c831c service swift] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:59:46.451140 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1206/2400] 10.222.0.72 () {60 vars in 1384 bytes} [Mon Sep 19 14:59:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 14:59:46.788729 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b460e03c-9845-40f8-8d46-4ebe8715c576 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:59:46.789262 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b460e03c-9845-40f8-8d46-4ebe8715c576 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:59:46.789834 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b460e03c-9845-40f8-8d46-4ebe8715c576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:59:46.811707 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-b460e03c-9845-40f8-8d46-4ebe8715c576 None None] MFA Rules not processed for user `afbbbf11f3234297ab1dd509f064480f`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:59:46.813024 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-b460e03c-9845-40f8-8d46-4ebe8715c576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:59:46.820508 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1195/2401] 10.222.0.72 () {58 vars in 967 bytes} [Mon Sep 19 14:59:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:59:46.834447 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44821467-0f88-49e7-b384-ffa0931c831c service swift] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:59:46.845370 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44821467-0f88-49e7-b384-ffa0931c831c service swift] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:59:46.850962 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d95410-5c21-42fe-b43a-8a53a0388172 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8504425c3a414608b030d0cf1af78af5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:59:46.851725 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d95410-5c21-42fe-b43a-8a53a0388172 service swift] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:59:46.852065 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d95410-5c21-42fe-b43a-8a53a0388172 service swift] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:59:46.852431 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d95410-5c21-42fe-b43a-8a53a0388172 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:59:46.861817 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d95410-5c21-42fe-b43a-8a53a0388172 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:59:46.863705 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d95410-5c21-42fe-b43a-8a53a0388172 service swift] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:59:46.873184 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1207/2402] 10.222.0.72 () {60 vars in 1384 bytes} [Mon Sep 19 14:59:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 14:59:48.998232 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b460e03c-9845-40f8-8d46-4ebe8715c576 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:59:48.999829 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-b460e03c-9845-40f8-8d46-4ebe8715c576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:59:49.015019 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b460e03c-9845-40f8-8d46-4ebe8715c576 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:59:49.019580 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82617039-fcf8-48bb-8dc2-69862d5ae7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:59:49.020281 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82617039-fcf8-48bb-8dc2-69862d5ae7aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:59:49.020814 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82617039-fcf8-48bb-8dc2-69862d5ae7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:59:49.021264 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82617039-fcf8-48bb-8dc2-69862d5ae7aa admin admin] PATH_INFO: `/v3/users/14b97589bac745db8a9262e88d9b9129` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:59:49.022644 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82617039-fcf8-48bb-8dc2-69862d5ae7aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=14b97589bac745db8a9262e88d9b9129)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:59:49.024387 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82617039-fcf8-48bb-8dc2-69862d5ae7aa admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:59:49.081238 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-82617039-fcf8-48bb-8dc2-69862d5ae7aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14b97589bac745db8a9262e88d9b9129'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:59:49.095281 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-82617039-fcf8-48bb-8dc2-69862d5ae7aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14b97589bac745db8a9262e88d9b9129'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:59:49.102151 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-82617039-fcf8-48bb-8dc2-69862d5ae7aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14b97589bac745db8a9262e88d9b9129'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:59:49.102895 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-82617039-fcf8-48bb-8dc2-69862d5ae7aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14b97589bac745db8a9262e88d9b9129'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:59:49.110744 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-82617039-fcf8-48bb-8dc2-69862d5ae7aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14b97589bac745db8a9262e88d9b9129'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:59:49.117674 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1196/2403] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Sep 19 14:59:48 2022] DELETE /identity/v3/users/14b97589bac745db8a9262e88d9b9129 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:59:49.122703 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db601f6-08b9-4ece-a9d2-19df5b8388bc None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:59:49.123235 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db601f6-08b9-4ece-a9d2-19df5b8388bc None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:59:49.123235 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db601f6-08b9-4ece-a9d2-19df5b8388bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:59:49.142967 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-2db601f6-08b9-4ece-a9d2-19df5b8388bc None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:59:49.144179 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-2db601f6-08b9-4ece-a9d2-19df5b8388bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:59:49.212211 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:59:49.234863 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1208/2404] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 14:59:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:59:49.251256 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82617039-fcf8-48bb-8dc2-69862d5ae7aa admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:59:49.252985 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-82617039-fcf8-48bb-8dc2-69862d5ae7aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:59:49.342800 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82617039-fcf8-48bb-8dc2-69862d5ae7aa admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:59:49.347246 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d2e4c1-8c20-4e27-831f-6516ba0a2179 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c2b78646374cb79ded4b7b59ba49c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:59:49.349268 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d2e4c1-8c20-4e27-831f-6516ba0a2179 service neutron] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:59:49.349755 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d2e4c1-8c20-4e27-831f-6516ba0a2179 service neutron] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:59:49.350201 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d2e4c1-8c20-4e27-831f-6516ba0a2179 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:59:49.373227 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d2e4c1-8c20-4e27-831f-6516ba0a2179 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:59:49.374949 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d2e4c1-8c20-4e27-831f-6516ba0a2179 service neutron] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:59:49.390103 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1197/2405] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:59:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:59:49.628636 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db601f6-08b9-4ece-a9d2-19df5b8388bc None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:59:49.630361 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-2db601f6-08b9-4ece-a9d2-19df5b8388bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:59:49.647787 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db601f6-08b9-4ece-a9d2-19df5b8388bc None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:59:49.655148 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97be3cda-7948-4daa-a8f6-1c797690b8c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:59:49.656099 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be3cda-7948-4daa-a8f6-1c797690b8c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:59:49.656480 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be3cda-7948-4daa-a8f6-1c797690b8c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:59:49.656767 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be3cda-7948-4daa-a8f6-1c797690b8c6 admin admin] PATH_INFO: `/v3/projects/7d821d3321644a1c8be76353c8dbbe8e` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:59:49.657920 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97be3cda-7948-4daa-a8f6-1c797690b8c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d821d3321644a1c8be76353c8dbbe8e)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:59:49.659908 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97be3cda-7948-4daa-a8f6-1c797690b8c6 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:59:49.720217 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-97be3cda-7948-4daa-a8f6-1c797690b8c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d821d3321644a1c8be76353c8dbbe8e', 'request_id': 'req-97be3cda-7948-4daa-a8f6-1c797690b8c6'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:59:49.730012 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-97be3cda-7948-4daa-a8f6-1c797690b8c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d821d3321644a1c8be76353c8dbbe8e', 'request_id': 'req-97be3cda-7948-4daa-a8f6-1c797690b8c6'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:59:49.737168 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-97be3cda-7948-4daa-a8f6-1c797690b8c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d821d3321644a1c8be76353c8dbbe8e', 'request_id': 'req-97be3cda-7948-4daa-a8f6-1c797690b8c6'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:59:49.757769 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-97be3cda-7948-4daa-a8f6-1c797690b8c6 admin admin] The token cache is being invalidate because project 7d821d3321644a1c8be76353c8dbbe8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 14:59:49.758186 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-97be3cda-7948-4daa-a8f6-1c797690b8c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:59:49.758961 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-97be3cda-7948-4daa-a8f6-1c797690b8c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:59:49.760594 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1209/2406] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Sep 19 14:59:49 2022] DELETE /identity/v3/projects/7d821d3321644a1c8be76353c8dbbe8e => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:59:50.582262 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a12759-4782-40be-8977-cb26c8116957 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:59:50.582728 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a12759-4782-40be-8977-cb26c8116957 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:59:50.582864 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a12759-4782-40be-8977-cb26c8116957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:59:50.603340 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-40a12759-4782-40be-8977-cb26c8116957 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:59:50.604553 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-40a12759-4782-40be-8977-cb26c8116957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:59:50.624926 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:59:50.671305 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1198/2407] 10.222.0.85 () {58 vars in 1016 bytes} [Mon Sep 19 14:59:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:59:50.686485 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97be3cda-7948-4daa-a8f6-1c797690b8c6 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:59:50.687872 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-97be3cda-7948-4daa-a8f6-1c797690b8c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:59:50.769270 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97be3cda-7948-4daa-a8f6-1c797690b8c6 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:59:50.774793 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ffc376-ddb1-45d7-9a84-d77bdabe44f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055439dc35e946f4a82535c684f9b60d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:59:50.775436 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ffc376-ddb1-45d7-9a84-d77bdabe44f0 service nova] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:59:50.775722 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ffc376-ddb1-45d7-9a84-d77bdabe44f0 service nova] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:59:50.775999 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ffc376-ddb1-45d7-9a84-d77bdabe44f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:59:50.784968 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ffc376-ddb1-45d7-9a84-d77bdabe44f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:59:50.786543 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ffc376-ddb1-45d7-9a84-d77bdabe44f0 service nova] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:59:50.796869 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1210/2408] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:59:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:59:56.704957 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a12759-4782-40be-8977-cb26c8116957 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:59:56.706483 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-40a12759-4782-40be-8977-cb26c8116957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:59:56.792770 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a12759-4782-40be-8977-cb26c8116957 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:59:56.797368 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01d116a-3d03-4ec3-88f3-1755131fc621 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c2b78646374cb79ded4b7b59ba49c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:59:56.797990 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01d116a-3d03-4ec3-88f3-1755131fc621 service neutron] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:59:56.798267 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01d116a-3d03-4ec3-88f3-1755131fc621 service neutron] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:59:56.798952 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01d116a-3d03-4ec3-88f3-1755131fc621 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:59:56.801210 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-f01d116a-3d03-4ec3-88f3-1755131fc621 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:59:56.875170 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01d116a-3d03-4ec3-88f3-1755131fc621 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:59:56.876658 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01d116a-3d03-4ec3-88f3-1755131fc621 service neutron] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:59:56.887362 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1199/2409] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 14:59:56 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:00:00.791923 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=68,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:00:03.024504 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69940f4-50d8-4a5c-ac43-b4bc48c693c6 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:00:03.025449 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69940f4-50d8-4a5c-ac43-b4bc48c693c6 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:00:03.026042 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69940f4-50d8-4a5c-ac43-b4bc48c693c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:00:03.048839 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-b69940f4-50d8-4a5c-ac43-b4bc48c693c6 None None] MFA Rules not processed for user `afbbbf11f3234297ab1dd509f064480f`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:00:03.050275 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-b69940f4-50d8-4a5c-ac43-b4bc48c693c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:00:03.115738 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1211/2410] 10.222.0.72 () {58 vars in 1009 bytes} [Mon Sep 19 15:00:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:00:03.129053 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01d116a-3d03-4ec3-88f3-1755131fc621 service neutron] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:00:03.130662 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-f01d116a-3d03-4ec3-88f3-1755131fc621 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:00:03.206045 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01d116a-3d03-4ec3-88f3-1755131fc621 service neutron] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:00:03.211358 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8e575a-3756-4c21-838f-4d18eb4d4923 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8504425c3a414608b030d0cf1af78af5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:00:03.212084 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e575a-3756-4c21-838f-4d18eb4d4923 service swift] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:00:03.212402 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e575a-3756-4c21-838f-4d18eb4d4923 service swift] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:00:03.212695 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e575a-3756-4c21-838f-4d18eb4d4923 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:00:03.221569 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8e575a-3756-4c21-838f-4d18eb4d4923 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:00:03.223177 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8e575a-3756-4c21-838f-4d18eb4d4923 service swift] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:00:03.232015 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1200/2411] 10.222.0.72 () {60 vars in 1384 bytes} [Mon Sep 19 15:00:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 15:00:03.855385 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69940f4-50d8-4a5c-ac43-b4bc48c693c6 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:00:03.863307 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-b69940f4-50d8-4a5c-ac43-b4bc48c693c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:00:04.034651 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69940f4-50d8-4a5c-ac43-b4bc48c693c6 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:00:04.046647 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4a61b4-eec7-47ca-be0c-753a4809cb70 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e7a0148db8462b8ba24bac6dd15298', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:00:04.047244 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4a61b4-eec7-47ca-be0c-753a4809cb70 service placement] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:00:04.048357 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4a61b4-eec7-47ca-be0c-753a4809cb70 service placement] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:00:04.048866 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4a61b4-eec7-47ca-be0c-753a4809cb70 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:00:04.051509 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-6c4a61b4-eec7-47ca-be0c-753a4809cb70 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:00:04.081899 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4a61b4-eec7-47ca-be0c-753a4809cb70 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:00:04.084484 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4a61b4-eec7-47ca-be0c-753a4809cb70 service placement] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:00:04.104951 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1212/2412] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 15:00:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:00:09.617473 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35eccd1-f6bd-47df-8f93-67c29f558ef8 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:00:09.618065 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35eccd1-f6bd-47df-8f93-67c29f558ef8 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:00:09.618065 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35eccd1-f6bd-47df-8f93-67c29f558ef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:00:09.625914 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:00:09.639213 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-d35eccd1-f6bd-47df-8f93-67c29f558ef8 None None] MFA Rules not processed for user `5982227628a54ff2942c058addf107bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:00:09.640572 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-d35eccd1-f6bd-47df-8f93-67c29f558ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:00:09.713363 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1201/2413] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 15:00:09 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:00:14.094653 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=57 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:00:19.618205 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee50d8f4-65e9-4ac7-b8e0-70c403d4aab2 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:00:19.618883 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee50d8f4-65e9-4ac7-b8e0-70c403d4aab2 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:00:19.618883 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee50d8f4-65e9-4ac7-b8e0-70c403d4aab2 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:00:19.620456 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1213/2414] 10.222.0.72 () {54 vars in 921 bytes} [Mon Sep 19 15:00:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:00:19.627278 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77060a7c-10bd-435f-9702-c6c86b63dd88 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:00:19.627830 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77060a7c-10bd-435f-9702-c6c86b63dd88 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:00:19.627830 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77060a7c-10bd-435f-9702-c6c86b63dd88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:00:19.648131 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-77060a7c-10bd-435f-9702-c6c86b63dd88 None None] MFA Rules not processed for user `055439dc35e946f4a82535c684f9b60d`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:00:19.649439 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-77060a7c-10bd-435f-9702-c6c86b63dd88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:00:19.659291 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1202/2415] 10.222.0.72 () {58 vars in 1018 bytes} [Mon Sep 19 15:00:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:00:19.671879 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee50d8f4-65e9-4ac7-b8e0-70c403d4aab2 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:00:19.673754 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-ee50d8f4-65e9-4ac7-b8e0-70c403d4aab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:00:19.734454 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee50d8f4-65e9-4ac7-b8e0-70c403d4aab2 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:00:19.738061 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0653200-bb8a-4364-8c72-dd0e8ff24f59 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d6d4ecf8f4849939d6510a6228b29dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:00:19.738660 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0653200-bb8a-4364-8c72-dd0e8ff24f59 service glance] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:00:19.738940 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0653200-bb8a-4364-8c72-dd0e8ff24f59 service glance] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:00:19.739211 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0653200-bb8a-4364-8c72-dd0e8ff24f59 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:00:19.749833 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0653200-bb8a-4364-8c72-dd0e8ff24f59 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:00:19.751278 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0653200-bb8a-4364-8c72-dd0e8ff24f59 service glance] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:00:19.762252 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1214/2416] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 15:00:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:00:19.830511 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af1664-a48d-4e06-b9ea-1172d65d634b None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:00:19.830796 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af1664-a48d-4e06-b9ea-1172d65d634b None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:00:19.831071 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af1664-a48d-4e06-b9ea-1172d65d634b None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:00:19.832422 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1203/2417] 10.222.0.72 () {54 vars in 921 bytes} [Mon Sep 19 15:00:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:00:19.837146 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74779c41-8e74-437e-9dd5-b020f9efa2f3 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:00:19.837435 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74779c41-8e74-437e-9dd5-b020f9efa2f3 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:00:19.837713 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74779c41-8e74-437e-9dd5-b020f9efa2f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:00:19.858840 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-74779c41-8e74-437e-9dd5-b020f9efa2f3 None None] MFA Rules not processed for user `f4c2b78646374cb79ded4b7b59ba49c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:00:19.860041 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-74779c41-8e74-437e-9dd5-b020f9efa2f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:00:19.866648 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1215/2418] 10.222.0.72 () {58 vars in 1018 bytes} [Mon Sep 19 15:00:19 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 15:00:19.879201 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04af1664-a48d-4e06-b9ea-1172d65d634b None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:00:19.890094 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04af1664-a48d-4e06-b9ea-1172d65d634b None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:00:19.893877 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b83eaa-173d-4a44-bf27-df24202ad56c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c2b78646374cb79ded4b7b59ba49c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:00:19.894581 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b83eaa-173d-4a44-bf27-df24202ad56c service neutron] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:00:19.894891 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b83eaa-173d-4a44-bf27-df24202ad56c service neutron] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:00:19.895194 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b83eaa-173d-4a44-bf27-df24202ad56c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:00:19.903143 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b83eaa-173d-4a44-bf27-df24202ad56c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:00:19.904597 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b83eaa-173d-4a44-bf27-df24202ad56c service neutron] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:00:19.913153 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1204/2419] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 15:00:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:00:19.994435 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725d956e-b2da-49c5-899c-7102a9ae50f5 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:00:19.994744 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725d956e-b2da-49c5-899c-7102a9ae50f5 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:00:19.995017 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725d956e-b2da-49c5-899c-7102a9ae50f5 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:00:19.996515 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1216/2420] 10.222.0.72 () {54 vars in 921 bytes} [Mon Sep 19 15:00:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:00:20.001321 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d182f5-d99c-4e2c-9173-3c8d325fc163 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:00:20.001613 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d182f5-d99c-4e2c-9173-3c8d325fc163 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:00:20.001915 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d182f5-d99c-4e2c-9173-3c8d325fc163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:00:20.022614 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-06d182f5-d99c-4e2c-9173-3c8d325fc163 None None] MFA Rules not processed for user `055439dc35e946f4a82535c684f9b60d`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:00:20.023815 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-06d182f5-d99c-4e2c-9173-3c8d325fc163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:00:20.033705 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1205/2421] 10.222.0.72 () {58 vars in 1018 bytes} [Mon Sep 19 15:00:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:00:20.044620 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725d956e-b2da-49c5-899c-7102a9ae50f5 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:00:20.055428 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725d956e-b2da-49c5-899c-7102a9ae50f5 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:00:20.058986 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c622fb20-acd4-4263-919b-60039b21ddd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c2b78646374cb79ded4b7b59ba49c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:00:20.059571 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c622fb20-acd4-4263-919b-60039b21ddd7 service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:00:20.059849 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c622fb20-acd4-4263-919b-60039b21ddd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:00:20.060116 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c622fb20-acd4-4263-919b-60039b21ddd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:00:20.070099 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c622fb20-acd4-4263-919b-60039b21ddd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:00:20.071713 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c622fb20-acd4-4263-919b-60039b21ddd7 service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:00:20.083031 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1217/2422] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 15:00:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:00:23.820614 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd71dc42-169a-4c3c-ac92-279bb8341a42 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:00:23.821337 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd71dc42-169a-4c3c-ac92-279bb8341a42 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:00:23.821443 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd71dc42-169a-4c3c-ac92-279bb8341a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:00:23.842007 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-fd71dc42-169a-4c3c-ac92-279bb8341a42 None None] MFA Rules not processed for user `afbbbf11f3234297ab1dd509f064480f`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:00:23.843207 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-fd71dc42-169a-4c3c-ac92-279bb8341a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:00:23.850584 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1206/2423] 10.222.0.72 () {58 vars in 1009 bytes} [Mon Sep 19 15:00:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:00:23.862824 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c622fb20-acd4-4263-919b-60039b21ddd7 service neutron] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:00:23.873937 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c622fb20-acd4-4263-919b-60039b21ddd7 service neutron] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:00:23.879690 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d14b6d9-bad1-477e-b9dd-ed7fedb0874d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8504425c3a414608b030d0cf1af78af5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:00:23.880290 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d14b6d9-bad1-477e-b9dd-ed7fedb0874d service swift] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:00:23.880617 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d14b6d9-bad1-477e-b9dd-ed7fedb0874d service swift] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:00:23.880873 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d14b6d9-bad1-477e-b9dd-ed7fedb0874d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:00:23.890009 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d14b6d9-bad1-477e-b9dd-ed7fedb0874d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:00:23.891736 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d14b6d9-bad1-477e-b9dd-ed7fedb0874d service swift] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:00:23.901214 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1218/2424] 10.222.0.72 () {60 vars in 1384 bytes} [Mon Sep 19 15:00:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 15:00:33.835822 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=39 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:00:33.897550 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=41 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:00:38.173638 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc1c22f-9cae-40d2-be62-3c5ea35b9615 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:00:38.174176 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc1c22f-9cae-40d2-be62-3c5ea35b9615 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:00:38.174305 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc1c22f-9cae-40d2-be62-3c5ea35b9615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:00:38.204502 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-1dc1c22f-9cae-40d2-be62-3c5ea35b9615 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:00:38.206017 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-1dc1c22f-9cae-40d2-be62-3c5ea35b9615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:00:38.216145 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1207/2425] 10.222.0.85 () {58 vars in 1016 bytes} [Mon Sep 19 15:00:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:00:38.234309 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d14b6d9-bad1-477e-b9dd-ed7fedb0874d service swift] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:00:38.246434 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d14b6d9-bad1-477e-b9dd-ed7fedb0874d service swift] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:00:38.252024 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f76d1ba-4190-4c6d-8fa6-dcf1fe0070eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055439dc35e946f4a82535c684f9b60d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:00:38.252665 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f76d1ba-4190-4c6d-8fa6-dcf1fe0070eb service nova] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:00:38.252941 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f76d1ba-4190-4c6d-8fa6-dcf1fe0070eb service nova] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:00:38.253209 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f76d1ba-4190-4c6d-8fa6-dcf1fe0070eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:00:38.261430 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f76d1ba-4190-4c6d-8fa6-dcf1fe0070eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:00:38.263558 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f76d1ba-4190-4c6d-8fa6-dcf1fe0070eb service nova] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:00:38.273070 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1219/2426] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 15:00:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:00:42.495447 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3073447b-27fc-4836-9bd8-bbda2bdc3ec1 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:00:42.496029 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3073447b-27fc-4836-9bd8-bbda2bdc3ec1 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:00:42.496159 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3073447b-27fc-4836-9bd8-bbda2bdc3ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:00:42.515705 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-3073447b-27fc-4836-9bd8-bbda2bdc3ec1 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:00:42.516923 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-3073447b-27fc-4836-9bd8-bbda2bdc3ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:00:42.524728 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1208/2427] 10.222.0.85 () {58 vars in 1016 bytes} [Mon Sep 19 15:00:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:00:42.547445 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f76d1ba-4190-4c6d-8fa6-dcf1fe0070eb service nova] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:00:42.560792 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f76d1ba-4190-4c6d-8fa6-dcf1fe0070eb service nova] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:00:42.566991 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af5d30e-80d9-4d6e-9a77-e1973a3c44f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055439dc35e946f4a82535c684f9b60d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:00:42.567586 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af5d30e-80d9-4d6e-9a77-e1973a3c44f3 service nova] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:00:42.567883 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af5d30e-80d9-4d6e-9a77-e1973a3c44f3 service nova] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:00:42.568149 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af5d30e-80d9-4d6e-9a77-e1973a3c44f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:00:42.578335 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af5d30e-80d9-4d6e-9a77-e1973a3c44f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:00:42.579942 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af5d30e-80d9-4d6e-9a77-e1973a3c44f3 service nova] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:00:42.591219 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1220/2428] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 15:00:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:00:42.612274 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28560442-13bb-4dad-8f58-26967a98d260 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:00:42.612679 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28560442-13bb-4dad-8f58-26967a98d260 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:00:42.613051 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28560442-13bb-4dad-8f58-26967a98d260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:00:42.636285 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-28560442-13bb-4dad-8f58-26967a98d260 None None] MFA Rules not processed for user `afbbbf11f3234297ab1dd509f064480f`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:00:42.638625 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-28560442-13bb-4dad-8f58-26967a98d260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:00:42.647841 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1209/2429] 10.222.0.72 () {58 vars in 967 bytes} [Mon Sep 19 15:00:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:00:42.665324 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af5d30e-80d9-4d6e-9a77-e1973a3c44f3 service nova] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:00:42.677470 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af5d30e-80d9-4d6e-9a77-e1973a3c44f3 service nova] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:00:42.684108 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3e08ed-096d-46ff-a125-f94ce4f41db7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8504425c3a414608b030d0cf1af78af5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:00:42.685065 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3e08ed-096d-46ff-a125-f94ce4f41db7 service swift] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:00:42.685423 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3e08ed-096d-46ff-a125-f94ce4f41db7 service swift] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:00:42.685726 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3e08ed-096d-46ff-a125-f94ce4f41db7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:00:42.696532 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3e08ed-096d-46ff-a125-f94ce4f41db7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:00:42.698429 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3e08ed-096d-46ff-a125-f94ce4f41db7 service swift] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:00:42.709198 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1221/2430] 10.222.0.72 () {60 vars in 1384 bytes} [Mon Sep 19 15:00:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 15:00:45.558467 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26245866-6fe2-4d55-be39-f54802263a94 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:00:45.558979 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26245866-6fe2-4d55-be39-f54802263a94 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:00:45.559110 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26245866-6fe2-4d55-be39-f54802263a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:00:45.581463 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-26245866-6fe2-4d55-be39-f54802263a94 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:00:45.582680 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-26245866-6fe2-4d55-be39-f54802263a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:00:45.591519 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1210/2431] 10.222.0.85 () {58 vars in 1016 bytes} [Mon Sep 19 15:00:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:00:45.612238 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3e08ed-096d-46ff-a125-f94ce4f41db7 service swift] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:00:45.613738 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-3e3e08ed-096d-46ff-a125-f94ce4f41db7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:00:45.630231 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3e08ed-096d-46ff-a125-f94ce4f41db7 service swift] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:00:45.636929 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77464b8-c6fa-4cb8-82e1-242e88db37dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055439dc35e946f4a82535c684f9b60d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:00:45.638129 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77464b8-c6fa-4cb8-82e1-242e88db37dd service nova] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:00:45.638306 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77464b8-c6fa-4cb8-82e1-242e88db37dd service nova] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:00:45.638596 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77464b8-c6fa-4cb8-82e1-242e88db37dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:00:45.646815 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77464b8-c6fa-4cb8-82e1-242e88db37dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:00:45.648430 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77464b8-c6fa-4cb8-82e1-242e88db37dd service nova] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:00:45.660769 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1222/2432] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 15:00:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:00:48.707299 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69c1803-e506-45e1-b74a-faf60c0913c4 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:00:48.707810 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69c1803-e506-45e1-b74a-faf60c0913c4 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:00:48.707977 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69c1803-e506-45e1-b74a-faf60c0913c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:00:48.728034 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-d69c1803-e506-45e1-b74a-faf60c0913c4 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:00:48.729292 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-d69c1803-e506-45e1-b74a-faf60c0913c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:00:48.737218 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1211/2433] 10.222.0.85 () {58 vars in 1016 bytes} [Mon Sep 19 15:00:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:00:48.907321 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77464b8-c6fa-4cb8-82e1-242e88db37dd service nova] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:00:48.918428 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77464b8-c6fa-4cb8-82e1-242e88db37dd service nova] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:00:48.923928 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dd4c5d-ae1e-4cfd-ace5-64d49ccd93b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055439dc35e946f4a82535c684f9b60d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:00:48.924553 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd4c5d-ae1e-4cfd-ace5-64d49ccd93b0 service nova] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:00:48.924831 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd4c5d-ae1e-4cfd-ace5-64d49ccd93b0 service nova] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:00:48.925099 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd4c5d-ae1e-4cfd-ace5-64d49ccd93b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:00:48.933258 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dd4c5d-ae1e-4cfd-ace5-64d49ccd93b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:00:48.935417 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dd4c5d-ae1e-4cfd-ace5-64d49ccd93b0 service nova] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:00:48.944757 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1223/2434] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 15:00:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:00:51.887250 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8ed176-10cd-4daa-ba89-86e1cb0fbb95 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:00:51.887752 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8ed176-10cd-4daa-ba89-86e1cb0fbb95 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:00:51.887852 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8ed176-10cd-4daa-ba89-86e1cb0fbb95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:00:51.908388 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-fd8ed176-10cd-4daa-ba89-86e1cb0fbb95 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:00:51.909722 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-fd8ed176-10cd-4daa-ba89-86e1cb0fbb95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:00:51.917563 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1212/2435] 10.222.0.85 () {58 vars in 1016 bytes} [Mon Sep 19 15:00:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:00:51.955293 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dd4c5d-ae1e-4cfd-ace5-64d49ccd93b0 service nova] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:00:51.967051 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dd4c5d-ae1e-4cfd-ace5-64d49ccd93b0 service nova] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:00:51.972693 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3a0157-e7ea-46f6-9167-e826a444803d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055439dc35e946f4a82535c684f9b60d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:00:51.973317 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a0157-e7ea-46f6-9167-e826a444803d service nova] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:00:51.973599 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a0157-e7ea-46f6-9167-e826a444803d service nova] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:00:51.973896 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a0157-e7ea-46f6-9167-e826a444803d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:00:51.982708 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3a0157-e7ea-46f6-9167-e826a444803d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:00:51.984272 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3a0157-e7ea-46f6-9167-e826a444803d service nova] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:00:51.993676 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1224/2436] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 15:00:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:01:01.903178 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=18 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:01:01.989448 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=36 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:01:11.085414 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d7c897-cb98-4140-a48d-d50da5603952 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:11.086127 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d7c897-cb98-4140-a48d-d50da5603952 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:11.086127 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d7c897-cb98-4140-a48d-d50da5603952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:11.106943 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-a4d7c897-cb98-4140-a48d-d50da5603952 None None] MFA Rules not processed for user `56875d0b48a04325a01d0d999ad186ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:01:11.108365 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-a4d7c897-cb98-4140-a48d-d50da5603952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:01:11.185220 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1213/2437] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 15:01:11 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:01:11.647758 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf244a8e-7a5a-408f-8af9-f1744ebcfa08 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:11.648237 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf244a8e-7a5a-408f-8af9-f1744ebcfa08 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:11.648378 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf244a8e-7a5a-408f-8af9-f1744ebcfa08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:11.669244 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-cf244a8e-7a5a-408f-8af9-f1744ebcfa08 None None] MFA Rules not processed for user `c3773acf65044281ae7837258aefd5ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:01:11.670520 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-cf244a8e-7a5a-408f-8af9-f1744ebcfa08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:01:11.733721 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1225/2438] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 15:01:11 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:01:21.177292 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=25 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:01:21.730528 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=25 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:01:24.844482 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d7c897-cb98-4140-a48d-d50da5603952 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:01:24.846005 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-a4d7c897-cb98-4140-a48d-d50da5603952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:01:24.859512 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d7c897-cb98-4140-a48d-d50da5603952 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:01:24.864106 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e745a39-c6fc-4d4d-bb1e-e1413745c846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:01:24.864783 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e745a39-c6fc-4d4d-bb1e-e1413745c846 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:24.865248 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e745a39-c6fc-4d4d-bb1e-e1413745c846 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:24.865680 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e745a39-c6fc-4d4d-bb1e-e1413745c846 admin admin] PATH_INFO: `/v3/users/5982227628a54ff2942c058addf107bd` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:24.867033 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e745a39-c6fc-4d4d-bb1e-e1413745c846 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5982227628a54ff2942c058addf107bd)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:01:24.868999 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e745a39-c6fc-4d4d-bb1e-e1413745c846 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:01:24.927983 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-9e745a39-c6fc-4d4d-bb1e-e1413745c846 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5982227628a54ff2942c058addf107bd'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:01:24.942119 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-9e745a39-c6fc-4d4d-bb1e-e1413745c846 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5982227628a54ff2942c058addf107bd'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:01:24.949653 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-9e745a39-c6fc-4d4d-bb1e-e1413745c846 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5982227628a54ff2942c058addf107bd'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:01:24.950379 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-9e745a39-c6fc-4d4d-bb1e-e1413745c846 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5982227628a54ff2942c058addf107bd'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:01:24.958589 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-9e745a39-c6fc-4d4d-bb1e-e1413745c846 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5982227628a54ff2942c058addf107bd'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:01:24.965422 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1214/2439] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Sep 19 15:01:24 2022] DELETE /identity/v3/users/5982227628a54ff2942c058addf107bd => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:01:25.393324 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf244a8e-7a5a-408f-8af9-f1744ebcfa08 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:01:25.410383 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf244a8e-7a5a-408f-8af9-f1744ebcfa08 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:01:25.479161 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593780ec-662b-48a0-90b6-27028952345d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:01:25.480556 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593780ec-662b-48a0-90b6-27028952345d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:25.480968 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593780ec-662b-48a0-90b6-27028952345d admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:25.481246 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593780ec-662b-48a0-90b6-27028952345d admin admin] PATH_INFO: `/v3/projects/3c6e8449bf9c41cc88c8775bd609efe0` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:25.482416 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593780ec-662b-48a0-90b6-27028952345d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c6e8449bf9c41cc88c8775bd609efe0)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:01:25.484681 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593780ec-662b-48a0-90b6-27028952345d admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:01:25.533324 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-593780ec-662b-48a0-90b6-27028952345d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c6e8449bf9c41cc88c8775bd609efe0', 'request_id': 'req-593780ec-662b-48a0-90b6-27028952345d'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:01:25.544053 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-593780ec-662b-48a0-90b6-27028952345d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c6e8449bf9c41cc88c8775bd609efe0', 'request_id': 'req-593780ec-662b-48a0-90b6-27028952345d'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:01:25.550932 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-593780ec-662b-48a0-90b6-27028952345d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c6e8449bf9c41cc88c8775bd609efe0', 'request_id': 'req-593780ec-662b-48a0-90b6-27028952345d'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:01:25.564475 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-593780ec-662b-48a0-90b6-27028952345d admin admin] The token cache is being invalidate because project 3c6e8449bf9c41cc88c8775bd609efe0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:01:25.564768 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-593780ec-662b-48a0-90b6-27028952345d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:01:25.565433 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-593780ec-662b-48a0-90b6-27028952345d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:01:25.568296 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1226/2440] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Sep 19 15:01:25 2022] DELETE /identity/v3/projects/3c6e8449bf9c41cc88c8775bd609efe0 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:01:25.573317 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2607283a-3fc7-4a15-abca-16a48282e2d9 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:25.573671 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2607283a-3fc7-4a15-abca-16a48282e2d9 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:25.573947 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2607283a-3fc7-4a15-abca-16a48282e2d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:25.596318 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-2607283a-3fc7-4a15-abca-16a48282e2d9 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:01:25.597557 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-2607283a-3fc7-4a15-abca-16a48282e2d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:01:25.665457 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1215/2441] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 15:01:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 15:01:25.673884 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c09b9-7c30-425d-8e8e-09a7923d355d None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:25.674334 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c09b9-7c30-425d-8e8e-09a7923d355d None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:25.674741 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c09b9-7c30-425d-8e8e-09a7923d355d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:25.696904 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-0e1c09b9-7c30-425d-8e8e-09a7923d355d None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:01:25.698396 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-0e1c09b9-7c30-425d-8e8e-09a7923d355d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:01:25.707400 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1227/2442] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 15:01:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:01:25.712366 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2607283a-3fc7-4a15-abca-16a48282e2d9 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:01:25.723397 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2607283a-3fc7-4a15-abca-16a48282e2d9 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:01:25.728321 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8923c103-ee1d-4c18-be2a-1efa3d5aafe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:01:25.729140 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8923c103-ee1d-4c18-be2a-1efa3d5aafe6 admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:25.729307 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8923c103-ee1d-4c18-be2a-1efa3d5aafe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:25.729524 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8923c103-ee1d-4c18-be2a-1efa3d5aafe6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:25.730283 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8923c103-ee1d-4c18-be2a-1efa3d5aafe6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:01:25.730586 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8923c103-ee1d-4c18-be2a-1efa3d5aafe6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:01:25.732184 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8923c103-ee1d-4c18-be2a-1efa3d5aafe6 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:01:25.744391 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1216/2443] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Sep 19 15:01:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:01:25.748942 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1c09b9-7c30-425d-8e8e-09a7923d355d None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:01:25.758986 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1c09b9-7c30-425d-8e8e-09a7923d355d None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:01:25.764865 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cdb170-e016-49d3-bde0-94653943e667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:01:25.765609 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cdb170-e016-49d3-bde0-94653943e667 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:25.765960 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cdb170-e016-49d3-bde0-94653943e667 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:25.766336 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cdb170-e016-49d3-bde0-94653943e667 admin admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:25.767078 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cdb170-e016-49d3-bde0-94653943e667 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:01:25.769126 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cdb170-e016-49d3-bde0-94653943e667 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:01:25.804247 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1228/2444] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Sep 19 15:01:25 2022] POST /identity/v3/projects => generated 389 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 15:01:25.806277 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8923c103-ee1d-4c18-be2a-1efa3d5aafe6 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:01:25.818085 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8923c103-ee1d-4c18-be2a-1efa3d5aafe6 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:01:25.894098 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452bda3a-96c8-4395-abd6-84473b5ebc3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:01:25.894752 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452bda3a-96c8-4395-abd6-84473b5ebc3a admin admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:25.895046 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452bda3a-96c8-4395-abd6-84473b5ebc3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:25.895326 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452bda3a-96c8-4395-abd6-84473b5ebc3a admin admin] PATH_INFO: `/v3/users` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:25.895972 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452bda3a-96c8-4395-abd6-84473b5ebc3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:01:25.897952 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452bda3a-96c8-4395-abd6-84473b5ebc3a admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:01:25.911073 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:01:25.929105 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1217/2445] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Sep 19 15:01:25 2022] POST /identity/v3/users => generated 295 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:01:25.934288 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cdb170-e016-49d3-bde0-94653943e667 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:01:25.945533 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cdb170-e016-49d3-bde0-94653943e667 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:01:25.951421 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c25779-3cbd-4afd-8c6b-faa8a6f47a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:01:25.952028 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c25779-3cbd-4afd-8c6b-faa8a6f47a52 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:25.952312 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c25779-3cbd-4afd-8c6b-faa8a6f47a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:25.952630 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c25779-3cbd-4afd-8c6b-faa8a6f47a52 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:25.953283 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c25779-3cbd-4afd-8c6b-faa8a6f47a52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:01:25.954895 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c25779-3cbd-4afd-8c6b-faa8a6f47a52 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:01:25.967852 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1229/2446] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 15:01:25 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:01:25.971668 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452bda3a-96c8-4395-abd6-84473b5ebc3a admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:01:25.984456 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452bda3a-96c8-4395-abd6-84473b5ebc3a admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:01:25.989249 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f89daae-9dbb-4e9e-97ed-1a02dcf2b233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:01:25.990026 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f89daae-9dbb-4e9e-97ed-1a02dcf2b233 admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:25.990146 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f89daae-9dbb-4e9e-97ed-1a02dcf2b233 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:25.990530 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f89daae-9dbb-4e9e-97ed-1a02dcf2b233 admin admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:25.991298 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f89daae-9dbb-4e9e-97ed-1a02dcf2b233 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:01:25.992934 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f89daae-9dbb-4e9e-97ed-1a02dcf2b233 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:01:26.004984 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1218/2447] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 15:01:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 15:01:26.009304 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c25779-3cbd-4afd-8c6b-faa8a6f47a52 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:01:26.019991 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c25779-3cbd-4afd-8c6b-faa8a6f47a52 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:01:26.025580 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e6e6a9-e486-4bca-9443-eeae3ebc98d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:01:26.026248 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e6e6a9-e486-4bca-9443-eeae3ebc98d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:26.026529 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e6e6a9-e486-4bca-9443-eeae3ebc98d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:26.027384 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e6e6a9-e486-4bca-9443-eeae3ebc98d4 admin admin] PATH_INFO: `/v3/projects/1adf537e2548498f934181fd2412f02d/users/1132124ddd5648de9af23347a0af086d/roles/efa0e5b3413748dc828a89b12d67df79` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:26.044242 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e6e6a9-e486-4bca-9443-eeae3ebc98d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1adf537e2548498f934181fd2412f02d, user_id=1132124ddd5648de9af23347a0af086d, role_id=efa0e5b3413748dc828a89b12d67df79)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:01:26.046952 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e6e6a9-e486-4bca-9443-eeae3ebc98d4 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:01:26.072893 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1230/2448] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 15:01:26 2022] PUT /identity/v3/projects/1adf537e2548498f934181fd2412f02d/users/1132124ddd5648de9af23347a0af086d/roles/efa0e5b3413748dc828a89b12d67df79 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:01:26.078333 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f86ba50-af97-4ab3-a2f4-b5c14dcfe478 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:26.078623 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f86ba50-af97-4ab3-a2f4-b5c14dcfe478 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:26.078911 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f86ba50-af97-4ab3-a2f4-b5c14dcfe478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:26.111240 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-6f86ba50-af97-4ab3-a2f4-b5c14dcfe478 None None] MFA Rules not processed for user `1132124ddd5648de9af23347a0af086d`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:01:26.112598 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-6f86ba50-af97-4ab3-a2f4-b5c14dcfe478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:01:26.184582 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1219/2449] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 15:01:26 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 15:01:26.195592 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e6e6a9-e486-4bca-9443-eeae3ebc98d4 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:01:26.197869 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-e1e6e6a9-e486-4bca-9443-eeae3ebc98d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:01:26.232716 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:01:26.262625 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e6e6a9-e486-4bca-9443-eeae3ebc98d4 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:01:26.266313 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2fa9e2-88e5-461f-b171-90b973929083 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139dc7a4f1dc48fe8faea848bd1ac0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:01:26.266954 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2fa9e2-88e5-461f-b171-90b973929083 service cinder] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:26.267283 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2fa9e2-88e5-461f-b171-90b973929083 service cinder] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:26.267560 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2fa9e2-88e5-461f-b171-90b973929083 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:26.276076 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2fa9e2-88e5-461f-b171-90b973929083 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:01:26.278559 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2fa9e2-88e5-461f-b171-90b973929083 service cinder] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:01:26.288193 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1231/2450] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 15:01:26 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:01:33.519173 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e11c5-56de-4259-8a51-7027a9a5bf78 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:33.519701 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e11c5-56de-4259-8a51-7027a9a5bf78 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:33.519701 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e11c5-56de-4259-8a51-7027a9a5bf78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:33.538945 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-4e6e11c5-56de-4259-8a51-7027a9a5bf78 None None] MFA Rules not processed for user `b5fbe11b49b24fdb80257652ed9fe298`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:01:33.540137 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-4e6e11c5-56de-4259-8a51-7027a9a5bf78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:01:33.594369 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1220/2451] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 15:01:33 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:01:36.284001 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=14 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:01:36.583615 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2fa9e2-88e5-461f-b171-90b973929083 service cinder] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:01:36.655395 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2fa9e2-88e5-461f-b171-90b973929083 service cinder] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:01:36.660621 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81be521-8eea-4453-bd91-3756891e2908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:01:36.661263 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81be521-8eea-4453-bd91-3756891e2908 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:36.661542 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81be521-8eea-4453-bd91-3756891e2908 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:36.661816 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81be521-8eea-4453-bd91-3756891e2908 admin admin] PATH_INFO: `/v3/users/1132124ddd5648de9af23347a0af086d` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:36.663646 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81be521-8eea-4453-bd91-3756891e2908 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1132124ddd5648de9af23347a0af086d)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:01:36.666621 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81be521-8eea-4453-bd91-3756891e2908 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:01:36.718522 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-a81be521-8eea-4453-bd91-3756891e2908 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1132124ddd5648de9af23347a0af086d'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:01:36.731260 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-a81be521-8eea-4453-bd91-3756891e2908 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1132124ddd5648de9af23347a0af086d'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:01:36.738577 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-a81be521-8eea-4453-bd91-3756891e2908 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1132124ddd5648de9af23347a0af086d'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:01:36.747434 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-a81be521-8eea-4453-bd91-3756891e2908 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1132124ddd5648de9af23347a0af086d'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:01:36.748086 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-a81be521-8eea-4453-bd91-3756891e2908 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1132124ddd5648de9af23347a0af086d'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:01:36.754275 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1232/2452] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Sep 19 15:01:36 2022] DELETE /identity/v3/users/1132124ddd5648de9af23347a0af086d => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:01:36.758933 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5d71ee-e06b-4bbd-bca2-94d5885d5a9b None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:36.759551 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5d71ee-e06b-4bbd-bca2-94d5885d5a9b None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:36.759551 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5d71ee-e06b-4bbd-bca2-94d5885d5a9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:36.780208 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-bd5d71ee-e06b-4bbd-bca2-94d5885d5a9b None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:01:36.781561 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-bd5d71ee-e06b-4bbd-bca2-94d5885d5a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:01:36.851811 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1221/2453] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 15:01:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:01:36.861171 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81be521-8eea-4453-bd91-3756891e2908 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:01:36.863724 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-a81be521-8eea-4453-bd91-3756891e2908 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:01:36.953681 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81be521-8eea-4453-bd91-3756891e2908 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:01:36.957397 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3196af-f53f-42db-9028-994d65081ec5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c2b78646374cb79ded4b7b59ba49c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:01:36.958034 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3196af-f53f-42db-9028-994d65081ec5 service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:36.958313 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3196af-f53f-42db-9028-994d65081ec5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:36.958584 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3196af-f53f-42db-9028-994d65081ec5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:36.968826 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3196af-f53f-42db-9028-994d65081ec5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:01:36.970587 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3196af-f53f-42db-9028-994d65081ec5 service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:01:36.980604 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1233/2454] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 15:01:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 15:01:37.259989 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5d71ee-e06b-4bbd-bca2-94d5885d5a9b None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:01:37.262171 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-bd5d71ee-e06b-4bbd-bca2-94d5885d5a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:01:37.274358 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5d71ee-e06b-4bbd-bca2-94d5885d5a9b None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:01:37.280547 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9695c0fa-96b4-470c-8d5c-118ad886c99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:01:37.281300 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9695c0fa-96b4-470c-8d5c-118ad886c99c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:37.281656 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9695c0fa-96b4-470c-8d5c-118ad886c99c admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:37.281998 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9695c0fa-96b4-470c-8d5c-118ad886c99c admin admin] PATH_INFO: `/v3/projects/1adf537e2548498f934181fd2412f02d` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:37.283199 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9695c0fa-96b4-470c-8d5c-118ad886c99c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1adf537e2548498f934181fd2412f02d)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:01:37.285286 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9695c0fa-96b4-470c-8d5c-118ad886c99c admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:01:37.295112 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:01:37.337958 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-9695c0fa-96b4-470c-8d5c-118ad886c99c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1adf537e2548498f934181fd2412f02d', 'request_id': 'req-9695c0fa-96b4-470c-8d5c-118ad886c99c'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:01:37.347023 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-9695c0fa-96b4-470c-8d5c-118ad886c99c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1adf537e2548498f934181fd2412f02d', 'request_id': 'req-9695c0fa-96b4-470c-8d5c-118ad886c99c'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:01:37.355245 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-9695c0fa-96b4-470c-8d5c-118ad886c99c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1adf537e2548498f934181fd2412f02d', 'request_id': 'req-9695c0fa-96b4-470c-8d5c-118ad886c99c'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:01:37.365922 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-9695c0fa-96b4-470c-8d5c-118ad886c99c admin admin] The token cache is being invalidate because project 1adf537e2548498f934181fd2412f02d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:01:37.366211 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-9695c0fa-96b4-470c-8d5c-118ad886c99c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:01:37.366881 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-9695c0fa-96b4-470c-8d5c-118ad886c99c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:01:37.368393 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1222/2455] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Sep 19 15:01:37 2022] DELETE /identity/v3/projects/1adf537e2548498f934181fd2412f02d => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:01:46.976416 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:01:47.362900 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=21,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:00.364109 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3196af-f53f-42db-9028-994d65081ec5 service neutron] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:00.365677 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-cf3196af-f53f-42db-9028-994d65081ec5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:00.377214 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3196af-f53f-42db-9028-994d65081ec5 service neutron] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:00.427688 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7663bca4-9a1a-435c-a0ec-2d24da56ffb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c2b78646374cb79ded4b7b59ba49c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:00.428297 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7663bca4-9a1a-435c-a0ec-2d24da56ffb2 service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:00.428613 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7663bca4-9a1a-435c-a0ec-2d24da56ffb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:00.428888 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7663bca4-9a1a-435c-a0ec-2d24da56ffb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:00.430658 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-7663bca4-9a1a-435c-a0ec-2d24da56ffb2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:00.509847 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7663bca4-9a1a-435c-a0ec-2d24da56ffb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:00.511830 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7663bca4-9a1a-435c-a0ec-2d24da56ffb2 service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:00.523080 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1234/2456] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 15:02:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:02:00.736527 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9695c0fa-96b4-470c-8d5c-118ad886c99c admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:00.738096 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-9695c0fa-96b4-470c-8d5c-118ad886c99c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:00.750337 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9695c0fa-96b4-470c-8d5c-118ad886c99c admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:00.754209 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b1314f-4fdb-439a-bacc-11d504bba178 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c2b78646374cb79ded4b7b59ba49c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:00.754815 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b1314f-4fdb-439a-bacc-11d504bba178 service neutron] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:00.755097 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b1314f-4fdb-439a-bacc-11d504bba178 service neutron] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:00.755511 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b1314f-4fdb-439a-bacc-11d504bba178 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:00.757282 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-a0b1314f-4fdb-439a-bacc-11d504bba178 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:00.771190 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b1314f-4fdb-439a-bacc-11d504bba178 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:00.772660 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b1314f-4fdb-439a-bacc-11d504bba178 service neutron] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:00.784433 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1223/2457] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 15:02:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:02:01.964896 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9edb85-1905-43a6-bc4e-26f633cd4f3d None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:01.965966 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9edb85-1905-43a6-bc4e-26f633cd4f3d None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:01.966500 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9edb85-1905-43a6-bc4e-26f633cd4f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:01.995112 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-4f9edb85-1905-43a6-bc4e-26f633cd4f3d None None] MFA Rules not processed for user `afbbbf11f3234297ab1dd509f064480f`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:02:01.996748 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-4f9edb85-1905-43a6-bc4e-26f633cd4f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:02.093577 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1235/2458] 10.222.0.72 () {58 vars in 967 bytes} [Mon Sep 19 15:02:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:02:02.149481 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b1314f-4fdb-439a-bacc-11d504bba178 service neutron] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:02.151505 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-a0b1314f-4fdb-439a-bacc-11d504bba178 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:02.232091 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b1314f-4fdb-439a-bacc-11d504bba178 service neutron] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:02.237469 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b83e29-a7b6-44c3-b35b-a1fff7e141a5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8504425c3a414608b030d0cf1af78af5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:02.238664 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b83e29-a7b6-44c3-b35b-a1fff7e141a5 service swift] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:02.239029 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b83e29-a7b6-44c3-b35b-a1fff7e141a5 service swift] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:02.239408 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b83e29-a7b6-44c3-b35b-a1fff7e141a5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:02.249295 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b83e29-a7b6-44c3-b35b-a1fff7e141a5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:02.251009 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b83e29-a7b6-44c3-b35b-a1fff7e141a5 service swift] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:02.260908 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1224/2459] 10.222.0.72 () {60 vars in 1384 bytes} [Mon Sep 19 15:02:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 15:02:05.141415 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9edb85-1905-43a6-bc4e-26f633cd4f3d None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:05.143534 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-4f9edb85-1905-43a6-bc4e-26f633cd4f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:05.201540 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:05.208480 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9edb85-1905-43a6-bc4e-26f633cd4f3d None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:05.212768 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6c826a-eaae-425c-8da5-62f806a96079 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139dc7a4f1dc48fe8faea848bd1ac0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:05.214035 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6c826a-eaae-425c-8da5-62f806a96079 service cinder] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:05.214328 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6c826a-eaae-425c-8da5-62f806a96079 service cinder] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:05.215109 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6c826a-eaae-425c-8da5-62f806a96079 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:05.217472 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-0c6c826a-eaae-425c-8da5-62f806a96079 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:05.287003 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6c826a-eaae-425c-8da5-62f806a96079 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:05.288624 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6c826a-eaae-425c-8da5-62f806a96079 service cinder] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:05.300926 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1236/2460] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 15:02:05 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:02:10.470098 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b83e29-a7b6-44c3-b35b-a1fff7e141a5 service swift] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:10.471709 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-67b83e29-a7b6-44c3-b35b-a1fff7e141a5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:10.545090 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b83e29-a7b6-44c3-b35b-a1fff7e141a5 service swift] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:10.550365 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3e7d4e-e5a6-4360-a310-a73f094a6e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:10.551081 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e7d4e-e5a6-4360-a310-a73f094a6e99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:10.551431 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e7d4e-e5a6-4360-a310-a73f094a6e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:10.551773 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e7d4e-e5a6-4360-a310-a73f094a6e99 admin admin] PATH_INFO: `/v3/users/b419942f414447c883ec133c7bcb0a3a` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:10.553063 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3e7d4e-e5a6-4360-a310-a73f094a6e99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b419942f414447c883ec133c7bcb0a3a)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:10.555057 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3e7d4e-e5a6-4360-a310-a73f094a6e99 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:10.607760 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-9a3e7d4e-e5a6-4360-a310-a73f094a6e99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b419942f414447c883ec133c7bcb0a3a'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:10.621684 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-9a3e7d4e-e5a6-4360-a310-a73f094a6e99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b419942f414447c883ec133c7bcb0a3a'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:10.628682 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-9a3e7d4e-e5a6-4360-a310-a73f094a6e99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b419942f414447c883ec133c7bcb0a3a'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:10.629471 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-9a3e7d4e-e5a6-4360-a310-a73f094a6e99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b419942f414447c883ec133c7bcb0a3a'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:10.634012 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:10.638997 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-9a3e7d4e-e5a6-4360-a310-a73f094a6e99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b419942f414447c883ec133c7bcb0a3a'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:10.646590 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1225/2461] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Sep 19 15:02:10 2022] DELETE /identity/v3/users/b419942f414447c883ec133c7bcb0a3a => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:02:10.977533 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6c826a-eaae-425c-8da5-62f806a96079 service cinder] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:10.991765 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6c826a-eaae-425c-8da5-62f806a96079 service cinder] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:11.068165 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9628811a-5fbb-4739-a10a-ab95e41dba6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:11.069316 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9628811a-5fbb-4739-a10a-ab95e41dba6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:11.069802 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9628811a-5fbb-4739-a10a-ab95e41dba6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:11.070089 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9628811a-5fbb-4739-a10a-ab95e41dba6a admin admin] PATH_INFO: `/v3/projects/e6bd8fe3bd294e6bac9fc3ceb6cb459a` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:11.072160 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9628811a-5fbb-4739-a10a-ab95e41dba6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6bd8fe3bd294e6bac9fc3ceb6cb459a)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:11.076045 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9628811a-5fbb-4739-a10a-ab95e41dba6a admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:11.133222 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-9628811a-5fbb-4739-a10a-ab95e41dba6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6bd8fe3bd294e6bac9fc3ceb6cb459a', 'request_id': 'req-9628811a-5fbb-4739-a10a-ab95e41dba6a'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:11.143658 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-9628811a-5fbb-4739-a10a-ab95e41dba6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6bd8fe3bd294e6bac9fc3ceb6cb459a', 'request_id': 'req-9628811a-5fbb-4739-a10a-ab95e41dba6a'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:11.169806 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-9628811a-5fbb-4739-a10a-ab95e41dba6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6bd8fe3bd294e6bac9fc3ceb6cb459a', 'request_id': 'req-9628811a-5fbb-4739-a10a-ab95e41dba6a'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:11.184869 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-9628811a-5fbb-4739-a10a-ab95e41dba6a admin admin] The token cache is being invalidate because project e6bd8fe3bd294e6bac9fc3ceb6cb459a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:02:11.185379 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-9628811a-5fbb-4739-a10a-ab95e41dba6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:11.186274 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-9628811a-5fbb-4739-a10a-ab95e41dba6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:11.188059 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1237/2462] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Sep 19 15:02:10 2022] DELETE /identity/v3/projects/e6bd8fe3bd294e6bac9fc3ceb6cb459a => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:02:11.192470 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3e7d4e-e5a6-4360-a310-a73f094a6e99 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:11.194035 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-9a3e7d4e-e5a6-4360-a310-a73f094a6e99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:11.219952 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3e7d4e-e5a6-4360-a310-a73f094a6e99 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:11.288837 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89908d0-e458-4533-ab27-2a8ce387e4fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:11.289690 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89908d0-e458-4533-ab27-2a8ce387e4fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:11.289970 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89908d0-e458-4533-ab27-2a8ce387e4fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:11.290242 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89908d0-e458-4533-ab27-2a8ce387e4fd admin admin] PATH_INFO: `/v3/users/d44e7235b5c3464983a2d3cf053289e6` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:11.291420 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89908d0-e458-4533-ab27-2a8ce387e4fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=d44e7235b5c3464983a2d3cf053289e6)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:11.293387 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89908d0-e458-4533-ab27-2a8ce387e4fd admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:11.372061 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-c89908d0-e458-4533-ab27-2a8ce387e4fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd44e7235b5c3464983a2d3cf053289e6'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:11.403704 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-c89908d0-e458-4533-ab27-2a8ce387e4fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd44e7235b5c3464983a2d3cf053289e6'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:11.413173 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-c89908d0-e458-4533-ab27-2a8ce387e4fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd44e7235b5c3464983a2d3cf053289e6'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:11.414642 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-c89908d0-e458-4533-ab27-2a8ce387e4fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd44e7235b5c3464983a2d3cf053289e6'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:11.426831 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-c89908d0-e458-4533-ab27-2a8ce387e4fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd44e7235b5c3464983a2d3cf053289e6'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:11.450933 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1226/2463] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Sep 19 15:02:11 2022] DELETE /identity/v3/users/d44e7235b5c3464983a2d3cf053289e6 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:02:11.644860 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9628811a-5fbb-4739-a10a-ab95e41dba6a admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:11.646815 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-9628811a-5fbb-4739-a10a-ab95e41dba6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:11.664878 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9628811a-5fbb-4739-a10a-ab95e41dba6a admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:11.695992 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:11.731247 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d293fa-2e5a-44ea-851f-3463df49e141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:11.731905 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d293fa-2e5a-44ea-851f-3463df49e141 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:11.732434 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d293fa-2e5a-44ea-851f-3463df49e141 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:11.733079 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d293fa-2e5a-44ea-851f-3463df49e141 admin admin] PATH_INFO: `/v3/projects/1073d723af00470f9a3daab671772bae` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:11.734525 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d293fa-2e5a-44ea-851f-3463df49e141 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1073d723af00470f9a3daab671772bae)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:11.736497 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d293fa-2e5a-44ea-851f-3463df49e141 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:11.796265 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-46d293fa-2e5a-44ea-851f-3463df49e141 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1073d723af00470f9a3daab671772bae', 'request_id': 'req-46d293fa-2e5a-44ea-851f-3463df49e141'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:11.804500 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-46d293fa-2e5a-44ea-851f-3463df49e141 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1073d723af00470f9a3daab671772bae', 'request_id': 'req-46d293fa-2e5a-44ea-851f-3463df49e141'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:11.811369 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-46d293fa-2e5a-44ea-851f-3463df49e141 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1073d723af00470f9a3daab671772bae', 'request_id': 'req-46d293fa-2e5a-44ea-851f-3463df49e141'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:11.824272 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-46d293fa-2e5a-44ea-851f-3463df49e141 admin admin] The token cache is being invalidate because project 1073d723af00470f9a3daab671772bae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:02:11.824605 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-46d293fa-2e5a-44ea-851f-3463df49e141 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:11.825280 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-46d293fa-2e5a-44ea-851f-3463df49e141 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:11.826777 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1238/2464] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Sep 19 15:02:11 2022] DELETE /identity/v3/projects/1073d723af00470f9a3daab671772bae => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:02:12.244363 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89908d0-e458-4533-ab27-2a8ce387e4fd admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:12.245913 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-c89908d0-e458-4533-ab27-2a8ce387e4fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:12.307809 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89908d0-e458-4533-ab27-2a8ce387e4fd admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:12.345510 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:12.367471 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94181f8-edef-40d3-b9f5-ecda4e769427 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c2b78646374cb79ded4b7b59ba49c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:12.368085 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94181f8-edef-40d3-b9f5-ecda4e769427 service neutron] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:12.368403 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94181f8-edef-40d3-b9f5-ecda4e769427 service neutron] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:12.368798 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94181f8-edef-40d3-b9f5-ecda4e769427 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:12.370861 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-e94181f8-edef-40d3-b9f5-ecda4e769427 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:12.380152 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94181f8-edef-40d3-b9f5-ecda4e769427 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:12.381644 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94181f8-edef-40d3-b9f5-ecda4e769427 service neutron] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:12.390201 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1227/2465] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 15:02:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:02:12.512762 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973166aa-ecb1-4546-8787-44b926f821dd None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:12.513350 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973166aa-ecb1-4546-8787-44b926f821dd None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:12.513570 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973166aa-ecb1-4546-8787-44b926f821dd None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:12.515244 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1239/2466] 10.222.0.72 () {54 vars in 921 bytes} [Mon Sep 19 15:02:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:02:12.522767 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c403ee0a-2e96-4036-90aa-6183b3defa62 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:12.523403 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c403ee0a-2e96-4036-90aa-6183b3defa62 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:12.523967 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c403ee0a-2e96-4036-90aa-6183b3defa62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:12.550544 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-c403ee0a-2e96-4036-90aa-6183b3defa62 None None] MFA Rules not processed for user `f4c2b78646374cb79ded4b7b59ba49c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:02:12.551838 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-c403ee0a-2e96-4036-90aa-6183b3defa62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:12.563457 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1228/2467] 10.222.0.72 () {58 vars in 1018 bytes} [Mon Sep 19 15:02:12 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:02:12.576205 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973166aa-ecb1-4546-8787-44b926f821dd None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:12.577964 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-973166aa-ecb1-4546-8787-44b926f821dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:12.603059 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973166aa-ecb1-4546-8787-44b926f821dd None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:12.607748 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c9c54a-a6b4-4e89-87bd-6945f0f9ab20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c2b78646374cb79ded4b7b59ba49c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:12.608884 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c9c54a-a6b4-4e89-87bd-6945f0f9ab20 service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:12.609310 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c9c54a-a6b4-4e89-87bd-6945f0f9ab20 service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:12.609777 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c9c54a-a6b4-4e89-87bd-6945f0f9ab20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:12.618700 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c9c54a-a6b4-4e89-87bd-6945f0f9ab20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:12.621410 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c9c54a-a6b4-4e89-87bd-6945f0f9ab20 service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:12.631342 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1240/2468] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 15:02:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:02:12.726015 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa08a26-f363-4c7c-8845-2c6cc7931b0a None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:12.726302 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa08a26-f363-4c7c-8845-2c6cc7931b0a None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:12.726585 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa08a26-f363-4c7c-8845-2c6cc7931b0a None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:12.727902 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1229/2469] 10.222.0.72 () {54 vars in 921 bytes} [Mon Sep 19 15:02:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 15:02:12.733247 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6238337-beaf-431b-93a6-d12223aeffd5 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:12.733557 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6238337-beaf-431b-93a6-d12223aeffd5 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:12.733829 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6238337-beaf-431b-93a6-d12223aeffd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:12.754094 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-f6238337-beaf-431b-93a6-d12223aeffd5 None None] MFA Rules not processed for user `055439dc35e946f4a82535c684f9b60d`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:02:12.755244 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-f6238337-beaf-431b-93a6-d12223aeffd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:12.835828 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1241/2470] 10.222.0.72 () {58 vars in 1018 bytes} [Mon Sep 19 15:02:12 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:02:12.846740 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa08a26-f363-4c7c-8845-2c6cc7931b0a None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:12.848620 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-9aa08a26-f363-4c7c-8845-2c6cc7931b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:12.862295 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa08a26-f363-4c7c-8845-2c6cc7931b0a None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:12.866183 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913cf885-4d43-4846-9693-b766f3b5f8be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c2b78646374cb79ded4b7b59ba49c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:12.866780 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913cf885-4d43-4846-9693-b766f3b5f8be service neutron] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:12.867058 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913cf885-4d43-4846-9693-b766f3b5f8be service neutron] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:12.867328 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913cf885-4d43-4846-9693-b766f3b5f8be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:12.879738 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913cf885-4d43-4846-9693-b766f3b5f8be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:12.881409 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913cf885-4d43-4846-9693-b766f3b5f8be service neutron] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:12.893775 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1230/2471] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 15:02:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:02:12.960541 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec72a7a-82c2-45f5-a0fe-192b1bbbb80a None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:12.960858 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec72a7a-82c2-45f5-a0fe-192b1bbbb80a None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:12.961093 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec72a7a-82c2-45f5-a0fe-192b1bbbb80a None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:12.962461 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1242/2472] 10.222.0.72 () {54 vars in 961 bytes} [Mon Sep 19 15:02:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:02:12.968099 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb4bb02-1b66-4461-8183-f7969a47009e None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:12.968427 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb4bb02-1b66-4461-8183-f7969a47009e None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:12.968706 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb4bb02-1b66-4461-8183-f7969a47009e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:12.991059 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-8fb4bb02-1b66-4461-8183-f7969a47009e None None] MFA Rules not processed for user `51e7a0148db8462b8ba24bac6dd15298`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:02:12.992276 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-8fb4bb02-1b66-4461-8183-f7969a47009e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:13.059483 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1231/2473] 10.222.0.72 () {58 vars in 1058 bytes} [Mon Sep 19 15:02:12 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:02:13.067908 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec72a7a-82c2-45f5-a0fe-192b1bbbb80a None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:13.081935 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec72a7a-82c2-45f5-a0fe-192b1bbbb80a None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:13.087451 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d2fee6-fa90-4a64-a0c5-3843f148f86d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e7a0148db8462b8ba24bac6dd15298', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:13.088070 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d2fee6-fa90-4a64-a0c5-3843f148f86d service placement] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:13.088901 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d2fee6-fa90-4a64-a0c5-3843f148f86d service placement] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:13.089175 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d2fee6-fa90-4a64-a0c5-3843f148f86d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:13.090922 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-a1d2fee6-fa90-4a64-a0c5-3843f148f86d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:13.102334 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d2fee6-fa90-4a64-a0c5-3843f148f86d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:13.103928 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d2fee6-fa90-4a64-a0c5-3843f148f86d service placement] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:13.113939 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1243/2474] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 15:02:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 15:02:15.202032 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb4bb02-1b66-4461-8183-f7969a47009e None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:15.203437 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-8fb4bb02-1b66-4461-8183-f7969a47009e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:15.219714 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb4bb02-1b66-4461-8183-f7969a47009e None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:15.225228 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b514cb28-9c40-4695-8f31-1a7d20b50d6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055439dc35e946f4a82535c684f9b60d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:15.225824 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b514cb28-9c40-4695-8f31-1a7d20b50d6b service nova] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:15.226104 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b514cb28-9c40-4695-8f31-1a7d20b50d6b service nova] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:15.226383 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b514cb28-9c40-4695-8f31-1a7d20b50d6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:15.228039 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-b514cb28-9c40-4695-8f31-1a7d20b50d6b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:15.287417 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b514cb28-9c40-4695-8f31-1a7d20b50d6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:15.289048 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b514cb28-9c40-4695-8f31-1a7d20b50d6b service nova] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:15.298502 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1232/2475] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 15:02:15 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:02:18.777427 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d2fee6-fa90-4a64-a0c5-3843f148f86d service placement] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:18.787744 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d2fee6-fa90-4a64-a0c5-3843f148f86d service placement] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:18.792182 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb284bb-7ab1-45db-8d3b-ffeb4fa60421 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c2b78646374cb79ded4b7b59ba49c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:18.793545 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb284bb-7ab1-45db-8d3b-ffeb4fa60421 service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:18.793831 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb284bb-7ab1-45db-8d3b-ffeb4fa60421 service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:18.794132 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb284bb-7ab1-45db-8d3b-ffeb4fa60421 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:18.795960 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-3fb284bb-7ab1-45db-8d3b-ffeb4fa60421 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:18.806272 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb284bb-7ab1-45db-8d3b-ffeb4fa60421 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:18.807726 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb284bb-7ab1-45db-8d3b-ffeb4fa60421 service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:18.816824 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1244/2476] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 15:02:18 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:02:19.981672 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b514cb28-9c40-4695-8f31-1a7d20b50d6b service nova] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:19.991034 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b514cb28-9c40-4695-8f31-1a7d20b50d6b service nova] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:19.994546 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2248c21-881d-45c5-912a-acb4cdfb1121 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c2b78646374cb79ded4b7b59ba49c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:19.995137 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2248c21-881d-45c5-912a-acb4cdfb1121 service neutron] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:19.995417 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2248c21-881d-45c5-912a-acb4cdfb1121 service neutron] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:19.995688 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2248c21-881d-45c5-912a-acb4cdfb1121 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:19.998053 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-f2248c21-881d-45c5-912a-acb4cdfb1121 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:20.048089 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:20.076899 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2248c21-881d-45c5-912a-acb4cdfb1121 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:20.079030 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2248c21-881d-45c5-912a-acb4cdfb1121 service neutron] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:20.090441 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1233/2477] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 15:02:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:02:23.315428 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c8eec-0504-4b1a-8085-f8778956ece9 None None] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:23.315927 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c8eec-0504-4b1a-8085-f8778956ece9 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:23.316094 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c8eec-0504-4b1a-8085-f8778956ece9 None None] PATH_INFO: `/` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:23.317485 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1245/2478] 10.222.0.72 () {54 vars in 921 bytes} [Mon Sep 19 15:02:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:02:23.330751 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9d39bf-f0f3-4183-85cb-a8c0d8da9d70 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:23.331226 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9d39bf-f0f3-4183-85cb-a8c0d8da9d70 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:23.331352 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9d39bf-f0f3-4183-85cb-a8c0d8da9d70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:23.352047 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-fd9d39bf-f0f3-4183-85cb-a8c0d8da9d70 None None] MFA Rules not processed for user `51e7a0148db8462b8ba24bac6dd15298`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:02:23.353280 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-fd9d39bf-f0f3-4183-85cb-a8c0d8da9d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:23.362531 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1234/2479] 10.222.0.72 () {58 vars in 1018 bytes} [Mon Sep 19 15:02:23 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:02:23.379273 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44c8eec-0504-4b1a-8085-f8778956ece9 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:23.381257 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-d44c8eec-0504-4b1a-8085-f8778956ece9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:23.396803 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9d39bf-f0f3-4183-85cb-a8c0d8da9d70 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:23.398290 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-fd9d39bf-f0f3-4183-85cb-a8c0d8da9d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:23.399789 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44c8eec-0504-4b1a-8085-f8778956ece9 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:23.405864 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ed0851-e597-4e56-9b63-523be50584b5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e7a0148db8462b8ba24bac6dd15298', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:23.406707 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed0851-e597-4e56-9b63-523be50584b5 service placement] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:23.407175 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed0851-e597-4e56-9b63-523be50584b5 service placement] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:23.408422 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed0851-e597-4e56-9b63-523be50584b5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:23.419351 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9d39bf-f0f3-4183-85cb-a8c0d8da9d70 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:23.423605 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ed0851-e597-4e56-9b63-523be50584b5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:23.424368 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dafd040-50e3-4017-94e7-57440dc04442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:23.424850 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dafd040-50e3-4017-94e7-57440dc04442 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:23.425337 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dafd040-50e3-4017-94e7-57440dc04442 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:23.425553 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ed0851-e597-4e56-9b63-523be50584b5 service placement] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:23.425640 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dafd040-50e3-4017-94e7-57440dc04442 admin admin] PATH_INFO: `/v3/users/56875d0b48a04325a01d0d999ad186ba` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:23.426765 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dafd040-50e3-4017-94e7-57440dc04442 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56875d0b48a04325a01d0d999ad186ba)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:23.428889 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dafd040-50e3-4017-94e7-57440dc04442 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:23.431578 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:23.439832 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1246/2480] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 15:02:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:02:23.483526 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-9dafd040-50e3-4017-94e7-57440dc04442 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56875d0b48a04325a01d0d999ad186ba'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:23.496372 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-9dafd040-50e3-4017-94e7-57440dc04442 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56875d0b48a04325a01d0d999ad186ba'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:23.503400 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-9dafd040-50e3-4017-94e7-57440dc04442 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56875d0b48a04325a01d0d999ad186ba'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:23.504162 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-9dafd040-50e3-4017-94e7-57440dc04442 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56875d0b48a04325a01d0d999ad186ba'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:23.513089 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-9dafd040-50e3-4017-94e7-57440dc04442 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56875d0b48a04325a01d0d999ad186ba'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:23.519239 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1235/2481] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Sep 19 15:02:23 2022] DELETE /identity/v3/users/56875d0b48a04325a01d0d999ad186ba => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:02:23.726171 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ed0851-e597-4e56-9b63-523be50584b5 service placement] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:23.753878 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ed0851-e597-4e56-9b63-523be50584b5 service placement] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:23.843610 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d87b2e-6198-4947-8dd7-c5079c76bf56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:23.844250 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d87b2e-6198-4947-8dd7-c5079c76bf56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:23.844566 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d87b2e-6198-4947-8dd7-c5079c76bf56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:23.844843 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d87b2e-6198-4947-8dd7-c5079c76bf56 admin admin] PATH_INFO: `/v3/projects/624b56d7e2a646179bdf35f82a23b32e` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:23.845961 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d87b2e-6198-4947-8dd7-c5079c76bf56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=624b56d7e2a646179bdf35f82a23b32e)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:23.848504 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d87b2e-6198-4947-8dd7-c5079c76bf56 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:23.904755 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-24d87b2e-6198-4947-8dd7-c5079c76bf56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '624b56d7e2a646179bdf35f82a23b32e', 'request_id': 'req-24d87b2e-6198-4947-8dd7-c5079c76bf56'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:23.918692 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-24d87b2e-6198-4947-8dd7-c5079c76bf56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '624b56d7e2a646179bdf35f82a23b32e', 'request_id': 'req-24d87b2e-6198-4947-8dd7-c5079c76bf56'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:23.929592 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-24d87b2e-6198-4947-8dd7-c5079c76bf56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '624b56d7e2a646179bdf35f82a23b32e', 'request_id': 'req-24d87b2e-6198-4947-8dd7-c5079c76bf56'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:23.944190 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-24d87b2e-6198-4947-8dd7-c5079c76bf56 admin admin] The token cache is being invalidate because project 624b56d7e2a646179bdf35f82a23b32e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:02:23.944561 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-24d87b2e-6198-4947-8dd7-c5079c76bf56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:23.945994 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-24d87b2e-6198-4947-8dd7-c5079c76bf56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:23.948767 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1247/2482] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Sep 19 15:02:23 2022] DELETE /identity/v3/projects/624b56d7e2a646179bdf35f82a23b32e => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:02:23.954123 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61abd981-544a-4a5f-a2a5-654544f48362 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:23.954408 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61abd981-544a-4a5f-a2a5-654544f48362 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:23.954682 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61abd981-544a-4a5f-a2a5-654544f48362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:23.982838 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-61abd981-544a-4a5f-a2a5-654544f48362 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:02:23.984247 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-61abd981-544a-4a5f-a2a5-654544f48362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:24.069233 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1236/2483] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 15:02:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:02:24.076951 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c8460-4482-4a45-88fa-7daf7d0a54c0 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:24.077292 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c8460-4482-4a45-88fa-7daf7d0a54c0 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:24.078140 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c8460-4482-4a45-88fa-7daf7d0a54c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:24.097833 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-f73c8460-4482-4a45-88fa-7daf7d0a54c0 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:02:24.099289 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-f73c8460-4482-4a45-88fa-7daf7d0a54c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:24.111607 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1248/2484] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 15:02:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:02:24.112848 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61abd981-544a-4a5f-a2a5-654544f48362 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:24.123163 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61abd981-544a-4a5f-a2a5-654544f48362 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:24.131735 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2d7e63-5d43-49f4-80cb-6f9f5922315d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:24.132466 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d7e63-5d43-49f4-80cb-6f9f5922315d admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:24.132767 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d7e63-5d43-49f4-80cb-6f9f5922315d admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:24.133106 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d7e63-5d43-49f4-80cb-6f9f5922315d admin admin] PATH_INFO: `/v3/domains` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:24.133769 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2d7e63-5d43-49f4-80cb-6f9f5922315d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:02:24.134077 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2d7e63-5d43-49f4-80cb-6f9f5922315d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:24.135710 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2d7e63-5d43-49f4-80cb-6f9f5922315d admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:24.153470 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1237/2485] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Sep 19 15:02:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 15:02:24.155359 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73c8460-4482-4a45-88fa-7daf7d0a54c0 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:24.164833 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73c8460-4482-4a45-88fa-7daf7d0a54c0 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:24.170667 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e041ca-b695-4599-9e30-695fda7da8f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:24.171358 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e041ca-b695-4599-9e30-695fda7da8f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:24.171637 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e041ca-b695-4599-9e30-695fda7da8f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:24.171905 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e041ca-b695-4599-9e30-695fda7da8f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:24.172572 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e041ca-b695-4599-9e30-695fda7da8f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:24.174455 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e041ca-b695-4599-9e30-695fda7da8f0 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:24.205279 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1249/2486] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Sep 19 15:02:24 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:02:24.209456 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2d7e63-5d43-49f4-80cb-6f9f5922315d admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:24.220116 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2d7e63-5d43-49f4-80cb-6f9f5922315d admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:24.253571 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:24.282593 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349d2ea5-1f97-45a9-8405-99cbc7929418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:24.283142 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d2ea5-1f97-45a9-8405-99cbc7929418 admin admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:24.283411 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d2ea5-1f97-45a9-8405-99cbc7929418 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:24.283788 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d2ea5-1f97-45a9-8405-99cbc7929418 admin admin] PATH_INFO: `/v3/users` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:24.284448 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349d2ea5-1f97-45a9-8405-99cbc7929418 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:24.286347 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349d2ea5-1f97-45a9-8405-99cbc7929418 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:24.311561 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1238/2487] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Sep 19 15:02:24 2022] POST /identity/v3/users => generated 292 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 15:02:24.315524 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e041ca-b695-4599-9e30-695fda7da8f0 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:24.327126 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e041ca-b695-4599-9e30-695fda7da8f0 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:24.331809 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3577d0be-73a0-401c-af1c-07e195fc4971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:24.332437 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3577d0be-73a0-401c-af1c-07e195fc4971 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:24.336016 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3577d0be-73a0-401c-af1c-07e195fc4971 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:24.336016 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3577d0be-73a0-401c-af1c-07e195fc4971 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:24.336016 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3577d0be-73a0-401c-af1c-07e195fc4971 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:24.336016 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3577d0be-73a0-401c-af1c-07e195fc4971 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:24.346656 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1250/2488] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 15:02:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:02:24.350514 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349d2ea5-1f97-45a9-8405-99cbc7929418 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:24.361145 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349d2ea5-1f97-45a9-8405-99cbc7929418 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:24.365837 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4494e7a-9681-4ab7-a321-65300f1135e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:24.366437 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4494e7a-9681-4ab7-a321-65300f1135e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:24.366719 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4494e7a-9681-4ab7-a321-65300f1135e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:24.366994 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4494e7a-9681-4ab7-a321-65300f1135e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:24.367635 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4494e7a-9681-4ab7-a321-65300f1135e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:24.369319 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4494e7a-9681-4ab7-a321-65300f1135e1 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:24.379323 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1239/2489] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 15:02:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:02:24.383440 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3577d0be-73a0-401c-af1c-07e195fc4971 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:24.394014 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3577d0be-73a0-401c-af1c-07e195fc4971 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:24.398978 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ac501a-f54f-4901-b6b9-33d55eedbdac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:24.399612 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ac501a-f54f-4901-b6b9-33d55eedbdac admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:24.399894 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ac501a-f54f-4901-b6b9-33d55eedbdac admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:24.400165 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ac501a-f54f-4901-b6b9-33d55eedbdac admin admin] PATH_INFO: `/v3/projects/a0430aa29dc34cb5af0554167c3bbacc/users/4edcf03fc7d244608b7ff8ee15ebfc9a/roles/efa0e5b3413748dc828a89b12d67df79` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:24.415493 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ac501a-f54f-4901-b6b9-33d55eedbdac admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0430aa29dc34cb5af0554167c3bbacc, user_id=4edcf03fc7d244608b7ff8ee15ebfc9a, role_id=efa0e5b3413748dc828a89b12d67df79)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:24.418449 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ac501a-f54f-4901-b6b9-33d55eedbdac admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:24.430917 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1251/2490] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 15:02:24 2022] PUT /identity/v3/projects/a0430aa29dc34cb5af0554167c3bbacc/users/4edcf03fc7d244608b7ff8ee15ebfc9a/roles/efa0e5b3413748dc828a89b12d67df79 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:02:24.436291 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427ff7c4-e413-48e7-9994-3ca885fe2f77 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:24.436606 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427ff7c4-e413-48e7-9994-3ca885fe2f77 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:24.436880 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427ff7c4-e413-48e7-9994-3ca885fe2f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:24.456792 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-427ff7c4-e413-48e7-9994-3ca885fe2f77 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:02:24.458001 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-427ff7c4-e413-48e7-9994-3ca885fe2f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:24.517666 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1240/2491] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 15:02:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:02:24.527334 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ac501a-f54f-4901-b6b9-33d55eedbdac admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:24.529106 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-e0ac501a-f54f-4901-b6b9-33d55eedbdac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:24.559702 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:24.587901 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ac501a-f54f-4901-b6b9-33d55eedbdac admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:24.591666 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aef948b-b522-48b2-a58e-14fad0498418 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c2b78646374cb79ded4b7b59ba49c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:24.592263 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aef948b-b522-48b2-a58e-14fad0498418 service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:24.592571 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aef948b-b522-48b2-a58e-14fad0498418 service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:24.592848 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aef948b-b522-48b2-a58e-14fad0498418 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:24.601901 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aef948b-b522-48b2-a58e-14fad0498418 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:24.603324 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aef948b-b522-48b2-a58e-14fad0498418 service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:24.613395 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1252/2492] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 15:02:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:02:28.477004 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427ff7c4-e413-48e7-9994-3ca885fe2f77 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:28.481815 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-427ff7c4-e413-48e7-9994-3ca885fe2f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:28.688122 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427ff7c4-e413-48e7-9994-3ca885fe2f77 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:28.706754 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee648582-b6d6-442f-9dc0-25009731e843 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055439dc35e946f4a82535c684f9b60d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:28.707397 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee648582-b6d6-442f-9dc0-25009731e843 service nova] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:28.707823 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee648582-b6d6-442f-9dc0-25009731e843 service nova] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:28.708110 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee648582-b6d6-442f-9dc0-25009731e843 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:28.711967 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-ee648582-b6d6-442f-9dc0-25009731e843 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:28.736782 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee648582-b6d6-442f-9dc0-25009731e843 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:28.740269 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee648582-b6d6-442f-9dc0-25009731e843 service nova] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:28.762958 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1241/2493] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 15:02:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:02:29.144570 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed7a229-b8bf-459e-ae54-5d7e49cab075 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:29.145014 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed7a229-b8bf-459e-ae54-5d7e49cab075 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:29.145014 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed7a229-b8bf-459e-ae54-5d7e49cab075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:29.224221 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-0ed7a229-b8bf-459e-ae54-5d7e49cab075 None None] MFA Rules not processed for user `4edcf03fc7d244608b7ff8ee15ebfc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:02:29.227913 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-0ed7a229-b8bf-459e-ae54-5d7e49cab075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:29.341697 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1253/2494] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 15:02:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:02:29.359394 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee648582-b6d6-442f-9dc0-25009731e843 service nova] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:29.370941 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee648582-b6d6-442f-9dc0-25009731e843 service nova] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:29.389599 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3114952e-4952-42ab-b64f-ee4287d213cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055439dc35e946f4a82535c684f9b60d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:29.389599 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114952e-4952-42ab-b64f-ee4287d213cb service nova] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:29.389599 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114952e-4952-42ab-b64f-ee4287d213cb service nova] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:29.389599 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114952e-4952-42ab-b64f-ee4287d213cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:29.410219 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3114952e-4952-42ab-b64f-ee4287d213cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:29.412229 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3114952e-4952-42ab-b64f-ee4287d213cb service nova] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:29.429457 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1242/2495] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 15:02:29 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:02:31.119214 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2447e18c-6dd4-4f15-ab16-7d4d48d6248f None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:31.119743 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2447e18c-6dd4-4f15-ab16-7d4d48d6248f None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:31.119841 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2447e18c-6dd4-4f15-ab16-7d4d48d6248f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:31.146403 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-2447e18c-6dd4-4f15-ab16-7d4d48d6248f None None] MFA Rules not processed for user `4edcf03fc7d244608b7ff8ee15ebfc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:02:31.147619 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-2447e18c-6dd4-4f15-ab16-7d4d48d6248f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:31.155272 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1254/2496] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 15:02:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:02:31.498505 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3114952e-4952-42ab-b64f-ee4287d213cb service nova] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:31.509767 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3114952e-4952-42ab-b64f-ee4287d213cb service nova] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:31.515102 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b450777c-20e3-426a-a2ca-c4bcd470bd8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c2b78646374cb79ded4b7b59ba49c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:31.515730 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b450777c-20e3-426a-a2ca-c4bcd470bd8f service neutron] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:31.516009 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b450777c-20e3-426a-a2ca-c4bcd470bd8f service neutron] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:31.516283 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b450777c-20e3-426a-a2ca-c4bcd470bd8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:31.518286 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-b450777c-20e3-426a-a2ca-c4bcd470bd8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:31.529944 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b450777c-20e3-426a-a2ca-c4bcd470bd8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:31.531396 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b450777c-20e3-426a-a2ca-c4bcd470bd8f service neutron] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:31.539920 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1243/2497] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 15:02:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:02:34.800777 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2447e18c-6dd4-4f15-ab16-7d4d48d6248f None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:34.810641 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2447e18c-6dd4-4f15-ab16-7d4d48d6248f None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:34.814316 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3da2476-e7b7-4f0d-9ef0-498e75d0c0dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c2b78646374cb79ded4b7b59ba49c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:34.814912 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3da2476-e7b7-4f0d-9ef0-498e75d0c0dc service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:34.815194 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3da2476-e7b7-4f0d-9ef0-498e75d0c0dc service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:34.815501 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3da2476-e7b7-4f0d-9ef0-498e75d0c0dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:34.817316 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-f3da2476-e7b7-4f0d-9ef0-498e75d0c0dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:34.830329 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3da2476-e7b7-4f0d-9ef0-498e75d0c0dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:34.831769 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3da2476-e7b7-4f0d-9ef0-498e75d0c0dc service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:34.843208 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1255/2498] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 15:02:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:02:38.659193 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b450777c-20e3-426a-a2ca-c4bcd470bd8f service neutron] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:38.660793 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-b450777c-20e3-426a-a2ca-c4bcd470bd8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:38.676461 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b450777c-20e3-426a-a2ca-c4bcd470bd8f service neutron] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:38.680970 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097f3389-70d9-4f46-803c-1cdc172ea8bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:38.681593 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f3389-70d9-4f46-803c-1cdc172ea8bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:38.681873 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f3389-70d9-4f46-803c-1cdc172ea8bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:38.682149 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f3389-70d9-4f46-803c-1cdc172ea8bc admin admin] PATH_INFO: `/v3/users/c3773acf65044281ae7837258aefd5ad` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:38.683337 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097f3389-70d9-4f46-803c-1cdc172ea8bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3773acf65044281ae7837258aefd5ad)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:38.685282 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097f3389-70d9-4f46-803c-1cdc172ea8bc admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:38.690893 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:38.733735 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-097f3389-70d9-4f46-803c-1cdc172ea8bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3773acf65044281ae7837258aefd5ad'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:38.745507 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-097f3389-70d9-4f46-803c-1cdc172ea8bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3773acf65044281ae7837258aefd5ad'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:38.753091 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-097f3389-70d9-4f46-803c-1cdc172ea8bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3773acf65044281ae7837258aefd5ad'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:38.753766 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-097f3389-70d9-4f46-803c-1cdc172ea8bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3773acf65044281ae7837258aefd5ad'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:38.761076 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-097f3389-70d9-4f46-803c-1cdc172ea8bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3773acf65044281ae7837258aefd5ad'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:38.767749 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1244/2499] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Sep 19 15:02:38 2022] DELETE /identity/v3/users/c3773acf65044281ae7837258aefd5ad => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:02:38.944657 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3da2476-e7b7-4f0d-9ef0-498e75d0c0dc service neutron] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:38.955425 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3da2476-e7b7-4f0d-9ef0-498e75d0c0dc service neutron] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:39.013822 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fd8851-c748-493e-b5c2-0ca462ae5ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:39.014376 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fd8851-c748-493e-b5c2-0ca462ae5ef2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:39.014658 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fd8851-c748-493e-b5c2-0ca462ae5ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:39.014929 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fd8851-c748-493e-b5c2-0ca462ae5ef2 admin admin] PATH_INFO: `/v3/projects/5e4775dd038348b3aad7b520cc51b194` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:39.016028 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fd8851-c748-493e-b5c2-0ca462ae5ef2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e4775dd038348b3aad7b520cc51b194)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:39.017955 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fd8851-c748-493e-b5c2-0ca462ae5ef2 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:39.058176 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:39.065193 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-f3fd8851-c748-493e-b5c2-0ca462ae5ef2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e4775dd038348b3aad7b520cc51b194', 'request_id': 'req-f3fd8851-c748-493e-b5c2-0ca462ae5ef2'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:39.072318 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-f3fd8851-c748-493e-b5c2-0ca462ae5ef2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e4775dd038348b3aad7b520cc51b194', 'request_id': 'req-f3fd8851-c748-493e-b5c2-0ca462ae5ef2'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:39.078340 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-f3fd8851-c748-493e-b5c2-0ca462ae5ef2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e4775dd038348b3aad7b520cc51b194', 'request_id': 'req-f3fd8851-c748-493e-b5c2-0ca462ae5ef2'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:39.089393 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-f3fd8851-c748-493e-b5c2-0ca462ae5ef2 admin admin] The token cache is being invalidate because project 5e4775dd038348b3aad7b520cc51b194 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:02:39.090254 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-f3fd8851-c748-493e-b5c2-0ca462ae5ef2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:39.091103 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-f3fd8851-c748-493e-b5c2-0ca462ae5ef2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:39.092635 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1256/2500] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Sep 19 15:02:38 2022] DELETE /identity/v3/projects/5e4775dd038348b3aad7b520cc51b194 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:02:39.097643 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b976af-3900-46c8-8266-c86ee03d4a99 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:39.097932 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b976af-3900-46c8-8266-c86ee03d4a99 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:39.098208 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b976af-3900-46c8-8266-c86ee03d4a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:39.118124 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-b7b976af-3900-46c8-8266-c86ee03d4a99 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:02:39.119326 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-b7b976af-3900-46c8-8266-c86ee03d4a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:39.178593 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1245/2501] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 15:02:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:02:39.186829 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0471c6-bf95-4eb5-b76e-cd3b420a35e6 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:39.187114 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0471c6-bf95-4eb5-b76e-cd3b420a35e6 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:39.187389 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0471c6-bf95-4eb5-b76e-cd3b420a35e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:39.208049 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-db0471c6-bf95-4eb5-b76e-cd3b420a35e6 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:02:39.209288 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-db0471c6-bf95-4eb5-b76e-cd3b420a35e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:39.217883 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1257/2502] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 15:02:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:02:39.222078 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b976af-3900-46c8-8266-c86ee03d4a99 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:39.232356 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b976af-3900-46c8-8266-c86ee03d4a99 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:39.237019 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a796adf-e305-4042-97bc-61f5f8e6b033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:39.237615 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a796adf-e305-4042-97bc-61f5f8e6b033 admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:39.237892 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a796adf-e305-4042-97bc-61f5f8e6b033 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:39.238163 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a796adf-e305-4042-97bc-61f5f8e6b033 admin admin] PATH_INFO: `/v3/domains` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:39.238798 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a796adf-e305-4042-97bc-61f5f8e6b033 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:02:39.239100 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a796adf-e305-4042-97bc-61f5f8e6b033 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:39.240715 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a796adf-e305-4042-97bc-61f5f8e6b033 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:39.252460 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1246/2503] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Sep 19 15:02:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:02:39.256730 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0471c6-bf95-4eb5-b76e-cd3b420a35e6 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:39.266660 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0471c6-bf95-4eb5-b76e-cd3b420a35e6 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:39.271302 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bd9186-30e7-4e3b-939a-069cfb428b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:39.271892 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd9186-30e7-4e3b-939a-069cfb428b7e admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:39.272174 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd9186-30e7-4e3b-939a-069cfb428b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:39.272487 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd9186-30e7-4e3b-939a-069cfb428b7e admin admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:39.273119 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bd9186-30e7-4e3b-939a-069cfb428b7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:39.275323 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bd9186-30e7-4e3b-939a-069cfb428b7e admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:39.305520 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1258/2504] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Sep 19 15:02:39 2022] POST /identity/v3/projects => generated 357 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:02:39.306627 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a796adf-e305-4042-97bc-61f5f8e6b033 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:39.316661 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a796adf-e305-4042-97bc-61f5f8e6b033 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:39.373563 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe532a8-e30c-40c1-ad3b-ff4ee777ef11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:39.374172 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe532a8-e30c-40c1-ad3b-ff4ee777ef11 admin admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:39.374456 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe532a8-e30c-40c1-ad3b-ff4ee777ef11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:39.374729 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe532a8-e30c-40c1-ad3b-ff4ee777ef11 admin admin] PATH_INFO: `/v3/users` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:39.375647 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe532a8-e30c-40c1-ad3b-ff4ee777ef11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:39.377588 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe532a8-e30c-40c1-ad3b-ff4ee777ef11 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:39.400156 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1247/2505] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Sep 19 15:02:39 2022] POST /identity/v3/users => generated 279 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 15:02:39.405346 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bd9186-30e7-4e3b-939a-069cfb428b7e admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:39.417347 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bd9186-30e7-4e3b-939a-069cfb428b7e admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:39.422763 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7e3d88-c311-4571-8cde-00f5b8c76962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:39.423395 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7e3d88-c311-4571-8cde-00f5b8c76962 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:39.423675 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7e3d88-c311-4571-8cde-00f5b8c76962 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:39.424085 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7e3d88-c311-4571-8cde-00f5b8c76962 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:39.424759 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7e3d88-c311-4571-8cde-00f5b8c76962 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:39.426378 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7e3d88-c311-4571-8cde-00f5b8c76962 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:39.439094 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1259/2506] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 15:02:39 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:02:39.443458 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe532a8-e30c-40c1-ad3b-ff4ee777ef11 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:39.451323 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:39.457617 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe532a8-e30c-40c1-ad3b-ff4ee777ef11 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:39.463883 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07e088d-e9ca-42a6-a9c0-46694c66f5bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:39.464525 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e088d-e9ca-42a6-a9c0-46694c66f5bf admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:39.465427 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e088d-e9ca-42a6-a9c0-46694c66f5bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:39.465985 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e088d-e9ca-42a6-a9c0-46694c66f5bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:39.466895 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07e088d-e9ca-42a6-a9c0-46694c66f5bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:39.468894 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07e088d-e9ca-42a6-a9c0-46694c66f5bf admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:39.483612 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1248/2507] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 15:02:39 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 15:02:39.485134 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7e3d88-c311-4571-8cde-00f5b8c76962 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:39.495456 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7e3d88-c311-4571-8cde-00f5b8c76962 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:39.501577 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7744af4e-00c1-4784-892a-107824665c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:39.502243 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7744af4e-00c1-4784-892a-107824665c39 admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:39.502528 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7744af4e-00c1-4784-892a-107824665c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:39.502798 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7744af4e-00c1-4784-892a-107824665c39 admin admin] PATH_INFO: `/v3/projects/380423be565744558bdfcc3f27a7712f/users/57bd042d00b3442084dd69484bcedf43/roles/efa0e5b3413748dc828a89b12d67df79` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:39.522527 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7744af4e-00c1-4784-892a-107824665c39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=380423be565744558bdfcc3f27a7712f, user_id=57bd042d00b3442084dd69484bcedf43, role_id=efa0e5b3413748dc828a89b12d67df79)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:39.525346 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7744af4e-00c1-4784-892a-107824665c39 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:39.539957 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1260/2508] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 15:02:39 2022] PUT /identity/v3/projects/380423be565744558bdfcc3f27a7712f/users/57bd042d00b3442084dd69484bcedf43/roles/efa0e5b3413748dc828a89b12d67df79 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:02:39.550106 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992bef88-2ca1-450b-aac4-8cadbb883da8 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:39.550478 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992bef88-2ca1-450b-aac4-8cadbb883da8 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:39.550808 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992bef88-2ca1-450b-aac4-8cadbb883da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:39.588144 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-992bef88-2ca1-450b-aac4-8cadbb883da8 None None] MFA Rules not processed for user `57bd042d00b3442084dd69484bcedf43`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:02:39.589458 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-992bef88-2ca1-450b-aac4-8cadbb883da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:39.658096 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1249/2509] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 15:02:39 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:02:39.662829 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7744af4e-00c1-4784-892a-107824665c39 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:39.728576 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7744af4e-00c1-4784-892a-107824665c39 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:39.733458 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ac25d4-a979-4dfc-b5f2-eeb3a0c3a803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:39.734075 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ac25d4-a979-4dfc-b5f2-eeb3a0c3a803 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:39.734358 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ac25d4-a979-4dfc-b5f2-eeb3a0c3a803 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:39.734642 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ac25d4-a979-4dfc-b5f2-eeb3a0c3a803 admin admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:39.735480 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ac25d4-a979-4dfc-b5f2-eeb3a0c3a803 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:39.737449 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ac25d4-a979-4dfc-b5f2-eeb3a0c3a803 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:39.759459 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992bef88-2ca1-450b-aac4-8cadbb883da8 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:39.762793 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-992bef88-2ca1-450b-aac4-8cadbb883da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:39.768091 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1261/2510] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Sep 19 15:02:39 2022] POST /identity/v3/projects => generated 357 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 15:02:39.771969 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ac25d4-a979-4dfc-b5f2-eeb3a0c3a803 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:39.830177 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:39.845733 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ac25d4-a979-4dfc-b5f2-eeb3a0c3a803 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:39.850475 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e1017f-68a1-4371-a3e4-6264701414ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:39.851085 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e1017f-68a1-4371-a3e4-6264701414ea admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:39.851370 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e1017f-68a1-4371-a3e4-6264701414ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:39.851645 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e1017f-68a1-4371-a3e4-6264701414ea admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:39.852282 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e1017f-68a1-4371-a3e4-6264701414ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:39.854224 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e1017f-68a1-4371-a3e4-6264701414ea admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:39.859689 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992bef88-2ca1-450b-aac4-8cadbb883da8 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:39.877589 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1262/2511] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Sep 19 15:02:39 2022] POST /identity/v3/users => generated 285 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 15:02:39.881375 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e1017f-68a1-4371-a3e4-6264701414ea admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:39.891343 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e1017f-68a1-4371-a3e4-6264701414ea admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:39.896495 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7466522e-f117-48bd-b2dd-1869b06cf2c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:39.897098 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7466522e-f117-48bd-b2dd-1869b06cf2c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:39.897441 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7466522e-f117-48bd-b2dd-1869b06cf2c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:39.897865 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7466522e-f117-48bd-b2dd-1869b06cf2c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:39.899022 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7466522e-f117-48bd-b2dd-1869b06cf2c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:39.900695 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7466522e-f117-48bd-b2dd-1869b06cf2c5 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:39.918480 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1263/2512] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 15:02:39 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 15:02:39.923236 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7466522e-f117-48bd-b2dd-1869b06cf2c5 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:39.934790 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7466522e-f117-48bd-b2dd-1869b06cf2c5 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:39.940536 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8013ca1f-6826-431f-bbe3-d9bb320135eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:39.941190 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8013ca1f-6826-431f-bbe3-d9bb320135eb admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:39.941473 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8013ca1f-6826-431f-bbe3-d9bb320135eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:39.941771 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8013ca1f-6826-431f-bbe3-d9bb320135eb admin admin] PATH_INFO: `/v3/projects/ec6a8a711ea04e85afca4549493a91a0/users/809a90d9e7404239a2fb389dc72b5c69/roles/ddb643577b2e4e478100ec370decfaeb` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:39.942292 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734d0045-fb47-4dae-9aaf-7f00db2e308e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055439dc35e946f4a82535c684f9b60d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:39.942905 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d0045-fb47-4dae-9aaf-7f00db2e308e service nova] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:39.943187 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d0045-fb47-4dae-9aaf-7f00db2e308e service nova] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:39.943462 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d0045-fb47-4dae-9aaf-7f00db2e308e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:39.945274 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-734d0045-fb47-4dae-9aaf-7f00db2e308e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:39.963746 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734d0045-fb47-4dae-9aaf-7f00db2e308e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:39.964913 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8013ca1f-6826-431f-bbe3-d9bb320135eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec6a8a711ea04e85afca4549493a91a0, user_id=809a90d9e7404239a2fb389dc72b5c69, role_id=ddb643577b2e4e478100ec370decfaeb)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:39.965970 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734d0045-fb47-4dae-9aaf-7f00db2e308e service nova] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:39.967581 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8013ca1f-6826-431f-bbe3-d9bb320135eb admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:39.982059 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1250/2513] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 15:02:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 15:02:39.984297 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1264/2514] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 15:02:39 2022] PUT /identity/v3/projects/ec6a8a711ea04e85afca4549493a91a0/users/809a90d9e7404239a2fb389dc72b5c69/roles/ddb643577b2e4e478100ec370decfaeb => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:02:39.988434 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734d0045-fb47-4dae-9aaf-7f00db2e308e service nova] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:39.996648 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:40.002072 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734d0045-fb47-4dae-9aaf-7f00db2e308e service nova] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:40.072458 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7292cee1-cc4a-4286-84c7-3b5c054f4a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:40.073340 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7292cee1-cc4a-4286-84c7-3b5c054f4a9a admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:40.073621 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7292cee1-cc4a-4286-84c7-3b5c054f4a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:40.074419 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7292cee1-cc4a-4286-84c7-3b5c054f4a9a admin admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:40.075449 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7292cee1-cc4a-4286-84c7-3b5c054f4a9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:40.077111 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7292cee1-cc4a-4286-84c7-3b5c054f4a9a admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:40.087878 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1251/2515] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 15:02:39 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:02:40.092807 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8013ca1f-6826-431f-bbe3-d9bb320135eb admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:40.104713 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8013ca1f-6826-431f-bbe3-d9bb320135eb admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:40.116143 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4ea346-167b-40ff-9a1e-56d9940078a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:40.116891 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ea346-167b-40ff-9a1e-56d9940078a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:40.117177 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ea346-167b-40ff-9a1e-56d9940078a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:40.117453 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ea346-167b-40ff-9a1e-56d9940078a4 admin admin] PATH_INFO: `/v3/projects/ec6a8a711ea04e85afca4549493a91a0/users/809a90d9e7404239a2fb389dc72b5c69/roles/ddb643577b2e4e478100ec370decfaeb` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:40.119528 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4ea346-167b-40ff-9a1e-56d9940078a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec6a8a711ea04e85afca4549493a91a0, user_id=809a90d9e7404239a2fb389dc72b5c69, role_id=ddb643577b2e4e478100ec370decfaeb)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:40.122337 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4ea346-167b-40ff-9a1e-56d9940078a4 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:40.133078 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1265/2516] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 15:02:40 2022] PUT /identity/v3/projects/ec6a8a711ea04e85afca4549493a91a0/users/809a90d9e7404239a2fb389dc72b5c69/roles/ddb643577b2e4e478100ec370decfaeb => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:02:40.145044 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a862ee29-c680-4599-bc9a-48a11306c28b None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:40.145333 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a862ee29-c680-4599-bc9a-48a11306c28b None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:40.145625 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a862ee29-c680-4599-bc9a-48a11306c28b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:40.175115 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-a862ee29-c680-4599-bc9a-48a11306c28b None None] MFA Rules not processed for user `809a90d9e7404239a2fb389dc72b5c69`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:02:40.178209 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-a862ee29-c680-4599-bc9a-48a11306c28b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:40.248975 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1252/2517] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 15:02:40 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:02:40.260236 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4ea346-167b-40ff-9a1e-56d9940078a4 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:40.262856 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-3f4ea346-167b-40ff-9a1e-56d9940078a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:40.318933 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4ea346-167b-40ff-9a1e-56d9940078a4 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:40.322584 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412acb0b-6de7-4d1a-bec6-e46c2cd0023b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139dc7a4f1dc48fe8faea848bd1ac0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:40.323433 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412acb0b-6de7-4d1a-bec6-e46c2cd0023b service cinder] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:40.323712 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412acb0b-6de7-4d1a-bec6-e46c2cd0023b service cinder] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:40.324032 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412acb0b-6de7-4d1a-bec6-e46c2cd0023b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:40.333517 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412acb0b-6de7-4d1a-bec6-e46c2cd0023b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:40.334935 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412acb0b-6de7-4d1a-bec6-e46c2cd0023b service cinder] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:40.344505 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1266/2518] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 15:02:40 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:02:40.421264 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a862ee29-c680-4599-bc9a-48a11306c28b None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:40.431405 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a862ee29-c680-4599-bc9a-48a11306c28b None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:40.435688 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9452cdc-8234-4187-ac97-f4049421ed72 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139dc7a4f1dc48fe8faea848bd1ac0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:40.436283 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9452cdc-8234-4187-ac97-f4049421ed72 service cinder] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:40.436592 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9452cdc-8234-4187-ac97-f4049421ed72 service cinder] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:40.436865 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9452cdc-8234-4187-ac97-f4049421ed72 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:40.492276 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9452cdc-8234-4187-ac97-f4049421ed72 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:40.493732 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9452cdc-8234-4187-ac97-f4049421ed72 service cinder] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:40.502953 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1253/2519] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 15:02:40 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:02:43.308888 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412acb0b-6de7-4d1a-bec6-e46c2cd0023b service cinder] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:43.310998 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-412acb0b-6de7-4d1a-bec6-e46c2cd0023b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:43.389732 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412acb0b-6de7-4d1a-bec6-e46c2cd0023b service cinder] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:43.395304 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d5a280-01e5-43a2-b1be-1b1347a31ef1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055439dc35e946f4a82535c684f9b60d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:43.395986 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d5a280-01e5-43a2-b1be-1b1347a31ef1 service nova] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:43.396267 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d5a280-01e5-43a2-b1be-1b1347a31ef1 service nova] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:43.396570 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d5a280-01e5-43a2-b1be-1b1347a31ef1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:43.398320 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-90d5a280-01e5-43a2-b1be-1b1347a31ef1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:43.410867 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d5a280-01e5-43a2-b1be-1b1347a31ef1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:43.412570 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d5a280-01e5-43a2-b1be-1b1347a31ef1 service nova] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:43.423481 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1267/2520] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 15:02:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:02:50.047552 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d837e8f9-0df6-4a94-88e0-68092699edd7 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:50.048024 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d837e8f9-0df6-4a94-88e0-68092699edd7 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:50.048121 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d837e8f9-0df6-4a94-88e0-68092699edd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:50.069459 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-d837e8f9-0df6-4a94-88e0-68092699edd7 None None] MFA Rules not processed for user `afbbbf11f3234297ab1dd509f064480f`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:02:50.070773 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-d837e8f9-0df6-4a94-88e0-68092699edd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:50.092525 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:50.133288 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1254/2521] 10.222.0.72 () {58 vars in 1009 bytes} [Mon Sep 19 15:02:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 15:02:50.146436 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d5a280-01e5-43a2-b1be-1b1347a31ef1 service nova] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:50.148040 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-90d5a280-01e5-43a2-b1be-1b1347a31ef1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:50.174141 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:50.248049 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d5a280-01e5-43a2-b1be-1b1347a31ef1 service nova] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:50.254309 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193fde9f-8102-4275-9865-42d6eb6065a9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8504425c3a414608b030d0cf1af78af5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:50.255006 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193fde9f-8102-4275-9865-42d6eb6065a9 service swift] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:50.255283 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193fde9f-8102-4275-9865-42d6eb6065a9 service swift] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:50.255568 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193fde9f-8102-4275-9865-42d6eb6065a9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:50.265671 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193fde9f-8102-4275-9865-42d6eb6065a9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:50.267504 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193fde9f-8102-4275-9865-42d6eb6065a9 service swift] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:50.277524 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1268/2522] 10.222.0.72 () {60 vars in 1384 bytes} [Mon Sep 19 15:02:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 15:02:56.105766 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d837e8f9-0df6-4a94-88e0-68092699edd7 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:56.180577 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d837e8f9-0df6-4a94-88e0-68092699edd7 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:56.185546 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaee097-d951-4021-bccc-9cb5cdc37bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:56.186405 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaee097-d951-4021-bccc-9cb5cdc37bd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:56.186845 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaee097-d951-4021-bccc-9cb5cdc37bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:56.187288 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaee097-d951-4021-bccc-9cb5cdc37bd1 admin admin] PATH_INFO: `/v3/users/57bd042d00b3442084dd69484bcedf43` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:56.188842 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaee097-d951-4021-bccc-9cb5cdc37bd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57bd042d00b3442084dd69484bcedf43)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:56.190970 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaee097-d951-4021-bccc-9cb5cdc37bd1 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:56.256723 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-1eaee097-d951-4021-bccc-9cb5cdc37bd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57bd042d00b3442084dd69484bcedf43'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:56.285230 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-1eaee097-d951-4021-bccc-9cb5cdc37bd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57bd042d00b3442084dd69484bcedf43'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:56.295761 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-1eaee097-d951-4021-bccc-9cb5cdc37bd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57bd042d00b3442084dd69484bcedf43'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:56.296545 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-1eaee097-d951-4021-bccc-9cb5cdc37bd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57bd042d00b3442084dd69484bcedf43'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:56.306962 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-1eaee097-d951-4021-bccc-9cb5cdc37bd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57bd042d00b3442084dd69484bcedf43'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:56.317692 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1255/2523] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Sep 19 15:02:56 2022] DELETE /identity/v3/users/57bd042d00b3442084dd69484bcedf43 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:02:56.322341 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1278519-27f9-4ec8-9ad8-f9c3d5f901c3 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:56.322867 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1278519-27f9-4ec8-9ad8-f9c3d5f901c3 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:56.323231 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1278519-27f9-4ec8-9ad8-f9c3d5f901c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:56.353184 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-d1278519-27f9-4ec8-9ad8-f9c3d5f901c3 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:02:56.355352 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-d1278519-27f9-4ec8-9ad8-f9c3d5f901c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:56.435854 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1269/2524] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 15:02:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 15:02:56.446086 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaee097-d951-4021-bccc-9cb5cdc37bd1 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:56.449345 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-1eaee097-d951-4021-bccc-9cb5cdc37bd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:56.520374 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:56.524802 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaee097-d951-4021-bccc-9cb5cdc37bd1 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:56.530471 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4abc799-33e7-4cf2-8c4c-bcb6cc5676f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c2b78646374cb79ded4b7b59ba49c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:56.531423 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4abc799-33e7-4cf2-8c4c-bcb6cc5676f7 service neutron] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:56.532146 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4abc799-33e7-4cf2-8c4c-bcb6cc5676f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:56.532826 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4abc799-33e7-4cf2-8c4c-bcb6cc5676f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:56.544944 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4abc799-33e7-4cf2-8c4c-bcb6cc5676f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:56.546644 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4abc799-33e7-4cf2-8c4c-bcb6cc5676f7 service neutron] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:56.557289 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1256/2525] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 15:02:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:02:56.901045 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1278519-27f9-4ec8-9ad8-f9c3d5f901c3 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:56.902974 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-d1278519-27f9-4ec8-9ad8-f9c3d5f901c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:56.917020 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1278519-27f9-4ec8-9ad8-f9c3d5f901c3 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:56.929202 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e4f7b7-154b-46e5-94fa-cac9b564d70c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:56.929392 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e4f7b7-154b-46e5-94fa-cac9b564d70c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:56.929618 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e4f7b7-154b-46e5-94fa-cac9b564d70c admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:56.929891 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e4f7b7-154b-46e5-94fa-cac9b564d70c admin admin] PATH_INFO: `/v3/projects/380423be565744558bdfcc3f27a7712f` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:56.931103 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e4f7b7-154b-46e5-94fa-cac9b564d70c admin admin] RBAC: Authorizing `identity:delete_project(project_id=380423be565744558bdfcc3f27a7712f)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:56.933648 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e4f7b7-154b-46e5-94fa-cac9b564d70c admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:56.988045 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-c4e4f7b7-154b-46e5-94fa-cac9b564d70c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '380423be565744558bdfcc3f27a7712f', 'request_id': 'req-c4e4f7b7-154b-46e5-94fa-cac9b564d70c'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:56.997593 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-c4e4f7b7-154b-46e5-94fa-cac9b564d70c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '380423be565744558bdfcc3f27a7712f', 'request_id': 'req-c4e4f7b7-154b-46e5-94fa-cac9b564d70c'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:57.006071 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-c4e4f7b7-154b-46e5-94fa-cac9b564d70c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '380423be565744558bdfcc3f27a7712f', 'request_id': 'req-c4e4f7b7-154b-46e5-94fa-cac9b564d70c'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:57.022771 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-c4e4f7b7-154b-46e5-94fa-cac9b564d70c admin admin] The token cache is being invalidate because project 380423be565744558bdfcc3f27a7712f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:02:57.022771 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-c4e4f7b7-154b-46e5-94fa-cac9b564d70c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:57.023951 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-c4e4f7b7-154b-46e5-94fa-cac9b564d70c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:57.029916 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1270/2526] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Sep 19 15:02:56 2022] DELETE /identity/v3/projects/380423be565744558bdfcc3f27a7712f => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:02:57.030938 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4abc799-33e7-4cf2-8c4c-bcb6cc5676f7 service neutron] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:57.044175 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4abc799-33e7-4cf2-8c4c-bcb6cc5676f7 service neutron] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:57.114005 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e119a3b5-2adc-4461-b1d6-519622a8ef88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:57.114734 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e119a3b5-2adc-4461-b1d6-519622a8ef88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:57.115097 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e119a3b5-2adc-4461-b1d6-519622a8ef88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:57.115661 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e119a3b5-2adc-4461-b1d6-519622a8ef88 admin admin] PATH_INFO: `/v3/users/809a90d9e7404239a2fb389dc72b5c69` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:57.117014 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e119a3b5-2adc-4461-b1d6-519622a8ef88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=809a90d9e7404239a2fb389dc72b5c69)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:57.119051 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e119a3b5-2adc-4461-b1d6-519622a8ef88 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:57.182412 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-e119a3b5-2adc-4461-b1d6-519622a8ef88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '809a90d9e7404239a2fb389dc72b5c69'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:57.202435 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-e119a3b5-2adc-4461-b1d6-519622a8ef88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '809a90d9e7404239a2fb389dc72b5c69'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:57.212150 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-e119a3b5-2adc-4461-b1d6-519622a8ef88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '809a90d9e7404239a2fb389dc72b5c69'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:57.212977 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-e119a3b5-2adc-4461-b1d6-519622a8ef88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '809a90d9e7404239a2fb389dc72b5c69'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:57.221742 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-e119a3b5-2adc-4461-b1d6-519622a8ef88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '809a90d9e7404239a2fb389dc72b5c69'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:57.228412 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1257/2527] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Sep 19 15:02:57 2022] DELETE /identity/v3/users/809a90d9e7404239a2fb389dc72b5c69 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:02:57.558975 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e4f7b7-154b-46e5-94fa-cac9b564d70c admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:57.560581 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-c4e4f7b7-154b-46e5-94fa-cac9b564d70c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:57.581251 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e4f7b7-154b-46e5-94fa-cac9b564d70c admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:57.638764 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:57.682827 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c038fb9f-d34f-46bd-9697-c7459add98f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:57.683528 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c038fb9f-d34f-46bd-9697-c7459add98f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:57.683808 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c038fb9f-d34f-46bd-9697-c7459add98f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:57.684088 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c038fb9f-d34f-46bd-9697-c7459add98f9 admin admin] PATH_INFO: `/v3/projects/ec6a8a711ea04e85afca4549493a91a0` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:57.685431 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c038fb9f-d34f-46bd-9697-c7459add98f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec6a8a711ea04e85afca4549493a91a0)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:57.687386 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c038fb9f-d34f-46bd-9697-c7459add98f9 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:57.758632 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-c038fb9f-d34f-46bd-9697-c7459add98f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec6a8a711ea04e85afca4549493a91a0', 'request_id': 'req-c038fb9f-d34f-46bd-9697-c7459add98f9'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:57.768793 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-c038fb9f-d34f-46bd-9697-c7459add98f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec6a8a711ea04e85afca4549493a91a0', 'request_id': 'req-c038fb9f-d34f-46bd-9697-c7459add98f9'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:57.775551 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-c038fb9f-d34f-46bd-9697-c7459add98f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec6a8a711ea04e85afca4549493a91a0', 'request_id': 'req-c038fb9f-d34f-46bd-9697-c7459add98f9'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:57.791330 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-c038fb9f-d34f-46bd-9697-c7459add98f9 admin admin] The token cache is being invalidate because project ec6a8a711ea04e85afca4549493a91a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:02:57.791645 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-c038fb9f-d34f-46bd-9697-c7459add98f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:57.792922 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-c038fb9f-d34f-46bd-9697-c7459add98f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:57.794606 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1271/2528] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Sep 19 15:02:57 2022] DELETE /identity/v3/projects/ec6a8a711ea04e85afca4549493a91a0 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:02:57.799441 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed02120-431d-4100-b5e3-af2998fdb395 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:57.799726 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed02120-431d-4100-b5e3-af2998fdb395 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:57.800055 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed02120-431d-4100-b5e3-af2998fdb395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:57.826504 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-0ed02120-431d-4100-b5e3-af2998fdb395 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:02:57.828052 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-0ed02120-431d-4100-b5e3-af2998fdb395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:57.922472 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1258/2529] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 15:02:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 15:02:57.930671 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae33d6da-dd2a-48c2-b8d4-b602c4c30c6b None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:57.930997 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae33d6da-dd2a-48c2-b8d4-b602c4c30c6b None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:57.931281 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae33d6da-dd2a-48c2-b8d4-b602c4c30c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:57.954178 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-ae33d6da-dd2a-48c2-b8d4-b602c4c30c6b None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:02:57.955545 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-ae33d6da-dd2a-48c2-b8d4-b602c4c30c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:57.965114 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1272/2530] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 15:02:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:02:57.969386 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed02120-431d-4100-b5e3-af2998fdb395 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:57.981329 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed02120-431d-4100-b5e3-af2998fdb395 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:57.986230 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec3cfbf-feb5-4ca0-b47d-8567618fc924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:57.986911 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec3cfbf-feb5-4ca0-b47d-8567618fc924 admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:57.987264 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec3cfbf-feb5-4ca0-b47d-8567618fc924 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:57.987627 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec3cfbf-feb5-4ca0-b47d-8567618fc924 admin admin] PATH_INFO: `/v3/domains` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:57.988362 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec3cfbf-feb5-4ca0-b47d-8567618fc924 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:02:57.988877 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec3cfbf-feb5-4ca0-b47d-8567618fc924 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:57.990522 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec3cfbf-feb5-4ca0-b47d-8567618fc924 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:58.001749 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:58.013282 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1259/2531] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Sep 19 15:02:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:02:58.015668 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae33d6da-dd2a-48c2-b8d4-b602c4c30c6b None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:58.027308 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae33d6da-dd2a-48c2-b8d4-b602c4c30c6b None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:58.032740 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb87f1c-e895-453f-88f3-4429bddb3508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:58.033557 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb87f1c-e895-453f-88f3-4429bddb3508 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:58.034025 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb87f1c-e895-453f-88f3-4429bddb3508 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:58.034484 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb87f1c-e895-453f-88f3-4429bddb3508 admin admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:58.035298 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb87f1c-e895-453f-88f3-4429bddb3508 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:58.037438 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb87f1c-e895-453f-88f3-4429bddb3508 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:58.073251 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1273/2532] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Sep 19 15:02:58 2022] POST /identity/v3/projects => generated 387 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:02:58.074961 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec3cfbf-feb5-4ca0-b47d-8567618fc924 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:58.087986 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec3cfbf-feb5-4ca0-b47d-8567618fc924 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:58.161605 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1ad7ee-d9b4-4938-8338-dc9a1a0a2a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:58.162299 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1ad7ee-d9b4-4938-8338-dc9a1a0a2a11 admin admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:58.162653 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1ad7ee-d9b4-4938-8338-dc9a1a0a2a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:58.163042 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1ad7ee-d9b4-4938-8338-dc9a1a0a2a11 admin admin] PATH_INFO: `/v3/users` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:58.163739 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1ad7ee-d9b4-4938-8338-dc9a1a0a2a11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:58.165747 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1ad7ee-d9b4-4938-8338-dc9a1a0a2a11 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:58.192872 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1260/2533] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Sep 19 15:02:58 2022] POST /identity/v3/users => generated 294 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:02:58.196930 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb87f1c-e895-453f-88f3-4429bddb3508 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:58.209104 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb87f1c-e895-453f-88f3-4429bddb3508 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:58.216558 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f0ba0c-faf9-4a8c-b0f5-171043fb4827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:58.217289 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f0ba0c-faf9-4a8c-b0f5-171043fb4827 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:58.217764 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f0ba0c-faf9-4a8c-b0f5-171043fb4827 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:58.218105 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f0ba0c-faf9-4a8c-b0f5-171043fb4827 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:58.218834 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f0ba0c-faf9-4a8c-b0f5-171043fb4827 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:58.220560 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f0ba0c-faf9-4a8c-b0f5-171043fb4827 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:58.235666 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1274/2534] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 15:02:58 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 15:02:58.237087 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1ad7ee-d9b4-4938-8338-dc9a1a0a2a11 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:58.249471 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1ad7ee-d9b4-4938-8338-dc9a1a0a2a11 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:58.254389 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ec7756-bd78-429d-934b-d7d02cfe0d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:58.254998 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ec7756-bd78-429d-934b-d7d02cfe0d30 admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:58.255278 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ec7756-bd78-429d-934b-d7d02cfe0d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:58.255550 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ec7756-bd78-429d-934b-d7d02cfe0d30 admin admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:58.256296 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ec7756-bd78-429d-934b-d7d02cfe0d30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:58.257913 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ec7756-bd78-429d-934b-d7d02cfe0d30 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:58.273470 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1261/2535] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 15:02:58 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:02:58.274653 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f0ba0c-faf9-4a8c-b0f5-171043fb4827 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:58.286205 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f0ba0c-faf9-4a8c-b0f5-171043fb4827 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:58.291339 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9624f27-ba68-4a6c-8c0a-0d6b169364cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:58.292005 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9624f27-ba68-4a6c-8c0a-0d6b169364cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:58.293274 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9624f27-ba68-4a6c-8c0a-0d6b169364cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:58.293559 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9624f27-ba68-4a6c-8c0a-0d6b169364cd admin admin] PATH_INFO: `/v3/projects/4f52ecaae4cf4452954256c41f362793/users/65fba3eece154295b640f3d319b94739/roles/efa0e5b3413748dc828a89b12d67df79` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:58.310519 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9624f27-ba68-4a6c-8c0a-0d6b169364cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f52ecaae4cf4452954256c41f362793, user_id=65fba3eece154295b640f3d319b94739, role_id=efa0e5b3413748dc828a89b12d67df79)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:58.313335 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9624f27-ba68-4a6c-8c0a-0d6b169364cd admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:58.331516 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1275/2536] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 15:02:58 2022] PUT /identity/v3/projects/4f52ecaae4cf4452954256c41f362793/users/65fba3eece154295b640f3d319b94739/roles/efa0e5b3413748dc828a89b12d67df79 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:02:58.343614 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fcb955-64d3-4836-b033-622d7db76f67 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:58.343911 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fcb955-64d3-4836-b033-622d7db76f67 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:58.344197 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fcb955-64d3-4836-b033-622d7db76f67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:58.374613 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-20fcb955-64d3-4836-b033-622d7db76f67 None None] MFA Rules not processed for user `65fba3eece154295b640f3d319b94739`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:02:58.375924 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-20fcb955-64d3-4836-b033-622d7db76f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:58.453133 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1262/2537] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 15:02:58 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:02:58.457928 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9624f27-ba68-4a6c-8c0a-0d6b169364cd admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:58.531552 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9624f27-ba68-4a6c-8c0a-0d6b169364cd admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:58.536636 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa40606-e36a-40a1-9ca2-f049e749b144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:58.537348 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa40606-e36a-40a1-9ca2-f049e749b144 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:58.537635 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa40606-e36a-40a1-9ca2-f049e749b144 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:58.537910 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa40606-e36a-40a1-9ca2-f049e749b144 admin admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:58.538559 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa40606-e36a-40a1-9ca2-f049e749b144 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:58.540597 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa40606-e36a-40a1-9ca2-f049e749b144 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:58.546209 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:58.577820 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1276/2538] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Sep 19 15:02:58 2022] POST /identity/v3/projects => generated 387 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:02:58.579092 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fcb955-64d3-4836-b033-622d7db76f67 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:58.597744 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fcb955-64d3-4836-b033-622d7db76f67 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:58.691746 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605c8f74-b21e-4fd9-8144-5892af3d4bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:58.692795 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c8f74-b21e-4fd9-8144-5892af3d4bbb admin admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:58.693319 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c8f74-b21e-4fd9-8144-5892af3d4bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:58.693590 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c8f74-b21e-4fd9-8144-5892af3d4bbb admin admin] PATH_INFO: `/v3/users` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:58.694236 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605c8f74-b21e-4fd9-8144-5892af3d4bbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:58.696152 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605c8f74-b21e-4fd9-8144-5892af3d4bbb admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:58.708898 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:58.732366 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1263/2539] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Sep 19 15:02:58 2022] POST /identity/v3/users => generated 300 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 15:02:58.734646 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa40606-e36a-40a1-9ca2-f049e749b144 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:58.747282 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa40606-e36a-40a1-9ca2-f049e749b144 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:58.752903 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d405694b-b4ca-489a-ad96-68dd39fe9187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:58.753600 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d405694b-b4ca-489a-ad96-68dd39fe9187 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:58.753879 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d405694b-b4ca-489a-ad96-68dd39fe9187 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:58.754147 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d405694b-b4ca-489a-ad96-68dd39fe9187 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:58.754873 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d405694b-b4ca-489a-ad96-68dd39fe9187 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:58.757146 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d405694b-b4ca-489a-ad96-68dd39fe9187 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:58.772505 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1277/2540] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 15:02:58 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:02:58.774139 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605c8f74-b21e-4fd9-8144-5892af3d4bbb admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:58.786470 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605c8f74-b21e-4fd9-8144-5892af3d4bbb admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:58.791332 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11923f42-02f8-4808-9fe7-22193cdd1cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:58.792001 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11923f42-02f8-4808-9fe7-22193cdd1cfd admin admin] REQUEST_METHOD: `PUT` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:58.792941 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11923f42-02f8-4808-9fe7-22193cdd1cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:58.793226 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11923f42-02f8-4808-9fe7-22193cdd1cfd admin admin] PATH_INFO: `/v3/projects/c32f70e9d4eb4e6abaf9897514c45f17/users/d6f14eabda90479fbde0d296cc9ab5a6/roles/ddb643577b2e4e478100ec370decfaeb` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:58.812679 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11923f42-02f8-4808-9fe7-22193cdd1cfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c32f70e9d4eb4e6abaf9897514c45f17, user_id=d6f14eabda90479fbde0d296cc9ab5a6, role_id=ddb643577b2e4e478100ec370decfaeb)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:58.815528 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11923f42-02f8-4808-9fe7-22193cdd1cfd admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:58.840211 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d405694b-b4ca-489a-ad96-68dd39fe9187 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:58.848707 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1264/2541] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 15:02:58 2022] PUT /identity/v3/projects/c32f70e9d4eb4e6abaf9897514c45f17/users/d6f14eabda90479fbde0d296cc9ab5a6/roles/ddb643577b2e4e478100ec370decfaeb => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:02:58.852343 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d405694b-b4ca-489a-ad96-68dd39fe9187 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:58.939477 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a12adf-2e16-4af8-a1bf-4ee6bbe9d756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:58.940109 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a12adf-2e16-4af8-a1bf-4ee6bbe9d756 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:58.940420 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a12adf-2e16-4af8-a1bf-4ee6bbe9d756 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:58.940722 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a12adf-2e16-4af8-a1bf-4ee6bbe9d756 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:58.941518 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a12adf-2e16-4af8-a1bf-4ee6bbe9d756 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:58.943123 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a12adf-2e16-4af8-a1bf-4ee6bbe9d756 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:58.959160 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11923f42-02f8-4808-9fe7-22193cdd1cfd admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:58.960295 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1278/2542] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 15:02:58 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:02:58.973459 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11923f42-02f8-4808-9fe7-22193cdd1cfd admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:58.978833 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019cf165-8e84-4b6f-be59-064234790e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:58.979636 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019cf165-8e84-4b6f-be59-064234790e2f admin admin] REQUEST_METHOD: `PUT` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:58.980601 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019cf165-8e84-4b6f-be59-064234790e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:58.980875 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019cf165-8e84-4b6f-be59-064234790e2f admin admin] PATH_INFO: `/v3/projects/c32f70e9d4eb4e6abaf9897514c45f17/users/d6f14eabda90479fbde0d296cc9ab5a6/roles/ddb643577b2e4e478100ec370decfaeb` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:58.983124 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019cf165-8e84-4b6f-be59-064234790e2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c32f70e9d4eb4e6abaf9897514c45f17, user_id=d6f14eabda90479fbde0d296cc9ab5a6, role_id=ddb643577b2e4e478100ec370decfaeb)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:58.986140 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019cf165-8e84-4b6f-be59-064234790e2f admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:59.001627 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1265/2543] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 15:02:58 2022] PUT /identity/v3/projects/c32f70e9d4eb4e6abaf9897514c45f17/users/d6f14eabda90479fbde0d296cc9ab5a6/roles/ddb643577b2e4e478100ec370decfaeb => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:02:59.012059 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46afa15-9c6d-4c77-a6d8-5f77013870b7 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:59.012388 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46afa15-9c6d-4c77-a6d8-5f77013870b7 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:59.012672 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46afa15-9c6d-4c77-a6d8-5f77013870b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:59.044903 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-e46afa15-9c6d-4c77-a6d8-5f77013870b7 None None] MFA Rules not processed for user `d6f14eabda90479fbde0d296cc9ab5a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:02:59.046533 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-e46afa15-9c6d-4c77-a6d8-5f77013870b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:59.127406 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1279/2544] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 15:02:59 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:02:59.138832 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019cf165-8e84-4b6f-be59-064234790e2f admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:59.140675 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-019cf165-8e84-4b6f-be59-064234790e2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:59.213072 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019cf165-8e84-4b6f-be59-064234790e2f admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:59.217145 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b5fc22-0d88-4d16-a733-55da3a663eb7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139dc7a4f1dc48fe8faea848bd1ac0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:59.217962 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b5fc22-0d88-4d16-a733-55da3a663eb7 service cinder] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:59.218241 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b5fc22-0d88-4d16-a733-55da3a663eb7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:59.218507 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b5fc22-0d88-4d16-a733-55da3a663eb7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:59.229341 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b5fc22-0d88-4d16-a733-55da3a663eb7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:59.231264 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b5fc22-0d88-4d16-a733-55da3a663eb7 service cinder] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:59.241503 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1266/2545] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 15:02:59 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:02:59.271520 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46afa15-9c6d-4c77-a6d8-5f77013870b7 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:59.335443 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:59.347744 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46afa15-9c6d-4c77-a6d8-5f77013870b7 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:59.352797 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7cdf94-408a-4222-b9e7-054212d2efcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:59.353616 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7cdf94-408a-4222-b9e7-054212d2efcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:59.353898 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7cdf94-408a-4222-b9e7-054212d2efcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:59.354171 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7cdf94-408a-4222-b9e7-054212d2efcc admin admin] PATH_INFO: `/v3/users/65fba3eece154295b640f3d319b94739` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:59.356455 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7cdf94-408a-4222-b9e7-054212d2efcc admin admin] RBAC: Authorizing `identity:delete_user(user_id=65fba3eece154295b640f3d319b94739)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:59.358471 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7cdf94-408a-4222-b9e7-054212d2efcc admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:59.413127 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-4f7cdf94-408a-4222-b9e7-054212d2efcc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65fba3eece154295b640f3d319b94739'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:59.425962 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-4f7cdf94-408a-4222-b9e7-054212d2efcc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65fba3eece154295b640f3d319b94739'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:59.433246 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-4f7cdf94-408a-4222-b9e7-054212d2efcc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65fba3eece154295b640f3d319b94739'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:59.440914 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-4f7cdf94-408a-4222-b9e7-054212d2efcc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65fba3eece154295b640f3d319b94739'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:59.441568 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-4f7cdf94-408a-4222-b9e7-054212d2efcc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65fba3eece154295b640f3d319b94739'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:59.449439 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1280/2546] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Sep 19 15:02:59 2022] DELETE /identity/v3/users/65fba3eece154295b640f3d319b94739 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:02:59.454008 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58b7ffa-f16f-49c7-af9b-3d0e5dfb4b24 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:59.454369 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58b7ffa-f16f-49c7-af9b-3d0e5dfb4b24 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:59.454825 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58b7ffa-f16f-49c7-af9b-3d0e5dfb4b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:59.474590 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-e58b7ffa-f16f-49c7-af9b-3d0e5dfb4b24 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:02:59.475999 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-e58b7ffa-f16f-49c7-af9b-3d0e5dfb4b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:59.537193 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1267/2547] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 15:02:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 15:02:59.546760 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7cdf94-408a-4222-b9e7-054212d2efcc admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:59.548147 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-4f7cdf94-408a-4222-b9e7-054212d2efcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:59.605869 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7cdf94-408a-4222-b9e7-054212d2efcc admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:59.609542 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37a7064-c82f-494d-adcd-393ab6455c6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c2b78646374cb79ded4b7b59ba49c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:59.610143 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a7064-c82f-494d-adcd-393ab6455c6c service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:59.610451 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a7064-c82f-494d-adcd-393ab6455c6c service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:59.610724 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a7064-c82f-494d-adcd-393ab6455c6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:59.619664 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37a7064-c82f-494d-adcd-393ab6455c6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:59.621215 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37a7064-c82f-494d-adcd-393ab6455c6c service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:59.630585 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1281/2548] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 15:02:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:02:59.893948 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58b7ffa-f16f-49c7-af9b-3d0e5dfb4b24 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:59.895611 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-e58b7ffa-f16f-49c7-af9b-3d0e5dfb4b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:59.910127 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58b7ffa-f16f-49c7-af9b-3d0e5dfb4b24 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:59.914607 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21173ffe-8a78-49f1-b12b-08e2c8083577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:59.915775 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21173ffe-8a78-49f1-b12b-08e2c8083577 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:59.916226 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21173ffe-8a78-49f1-b12b-08e2c8083577 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:59.916549 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21173ffe-8a78-49f1-b12b-08e2c8083577 admin admin] PATH_INFO: `/v3/projects/4f52ecaae4cf4452954256c41f362793` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:59.917711 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21173ffe-8a78-49f1-b12b-08e2c8083577 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f52ecaae4cf4452954256c41f362793)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:59.920279 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21173ffe-8a78-49f1-b12b-08e2c8083577 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:59.969779 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-21173ffe-8a78-49f1-b12b-08e2c8083577 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f52ecaae4cf4452954256c41f362793', 'request_id': 'req-21173ffe-8a78-49f1-b12b-08e2c8083577'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:59.976445 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-21173ffe-8a78-49f1-b12b-08e2c8083577 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f52ecaae4cf4452954256c41f362793', 'request_id': 'req-21173ffe-8a78-49f1-b12b-08e2c8083577'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:59.977557 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:59.984800 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-21173ffe-8a78-49f1-b12b-08e2c8083577 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f52ecaae4cf4452954256c41f362793', 'request_id': 'req-21173ffe-8a78-49f1-b12b-08e2c8083577'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:59.996578 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-21173ffe-8a78-49f1-b12b-08e2c8083577 admin admin] The token cache is being invalidate because project 4f52ecaae4cf4452954256c41f362793 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:02:59.996870 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-21173ffe-8a78-49f1-b12b-08e2c8083577 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:59.997536 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-21173ffe-8a78-49f1-b12b-08e2c8083577 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:59.999169 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1268/2549] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Sep 19 15:02:59 2022] DELETE /identity/v3/projects/4f52ecaae4cf4452954256c41f362793 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:03:00.003128 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37a7064-c82f-494d-adcd-393ab6455c6c service neutron] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:00.013653 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37a7064-c82f-494d-adcd-393ab6455c6c service neutron] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:00.071963 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8aa80d-c58d-46bd-bf63-406d1a02a982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:00.073338 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8aa80d-c58d-46bd-bf63-406d1a02a982 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:00.073338 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8aa80d-c58d-46bd-bf63-406d1a02a982 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:00.074234 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8aa80d-c58d-46bd-bf63-406d1a02a982 admin admin] PATH_INFO: `/v3/users/d6f14eabda90479fbde0d296cc9ab5a6` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:00.075279 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8aa80d-c58d-46bd-bf63-406d1a02a982 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6f14eabda90479fbde0d296cc9ab5a6)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:00.077228 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8aa80d-c58d-46bd-bf63-406d1a02a982 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:00.100288 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:03:00.128794 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-1f8aa80d-c58d-46bd-bf63-406d1a02a982 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6f14eabda90479fbde0d296cc9ab5a6'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:00.140732 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-1f8aa80d-c58d-46bd-bf63-406d1a02a982 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6f14eabda90479fbde0d296cc9ab5a6'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:00.147709 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-1f8aa80d-c58d-46bd-bf63-406d1a02a982 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6f14eabda90479fbde0d296cc9ab5a6'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:00.155022 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-1f8aa80d-c58d-46bd-bf63-406d1a02a982 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6f14eabda90479fbde0d296cc9ab5a6'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:00.155814 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-1f8aa80d-c58d-46bd-bf63-406d1a02a982 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6f14eabda90479fbde0d296cc9ab5a6'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:00.163543 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1282/2550] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Sep 19 15:03:00 2022] DELETE /identity/v3/users/d6f14eabda90479fbde0d296cc9ab5a6 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:03:00.584527 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21173ffe-8a78-49f1-b12b-08e2c8083577 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:00.586131 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-21173ffe-8a78-49f1-b12b-08e2c8083577 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:00.599331 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21173ffe-8a78-49f1-b12b-08e2c8083577 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:00.659192 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f28b8c-130c-42f0-a52c-7d9fa9e48e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:00.659839 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f28b8c-130c-42f0-a52c-7d9fa9e48e95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:00.660121 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f28b8c-130c-42f0-a52c-7d9fa9e48e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:00.660422 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f28b8c-130c-42f0-a52c-7d9fa9e48e95 admin admin] PATH_INFO: `/v3/projects/c32f70e9d4eb4e6abaf9897514c45f17` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:00.661571 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f28b8c-130c-42f0-a52c-7d9fa9e48e95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c32f70e9d4eb4e6abaf9897514c45f17)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:00.663539 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f28b8c-130c-42f0-a52c-7d9fa9e48e95 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:00.712731 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-11f28b8c-130c-42f0-a52c-7d9fa9e48e95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c32f70e9d4eb4e6abaf9897514c45f17', 'request_id': 'req-11f28b8c-130c-42f0-a52c-7d9fa9e48e95'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:00.721398 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-11f28b8c-130c-42f0-a52c-7d9fa9e48e95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c32f70e9d4eb4e6abaf9897514c45f17', 'request_id': 'req-11f28b8c-130c-42f0-a52c-7d9fa9e48e95'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:00.728002 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-11f28b8c-130c-42f0-a52c-7d9fa9e48e95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c32f70e9d4eb4e6abaf9897514c45f17', 'request_id': 'req-11f28b8c-130c-42f0-a52c-7d9fa9e48e95'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:00.739130 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-11f28b8c-130c-42f0-a52c-7d9fa9e48e95 admin admin] The token cache is being invalidate because project c32f70e9d4eb4e6abaf9897514c45f17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:03:00.739418 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-11f28b8c-130c-42f0-a52c-7d9fa9e48e95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:00.740058 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-11f28b8c-130c-42f0-a52c-7d9fa9e48e95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:00.741573 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1269/2551] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Sep 19 15:03:00 2022] DELETE /identity/v3/projects/c32f70e9d4eb4e6abaf9897514c45f17 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:03:00.746750 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c76869-75df-4e89-b19b-1d4b12ba0fca None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:00.747222 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c76869-75df-4e89-b19b-1d4b12ba0fca None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:00.747320 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c76869-75df-4e89-b19b-1d4b12ba0fca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:00.767395 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-e1c76869-75df-4e89-b19b-1d4b12ba0fca None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:03:00.768633 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-e1c76869-75df-4e89-b19b-1d4b12ba0fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:00.827604 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1283/2552] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 15:03:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:03:00.835415 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8cfcae-4593-4591-94aa-654b8523dadb None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:00.835706 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8cfcae-4593-4591-94aa-654b8523dadb None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:00.835989 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8cfcae-4593-4591-94aa-654b8523dadb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:00.856654 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-1f8cfcae-4593-4591-94aa-654b8523dadb None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:03:00.857860 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-1f8cfcae-4593-4591-94aa-654b8523dadb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:00.865758 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1270/2553] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 15:03:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:03:00.869958 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c76869-75df-4e89-b19b-1d4b12ba0fca None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:00.879687 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c76869-75df-4e89-b19b-1d4b12ba0fca None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:00.884413 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551b1b64-d1c4-4c32-9973-c23c6c4e55a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:00.885005 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b1b64-d1c4-4c32-9973-c23c6c4e55a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:00.885286 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b1b64-d1c4-4c32-9973-c23c6c4e55a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:00.885558 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b1b64-d1c4-4c32-9973-c23c6c4e55a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:00.886748 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551b1b64-d1c4-4c32-9973-c23c6c4e55a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:03:00.887054 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551b1b64-d1c4-4c32-9973-c23c6c4e55a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:00.888693 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551b1b64-d1c4-4c32-9973-c23c6c4e55a8 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:00.900299 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1284/2554] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Sep 19 15:03:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:03:00.905359 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8cfcae-4593-4591-94aa-654b8523dadb None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:00.915533 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8cfcae-4593-4591-94aa-654b8523dadb None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:00.920720 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4909a9a0-1ebc-4377-afe7-d675b9a0fe8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:00.921330 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4909a9a0-1ebc-4377-afe7-d675b9a0fe8a admin admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:00.921611 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4909a9a0-1ebc-4377-afe7-d675b9a0fe8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:00.921885 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4909a9a0-1ebc-4377-afe7-d675b9a0fe8a admin admin] PATH_INFO: `/v3/projects` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:00.922524 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4909a9a0-1ebc-4377-afe7-d675b9a0fe8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:00.924444 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4909a9a0-1ebc-4377-afe7-d675b9a0fe8a admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:00.952128 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1271/2555] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Sep 19 15:03:00 2022] POST /identity/v3/projects => generated 387 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 15:03:00.956631 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551b1b64-d1c4-4c32-9973-c23c6c4e55a8 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:00.967753 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551b1b64-d1c4-4c32-9973-c23c6c4e55a8 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:01.023712 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b01c7c-7332-49de-86aa-42391dbcaaad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:01.024290 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b01c7c-7332-49de-86aa-42391dbcaaad admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:01.024591 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b01c7c-7332-49de-86aa-42391dbcaaad admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:01.024863 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b01c7c-7332-49de-86aa-42391dbcaaad admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:01.025491 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b01c7c-7332-49de-86aa-42391dbcaaad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:01.028007 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b01c7c-7332-49de-86aa-42391dbcaaad admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:01.048598 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1285/2556] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Sep 19 15:03:00 2022] POST /identity/v3/users => generated 294 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:03:01.052885 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4909a9a0-1ebc-4377-afe7-d675b9a0fe8a admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:01.063233 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4909a9a0-1ebc-4377-afe7-d675b9a0fe8a admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:01.067834 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78eb397-7dcb-4dd5-a323-738bb6d7abdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:01.068469 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78eb397-7dcb-4dd5-a323-738bb6d7abdd admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:01.068755 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78eb397-7dcb-4dd5-a323-738bb6d7abdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:01.069032 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78eb397-7dcb-4dd5-a323-738bb6d7abdd admin admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:01.069674 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78eb397-7dcb-4dd5-a323-738bb6d7abdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:01.071385 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78eb397-7dcb-4dd5-a323-738bb6d7abdd admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:01.084637 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1272/2557] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 15:03:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:03:01.088738 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b01c7c-7332-49de-86aa-42391dbcaaad admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:01.099522 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b01c7c-7332-49de-86aa-42391dbcaaad admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:01.104140 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb8ff74-5964-457c-8bca-cb3794ed2f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:01.104896 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb8ff74-5964-457c-8bca-cb3794ed2f1f admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:01.105280 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb8ff74-5964-457c-8bca-cb3794ed2f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:01.105556 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb8ff74-5964-457c-8bca-cb3794ed2f1f admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:01.106195 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb8ff74-5964-457c-8bca-cb3794ed2f1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:01.107795 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb8ff74-5964-457c-8bca-cb3794ed2f1f admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:01.118370 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1286/2558] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 15:03:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:03:01.122492 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78eb397-7dcb-4dd5-a323-738bb6d7abdd admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:01.132583 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78eb397-7dcb-4dd5-a323-738bb6d7abdd admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:01.137700 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9959c17c-ae92-4ddd-9292-3da33cc35419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:01.138340 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9959c17c-ae92-4ddd-9292-3da33cc35419 admin admin] REQUEST_METHOD: `PUT` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:01.138633 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9959c17c-ae92-4ddd-9292-3da33cc35419 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:01.138909 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9959c17c-ae92-4ddd-9292-3da33cc35419 admin admin] PATH_INFO: `/v3/projects/4b8257221ea94d778187dced5e9073aa/users/8141ef89354c41999dfa61e7c681fd09/roles/efa0e5b3413748dc828a89b12d67df79` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:01.154215 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9959c17c-ae92-4ddd-9292-3da33cc35419 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b8257221ea94d778187dced5e9073aa, user_id=8141ef89354c41999dfa61e7c681fd09, role_id=efa0e5b3413748dc828a89b12d67df79)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:01.156956 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9959c17c-ae92-4ddd-9292-3da33cc35419 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:01.169736 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1273/2559] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 15:03:01 2022] PUT /identity/v3/projects/4b8257221ea94d778187dced5e9073aa/users/8141ef89354c41999dfa61e7c681fd09/roles/efa0e5b3413748dc828a89b12d67df79 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:03:01.180807 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f6da9f-d003-4f61-b7c6-89ec0a79c1e1 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:01.181094 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f6da9f-d003-4f61-b7c6-89ec0a79c1e1 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:01.181365 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f6da9f-d003-4f61-b7c6-89ec0a79c1e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:01.188376 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:03:01.212041 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-28f6da9f-d003-4f61-b7c6-89ec0a79c1e1 None None] MFA Rules not processed for user `8141ef89354c41999dfa61e7c681fd09`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:03:01.213268 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-28f6da9f-d003-4f61-b7c6-89ec0a79c1e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:01.279171 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1287/2560] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 15:03:01 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:03:01.283677 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9959c17c-ae92-4ddd-9292-3da33cc35419 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:01.297630 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:03:01.350729 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9959c17c-ae92-4ddd-9292-3da33cc35419 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:01.355572 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d667542-96fd-471b-958b-7b56381c55a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:01.356219 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d667542-96fd-471b-958b-7b56381c55a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:01.356557 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d667542-96fd-471b-958b-7b56381c55a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:01.356811 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d667542-96fd-471b-958b-7b56381c55a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:01.357451 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d667542-96fd-471b-958b-7b56381c55a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:01.359336 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d667542-96fd-471b-958b-7b56381c55a7 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:01.392359 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1274/2561] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Sep 19 15:03:01 2022] POST /identity/v3/projects => generated 385 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:03:01.396114 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f6da9f-d003-4f61-b7c6-89ec0a79c1e1 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:01.407020 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f6da9f-d003-4f61-b7c6-89ec0a79c1e1 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:01.466879 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feba3f6e-fd43-4ed3-b0c0-2d4a7763ad3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:01.467481 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feba3f6e-fd43-4ed3-b0c0-2d4a7763ad3d admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:01.467758 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feba3f6e-fd43-4ed3-b0c0-2d4a7763ad3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:01.468027 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feba3f6e-fd43-4ed3-b0c0-2d4a7763ad3d admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:01.468693 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feba3f6e-fd43-4ed3-b0c0-2d4a7763ad3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:01.470602 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feba3f6e-fd43-4ed3-b0c0-2d4a7763ad3d admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:01.490465 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1288/2562] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Sep 19 15:03:01 2022] POST /identity/v3/users => generated 299 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 15:03:01.494468 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d667542-96fd-471b-958b-7b56381c55a7 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:01.505411 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d667542-96fd-471b-958b-7b56381c55a7 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:01.510032 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd40eb93-1080-4918-8b10-08f54b69dc50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:01.510619 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd40eb93-1080-4918-8b10-08f54b69dc50 admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:01.510919 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd40eb93-1080-4918-8b10-08f54b69dc50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:01.511739 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd40eb93-1080-4918-8b10-08f54b69dc50 admin admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:01.512412 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd40eb93-1080-4918-8b10-08f54b69dc50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:01.513995 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd40eb93-1080-4918-8b10-08f54b69dc50 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:01.524557 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1275/2563] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 15:03:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:03:01.528663 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feba3f6e-fd43-4ed3-b0c0-2d4a7763ad3d admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:01.538352 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feba3f6e-fd43-4ed3-b0c0-2d4a7763ad3d admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:01.543130 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c80fe1a-1885-48e9-8e0d-69ef52bd03f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:01.543763 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c80fe1a-1885-48e9-8e0d-69ef52bd03f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:01.544040 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c80fe1a-1885-48e9-8e0d-69ef52bd03f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:01.544310 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c80fe1a-1885-48e9-8e0d-69ef52bd03f4 admin admin] PATH_INFO: `/v3/projects/4137e73f2b9340a2820120519538d857/users/c41db7e8a0b14c19b51af59dfc418eb4/roles/ddb643577b2e4e478100ec370decfaeb` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:01.559229 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c80fe1a-1885-48e9-8e0d-69ef52bd03f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4137e73f2b9340a2820120519538d857, user_id=c41db7e8a0b14c19b51af59dfc418eb4, role_id=ddb643577b2e4e478100ec370decfaeb)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:01.561931 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c80fe1a-1885-48e9-8e0d-69ef52bd03f4 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:01.576638 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1289/2564] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 15:03:01 2022] PUT /identity/v3/projects/4137e73f2b9340a2820120519538d857/users/c41db7e8a0b14c19b51af59dfc418eb4/roles/ddb643577b2e4e478100ec370decfaeb => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:03:01.580616 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd40eb93-1080-4918-8b10-08f54b69dc50 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:01.590791 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd40eb93-1080-4918-8b10-08f54b69dc50 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:01.646254 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ea1a5e-2e47-423d-afe2-273af8919ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:01.646850 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ea1a5e-2e47-423d-afe2-273af8919ac3 admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:01.647139 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ea1a5e-2e47-423d-afe2-273af8919ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:01.647410 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ea1a5e-2e47-423d-afe2-273af8919ac3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:01.648039 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ea1a5e-2e47-423d-afe2-273af8919ac3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:01.649644 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ea1a5e-2e47-423d-afe2-273af8919ac3 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:01.659217 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1276/2565] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 15:03:01 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 15:03:01.663948 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c80fe1a-1885-48e9-8e0d-69ef52bd03f4 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:01.675712 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c80fe1a-1885-48e9-8e0d-69ef52bd03f4 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:01.680373 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d356dd00-0c89-4d44-91be-93d8ef141680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:01.681019 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d356dd00-0c89-4d44-91be-93d8ef141680 admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:01.681301 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d356dd00-0c89-4d44-91be-93d8ef141680 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:01.681600 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d356dd00-0c89-4d44-91be-93d8ef141680 admin admin] PATH_INFO: `/v3/projects/4137e73f2b9340a2820120519538d857/users/c41db7e8a0b14c19b51af59dfc418eb4/roles/ddb643577b2e4e478100ec370decfaeb` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:01.684086 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d356dd00-0c89-4d44-91be-93d8ef141680 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4137e73f2b9340a2820120519538d857, user_id=c41db7e8a0b14c19b51af59dfc418eb4, role_id=ddb643577b2e4e478100ec370decfaeb)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:01.686763 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d356dd00-0c89-4d44-91be-93d8ef141680 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:01.696944 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1290/2566] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 15:03:01 2022] PUT /identity/v3/projects/4137e73f2b9340a2820120519538d857/users/c41db7e8a0b14c19b51af59dfc418eb4/roles/ddb643577b2e4e478100ec370decfaeb => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:03:01.707522 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf5cd2d-a34f-4197-ad96-2b3f5df49310 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:01.707807 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf5cd2d-a34f-4197-ad96-2b3f5df49310 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:01.708077 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf5cd2d-a34f-4197-ad96-2b3f5df49310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:01.736696 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-bdf5cd2d-a34f-4197-ad96-2b3f5df49310 None None] MFA Rules not processed for user `c41db7e8a0b14c19b51af59dfc418eb4`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:03:01.737895 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-bdf5cd2d-a34f-4197-ad96-2b3f5df49310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:01.804971 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1277/2567] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 15:03:01 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:03:01.818623 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d356dd00-0c89-4d44-91be-93d8ef141680 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:01.820454 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-d356dd00-0c89-4d44-91be-93d8ef141680 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:01.868043 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:03:01.879810 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d356dd00-0c89-4d44-91be-93d8ef141680 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:01.883475 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a6ee31-b6a2-41d5-bce0-c02b5da91991 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139dc7a4f1dc48fe8faea848bd1ac0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:01.884098 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a6ee31-b6a2-41d5-bce0-c02b5da91991 service cinder] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:01.884409 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a6ee31-b6a2-41d5-bce0-c02b5da91991 service cinder] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:01.884685 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a6ee31-b6a2-41d5-bce0-c02b5da91991 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:01.893980 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a6ee31-b6a2-41d5-bce0-c02b5da91991 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:01.895413 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a6ee31-b6a2-41d5-bce0-c02b5da91991 service cinder] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:01.905147 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1291/2568] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 15:03:01 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:03:01.970371 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf5cd2d-a34f-4197-ad96-2b3f5df49310 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:01.979228 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:03:02.035452 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf5cd2d-a34f-4197-ad96-2b3f5df49310 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:02.040048 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc7614f-09ef-45fb-ac0e-c4bbe099a7c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:02.040708 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc7614f-09ef-45fb-ac0e-c4bbe099a7c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:02.040993 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc7614f-09ef-45fb-ac0e-c4bbe099a7c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:02.041269 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc7614f-09ef-45fb-ac0e-c4bbe099a7c5 admin admin] PATH_INFO: `/v3/users/8141ef89354c41999dfa61e7c681fd09` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:02.043052 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc7614f-09ef-45fb-ac0e-c4bbe099a7c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8141ef89354c41999dfa61e7c681fd09)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:02.045028 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc7614f-09ef-45fb-ac0e-c4bbe099a7c5 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:02.095195 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-8cc7614f-09ef-45fb-ac0e-c4bbe099a7c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8141ef89354c41999dfa61e7c681fd09'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:02.107688 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-8cc7614f-09ef-45fb-ac0e-c4bbe099a7c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8141ef89354c41999dfa61e7c681fd09'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:02.114538 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-8cc7614f-09ef-45fb-ac0e-c4bbe099a7c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8141ef89354c41999dfa61e7c681fd09'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:02.115214 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-8cc7614f-09ef-45fb-ac0e-c4bbe099a7c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8141ef89354c41999dfa61e7c681fd09'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:02.122982 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-8cc7614f-09ef-45fb-ac0e-c4bbe099a7c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8141ef89354c41999dfa61e7c681fd09'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:02.129401 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1278/2569] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Sep 19 15:03:01 2022] DELETE /identity/v3/users/8141ef89354c41999dfa61e7c681fd09 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:03:02.134049 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27af95cd-4b57-4185-a52b-90a9e036088a None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:02.134380 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27af95cd-4b57-4185-a52b-90a9e036088a None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:02.134651 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27af95cd-4b57-4185-a52b-90a9e036088a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:02.154134 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-27af95cd-4b57-4185-a52b-90a9e036088a None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:03:02.155450 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-27af95cd-4b57-4185-a52b-90a9e036088a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:02.213034 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1292/2570] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 15:03:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:03:02.223397 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc7614f-09ef-45fb-ac0e-c4bbe099a7c5 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:02.224834 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-8cc7614f-09ef-45fb-ac0e-c4bbe099a7c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:02.281302 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc7614f-09ef-45fb-ac0e-c4bbe099a7c5 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:02.285069 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f407ba-e220-4706-90ba-8c40e8d84c5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c2b78646374cb79ded4b7b59ba49c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:02.285643 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f407ba-e220-4706-90ba-8c40e8d84c5f service neutron] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:02.285919 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f407ba-e220-4706-90ba-8c40e8d84c5f service neutron] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:02.286194 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f407ba-e220-4706-90ba-8c40e8d84c5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:02.295812 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f407ba-e220-4706-90ba-8c40e8d84c5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:02.297259 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f407ba-e220-4706-90ba-8c40e8d84c5f service neutron] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:02.306503 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1279/2571] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 15:03:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:03:02.603165 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27af95cd-4b57-4185-a52b-90a9e036088a None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:02.608699 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-27af95cd-4b57-4185-a52b-90a9e036088a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:02.644568 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27af95cd-4b57-4185-a52b-90a9e036088a None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:02.646519 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6cd333-38aa-4f9b-94ce-1e00d49c4ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:02.647311 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6cd333-38aa-4f9b-94ce-1e00d49c4ae5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:02.647686 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6cd333-38aa-4f9b-94ce-1e00d49c4ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:02.648068 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6cd333-38aa-4f9b-94ce-1e00d49c4ae5 admin admin] PATH_INFO: `/v3/projects/4b8257221ea94d778187dced5e9073aa` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:02.649383 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6cd333-38aa-4f9b-94ce-1e00d49c4ae5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b8257221ea94d778187dced5e9073aa)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:02.651437 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6cd333-38aa-4f9b-94ce-1e00d49c4ae5 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:02.702446 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-1d6cd333-38aa-4f9b-94ce-1e00d49c4ae5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b8257221ea94d778187dced5e9073aa', 'request_id': 'req-1d6cd333-38aa-4f9b-94ce-1e00d49c4ae5'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:02.711445 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-1d6cd333-38aa-4f9b-94ce-1e00d49c4ae5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b8257221ea94d778187dced5e9073aa', 'request_id': 'req-1d6cd333-38aa-4f9b-94ce-1e00d49c4ae5'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:02.717713 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-1d6cd333-38aa-4f9b-94ce-1e00d49c4ae5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b8257221ea94d778187dced5e9073aa', 'request_id': 'req-1d6cd333-38aa-4f9b-94ce-1e00d49c4ae5'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:02.728594 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-1d6cd333-38aa-4f9b-94ce-1e00d49c4ae5 admin admin] The token cache is being invalidate because project 4b8257221ea94d778187dced5e9073aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:03:02.728885 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-1d6cd333-38aa-4f9b-94ce-1e00d49c4ae5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:02.729523 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-1d6cd333-38aa-4f9b-94ce-1e00d49c4ae5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:02.731092 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1293/2572] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Sep 19 15:03:02 2022] DELETE /identity/v3/projects/4b8257221ea94d778187dced5e9073aa => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:03:02.735038 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f407ba-e220-4706-90ba-8c40e8d84c5f service neutron] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:02.744779 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f407ba-e220-4706-90ba-8c40e8d84c5f service neutron] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:02.771733 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:03:02.803766 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5e1b2f-585c-4f29-b209-eecd419dc1b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:02.804420 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5e1b2f-585c-4f29-b209-eecd419dc1b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:02.804712 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5e1b2f-585c-4f29-b209-eecd419dc1b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:02.804986 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5e1b2f-585c-4f29-b209-eecd419dc1b4 admin admin] PATH_INFO: `/v3/users/c41db7e8a0b14c19b51af59dfc418eb4` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:02.806136 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5e1b2f-585c-4f29-b209-eecd419dc1b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c41db7e8a0b14c19b51af59dfc418eb4)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:02.808615 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5e1b2f-585c-4f29-b209-eecd419dc1b4 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:02.853582 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-fd5e1b2f-585c-4f29-b209-eecd419dc1b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c41db7e8a0b14c19b51af59dfc418eb4'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:02.866421 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-fd5e1b2f-585c-4f29-b209-eecd419dc1b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c41db7e8a0b14c19b51af59dfc418eb4'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:02.873409 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-fd5e1b2f-585c-4f29-b209-eecd419dc1b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c41db7e8a0b14c19b51af59dfc418eb4'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:02.874148 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-fd5e1b2f-585c-4f29-b209-eecd419dc1b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c41db7e8a0b14c19b51af59dfc418eb4'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:02.881784 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-fd5e1b2f-585c-4f29-b209-eecd419dc1b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c41db7e8a0b14c19b51af59dfc418eb4'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:02.888002 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1280/2573] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Sep 19 15:03:02 2022] DELETE /identity/v3/users/c41db7e8a0b14c19b51af59dfc418eb4 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:03:03.164671 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6cd333-38aa-4f9b-94ce-1e00d49c4ae5 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:03.166241 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-1d6cd333-38aa-4f9b-94ce-1e00d49c4ae5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:03.182007 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6cd333-38aa-4f9b-94ce-1e00d49c4ae5 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:03.240116 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efc2ac2-308f-47e7-a95d-14ab5524e06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:03.240775 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efc2ac2-308f-47e7-a95d-14ab5524e06f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:03.241059 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efc2ac2-308f-47e7-a95d-14ab5524e06f admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:03.241334 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efc2ac2-308f-47e7-a95d-14ab5524e06f admin admin] PATH_INFO: `/v3/projects/4137e73f2b9340a2820120519538d857` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:03.242440 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efc2ac2-308f-47e7-a95d-14ab5524e06f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4137e73f2b9340a2820120519538d857)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:03.244350 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efc2ac2-308f-47e7-a95d-14ab5524e06f admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:03.256066 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:03:03.294698 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-5efc2ac2-308f-47e7-a95d-14ab5524e06f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4137e73f2b9340a2820120519538d857', 'request_id': 'req-5efc2ac2-308f-47e7-a95d-14ab5524e06f'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:03.301986 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-5efc2ac2-308f-47e7-a95d-14ab5524e06f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4137e73f2b9340a2820120519538d857', 'request_id': 'req-5efc2ac2-308f-47e7-a95d-14ab5524e06f'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:03.307828 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-5efc2ac2-308f-47e7-a95d-14ab5524e06f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4137e73f2b9340a2820120519538d857', 'request_id': 'req-5efc2ac2-308f-47e7-a95d-14ab5524e06f'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:03.318688 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-5efc2ac2-308f-47e7-a95d-14ab5524e06f admin admin] The token cache is being invalidate because project 4137e73f2b9340a2820120519538d857 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:03:03.318978 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-5efc2ac2-308f-47e7-a95d-14ab5524e06f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:03.319611 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-5efc2ac2-308f-47e7-a95d-14ab5524e06f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:03.321135 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1294/2574] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Sep 19 15:03:03 2022] DELETE /identity/v3/projects/4137e73f2b9340a2820120519538d857 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:03:03.326873 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac08a84b-e3c1-4f0f-b845-556d6bb44334 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:03.327159 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac08a84b-e3c1-4f0f-b845-556d6bb44334 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:03.327432 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac08a84b-e3c1-4f0f-b845-556d6bb44334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:03.347247 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-ac08a84b-e3c1-4f0f-b845-556d6bb44334 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:03:03.348508 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-ac08a84b-e3c1-4f0f-b845-556d6bb44334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:03.407654 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1281/2575] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 15:03:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:03:03.415406 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b18a65-711f-463e-be47-f11a97e90f34 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:03.415692 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b18a65-711f-463e-be47-f11a97e90f34 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:03.415968 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b18a65-711f-463e-be47-f11a97e90f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:03.438026 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-56b18a65-711f-463e-be47-f11a97e90f34 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:03:03.439219 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-56b18a65-711f-463e-be47-f11a97e90f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:03.454646 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1295/2576] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 15:03:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:03:03.458835 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac08a84b-e3c1-4f0f-b845-556d6bb44334 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:03.469293 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac08a84b-e3c1-4f0f-b845-556d6bb44334 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:03.473799 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd87198b-593b-4935-b95c-e8424e887763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:03.474390 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd87198b-593b-4935-b95c-e8424e887763 admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:03.474669 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd87198b-593b-4935-b95c-e8424e887763 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:03.474943 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd87198b-593b-4935-b95c-e8424e887763 admin admin] PATH_INFO: `/v3/domains` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:03.475583 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd87198b-593b-4935-b95c-e8424e887763 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:03:03.475889 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd87198b-593b-4935-b95c-e8424e887763 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:03.477545 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd87198b-593b-4935-b95c-e8424e887763 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:03.488893 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1282/2577] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Sep 19 15:03:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:03:03.493058 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b18a65-711f-463e-be47-f11a97e90f34 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:03.502817 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b18a65-711f-463e-be47-f11a97e90f34 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:03.507386 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e97bce-49b1-4f0c-b54d-8c613ec6537f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:03.507972 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e97bce-49b1-4f0c-b54d-8c613ec6537f admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:03.508252 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e97bce-49b1-4f0c-b54d-8c613ec6537f admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:03.508553 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e97bce-49b1-4f0c-b54d-8c613ec6537f admin admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:03.509172 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e97bce-49b1-4f0c-b54d-8c613ec6537f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:03.511628 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e97bce-49b1-4f0c-b54d-8c613ec6537f admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:03.538674 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1296/2578] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Sep 19 15:03:03 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:03:03.542955 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd87198b-593b-4935-b95c-e8424e887763 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:03.552947 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd87198b-593b-4935-b95c-e8424e887763 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:03.586287 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:03:03.612319 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405d7b74-c626-46de-be0b-cb6170926144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:03.612949 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405d7b74-c626-46de-be0b-cb6170926144 admin admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:03.613230 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405d7b74-c626-46de-be0b-cb6170926144 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:03.613506 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405d7b74-c626-46de-be0b-cb6170926144 admin admin] PATH_INFO: `/v3/users` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:03.614142 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405d7b74-c626-46de-be0b-cb6170926144 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:03.616061 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405d7b74-c626-46de-be0b-cb6170926144 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:03.637835 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1283/2579] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Sep 19 15:03:03 2022] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:03:03.641934 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e97bce-49b1-4f0c-b54d-8c613ec6537f admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:03.652180 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e97bce-49b1-4f0c-b54d-8c613ec6537f admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:03.657039 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5248ae98-76f6-43be-a717-72f54ac296ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:03.657615 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5248ae98-76f6-43be-a717-72f54ac296ca admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:03.657954 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5248ae98-76f6-43be-a717-72f54ac296ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:03.658168 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5248ae98-76f6-43be-a717-72f54ac296ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:03.658808 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5248ae98-76f6-43be-a717-72f54ac296ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:03.660430 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5248ae98-76f6-43be-a717-72f54ac296ca admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:03.674280 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1297/2580] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 15:03:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:03:03.675938 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405d7b74-c626-46de-be0b-cb6170926144 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:03.686750 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405d7b74-c626-46de-be0b-cb6170926144 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:03.691542 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1b8387-64ff-4d9a-918c-32f37655f6ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:03.692248 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1b8387-64ff-4d9a-918c-32f37655f6ec admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:03.693156 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1b8387-64ff-4d9a-918c-32f37655f6ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:03.693434 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1b8387-64ff-4d9a-918c-32f37655f6ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:03.694075 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1b8387-64ff-4d9a-918c-32f37655f6ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:03.695683 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1b8387-64ff-4d9a-918c-32f37655f6ec admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:03.706744 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1284/2581] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 15:03:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:03:03.711028 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5248ae98-76f6-43be-a717-72f54ac296ca admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:03.721297 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5248ae98-76f6-43be-a717-72f54ac296ca admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:03.726601 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce10d41f-478b-47dd-8794-3cd41a04df6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:03.727470 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce10d41f-478b-47dd-8794-3cd41a04df6b admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:03.727754 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce10d41f-478b-47dd-8794-3cd41a04df6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:03.728031 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce10d41f-478b-47dd-8794-3cd41a04df6b admin admin] PATH_INFO: `/v3/projects/ca93cb62537148b58c3d87331fbfb4da/users/8489c99afded4f12a8d29b808414064d/roles/efa0e5b3413748dc828a89b12d67df79` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:03.746652 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce10d41f-478b-47dd-8794-3cd41a04df6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca93cb62537148b58c3d87331fbfb4da, user_id=8489c99afded4f12a8d29b808414064d, role_id=efa0e5b3413748dc828a89b12d67df79)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:03.749426 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce10d41f-478b-47dd-8794-3cd41a04df6b admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:03.765932 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1298/2582] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 15:03:03 2022] PUT /identity/v3/projects/ca93cb62537148b58c3d87331fbfb4da/users/8489c99afded4f12a8d29b808414064d/roles/efa0e5b3413748dc828a89b12d67df79 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:03:03.771111 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b9cd78-2826-4d75-9222-d10fb1680384 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:03.772023 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b9cd78-2826-4d75-9222-d10fb1680384 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:03.772563 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b9cd78-2826-4d75-9222-d10fb1680384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:03.792121 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-f9b9cd78-2826-4d75-9222-d10fb1680384 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:03:03.793532 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-f9b9cd78-2826-4d75-9222-d10fb1680384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:03.860375 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1285/2583] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 15:03:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:03:03.869911 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce10d41f-478b-47dd-8794-3cd41a04df6b admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:03.872405 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-ce10d41f-478b-47dd-8794-3cd41a04df6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:03.949721 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce10d41f-478b-47dd-8794-3cd41a04df6b admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:03.954013 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9dfb71-8621-4ad1-aa21-ca9c2eda0b89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c2b78646374cb79ded4b7b59ba49c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:03.954624 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9dfb71-8621-4ad1-aa21-ca9c2eda0b89 service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:03.954906 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9dfb71-8621-4ad1-aa21-ca9c2eda0b89 service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:03.955179 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9dfb71-8621-4ad1-aa21-ca9c2eda0b89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:03.965617 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9dfb71-8621-4ad1-aa21-ca9c2eda0b89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:03.967056 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9dfb71-8621-4ad1-aa21-ca9c2eda0b89 service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:03.976941 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1299/2584] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 15:03:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:03:04.661752 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64c961-461e-42fb-901e-e37cb18e58a8 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:04.662069 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64c961-461e-42fb-901e-e37cb18e58a8 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:04.662363 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64c961-461e-42fb-901e-e37cb18e58a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:04.710337 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-ed64c961-461e-42fb-901e-e37cb18e58a8 None None] MFA Rules not processed for user `8489c99afded4f12a8d29b808414064d`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:03:04.711678 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-ed64c961-461e-42fb-901e-e37cb18e58a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:04.818960 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1286/2585] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 15:03:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:03:04.823445 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9dfb71-8621-4ad1-aa21-ca9c2eda0b89 service neutron] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:04.834038 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020112d1-255f-4160-a9c7-207aa66f752e None None] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:04.836816 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9dfb71-8621-4ad1-aa21-ca9c2eda0b89 service neutron] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:04.838559 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020112d1-255f-4160-a9c7-207aa66f752e None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:04.839177 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020112d1-255f-4160-a9c7-207aa66f752e None None] PATH_INFO: `/` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:04.842835 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1287/2586] 10.222.0.72 () {54 vars in 921 bytes} [Mon Sep 19 15:03:04 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:03:04.845619 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70092751-b2ad-4ca3-abc3-e47acfef8774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:04.848824 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7057b465-ce58-417d-be12-6d4dc59696c6 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:04.849449 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7057b465-ce58-417d-be12-6d4dc59696c6 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:04.849891 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7057b465-ce58-417d-be12-6d4dc59696c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:04.852028 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70092751-b2ad-4ca3-abc3-e47acfef8774 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:04.852579 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70092751-b2ad-4ca3-abc3-e47acfef8774 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:04.853534 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70092751-b2ad-4ca3-abc3-e47acfef8774 admin admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:04.854376 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70092751-b2ad-4ca3-abc3-e47acfef8774 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:04.859756 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70092751-b2ad-4ca3-abc3-e47acfef8774 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:04.882968 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-7057b465-ce58-417d-be12-6d4dc59696c6 None None] MFA Rules not processed for user `055439dc35e946f4a82535c684f9b60d`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:03:04.884411 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-7057b465-ce58-417d-be12-6d4dc59696c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:04.900040 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1300/2587] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Sep 19 15:03:04 2022] POST /identity/v3/projects => generated 371 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 15:03:04.904270 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70092751-b2ad-4ca3-abc3-e47acfef8774 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:04.941056 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:03:04.946517 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:03:04.992372 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1288/2588] 10.222.0.72 () {58 vars in 1018 bytes} [Mon Sep 19 15:03:04 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:03:05.006779 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7057b465-ce58-417d-be12-6d4dc59696c6 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:05.008798 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-7057b465-ce58-417d-be12-6d4dc59696c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:05.014077 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70092751-b2ad-4ca3-abc3-e47acfef8774 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:05.019875 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21a8a3e-9407-4436-a79f-6bcf686fad7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:05.020518 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a8a3e-9407-4436-a79f-6bcf686fad7d admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:05.020808 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a8a3e-9407-4436-a79f-6bcf686fad7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:05.021139 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a8a3e-9407-4436-a79f-6bcf686fad7d admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:05.022101 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21a8a3e-9407-4436-a79f-6bcf686fad7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:05.024195 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21a8a3e-9407-4436-a79f-6bcf686fad7d admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:05.062932 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1301/2589] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Sep 19 15:03:04 2022] POST /identity/v3/users => generated 292 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 15:03:05.063998 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21a8a3e-9407-4436-a79f-6bcf686fad7d admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:05.073678 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21a8a3e-9407-4436-a79f-6bcf686fad7d admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:05.078339 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fca87c-ed27-4082-9255-e5fea60fa62b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:05.078926 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fca87c-ed27-4082-9255-e5fea60fa62b admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:05.079204 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fca87c-ed27-4082-9255-e5fea60fa62b admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:05.079475 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fca87c-ed27-4082-9255-e5fea60fa62b admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:05.080100 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fca87c-ed27-4082-9255-e5fea60fa62b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:05.081704 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fca87c-ed27-4082-9255-e5fea60fa62b admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:05.093025 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1302/2590] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 15:03:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 15:03:05.095612 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7057b465-ce58-417d-be12-6d4dc59696c6 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:05.097101 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fca87c-ed27-4082-9255-e5fea60fa62b admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:05.107145 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fca87c-ed27-4082-9255-e5fea60fa62b admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:05.111995 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4415d7ff-99a7-4ce8-8c4c-4a5c66ad7a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:05.112709 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415d7ff-99a7-4ce8-8c4c-4a5c66ad7a41 admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:05.112992 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415d7ff-99a7-4ce8-8c4c-4a5c66ad7a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:05.113265 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415d7ff-99a7-4ce8-8c4c-4a5c66ad7a41 admin admin] PATH_INFO: `/v3/projects/6513a46a53de4ce6975cbaed86ac220f/users/fb4df43090984fa1baf8c581b219367d/roles/ddb643577b2e4e478100ec370decfaeb` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:05.128265 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4415d7ff-99a7-4ce8-8c4c-4a5c66ad7a41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6513a46a53de4ce6975cbaed86ac220f, user_id=fb4df43090984fa1baf8c581b219367d, role_id=ddb643577b2e4e478100ec370decfaeb)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:05.130942 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4415d7ff-99a7-4ce8-8c4c-4a5c66ad7a41 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:05.144607 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1303/2591] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 15:03:05 2022] PUT /identity/v3/projects/6513a46a53de4ce6975cbaed86ac220f/users/fb4df43090984fa1baf8c581b219367d/roles/ddb643577b2e4e478100ec370decfaeb => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:03:05.146575 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae175ac-50b6-4330-9364-d87b1e23a71c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d6d4ecf8f4849939d6510a6228b29dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:05.147181 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae175ac-50b6-4330-9364-d87b1e23a71c service glance] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:05.147569 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae175ac-50b6-4330-9364-d87b1e23a71c service glance] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:05.147839 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae175ac-50b6-4330-9364-d87b1e23a71c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:05.148452 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4415d7ff-99a7-4ce8-8c4c-4a5c66ad7a41 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:05.212465 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4415d7ff-99a7-4ce8-8c4c-4a5c66ad7a41 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:05.217616 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef311a-0e0c-4c5a-b486-b3eb3d8633a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:05.218210 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef311a-0e0c-4c5a-b486-b3eb3d8633a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:05.218322 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae175ac-50b6-4330-9364-d87b1e23a71c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:05.218486 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef311a-0e0c-4c5a-b486-b3eb3d8633a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:05.218755 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef311a-0e0c-4c5a-b486-b3eb3d8633a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:05.219404 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ef311a-0e0c-4c5a-b486-b3eb3d8633a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:05.219654 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae175ac-50b6-4330-9364-d87b1e23a71c service glance] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:05.221011 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ef311a-0e0c-4c5a-b486-b3eb3d8633a4 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:05.231184 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1289/2592] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 15:03:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:03:05.231500 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1304/2593] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 15:03:05 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:03:05.235502 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae175ac-50b6-4330-9364-d87b1e23a71c service glance] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:05.245701 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae175ac-50b6-4330-9364-d87b1e23a71c service glance] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:05.250862 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5927dfc5-0d0c-4295-939a-bbed4ef74b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:05.251689 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5927dfc5-0d0c-4295-939a-bbed4ef74b53 admin admin] REQUEST_METHOD: `PUT` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:05.252006 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5927dfc5-0d0c-4295-939a-bbed4ef74b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:05.252387 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5927dfc5-0d0c-4295-939a-bbed4ef74b53 admin admin] PATH_INFO: `/v3/projects/6513a46a53de4ce6975cbaed86ac220f/users/fb4df43090984fa1baf8c581b219367d/roles/ddb643577b2e4e478100ec370decfaeb` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:05.254332 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5927dfc5-0d0c-4295-939a-bbed4ef74b53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6513a46a53de4ce6975cbaed86ac220f, user_id=fb4df43090984fa1baf8c581b219367d, role_id=ddb643577b2e4e478100ec370decfaeb)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:05.257577 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5927dfc5-0d0c-4295-939a-bbed4ef74b53 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:05.268592 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1290/2594] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 15:03:05 2022] PUT /identity/v3/projects/6513a46a53de4ce6975cbaed86ac220f/users/fb4df43090984fa1baf8c581b219367d/roles/ddb643577b2e4e478100ec370decfaeb => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:03:05.975365 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f3571d-c90e-4642-8fd9-996a9add3492 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:05.975846 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f3571d-c90e-4642-8fd9-996a9add3492 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:05.975932 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f3571d-c90e-4642-8fd9-996a9add3492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:06.005970 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-66f3571d-c90e-4642-8fd9-996a9add3492 None None] MFA Rules not processed for user `fb4df43090984fa1baf8c581b219367d`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:03:06.007541 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-66f3571d-c90e-4642-8fd9-996a9add3492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:06.081907 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:03:06.095495 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1305/2595] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 15:03:05 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:03:06.107725 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d98acc-9e19-4f49-8c26-d2b4364ab8f1 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:06.108278 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d98acc-9e19-4f49-8c26-d2b4364ab8f1 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:06.108278 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d98acc-9e19-4f49-8c26-d2b4364ab8f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:06.130035 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-45d98acc-9e19-4f49-8c26-d2b4364ab8f1 None None] MFA Rules not processed for user `8489c99afded4f12a8d29b808414064d`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:03:06.131310 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-45d98acc-9e19-4f49-8c26-d2b4364ab8f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:06.147330 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:03:06.199993 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1291/2596] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 15:03:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:03:06.210802 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f3571d-c90e-4642-8fd9-996a9add3492 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:06.212206 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-66f3571d-c90e-4642-8fd9-996a9add3492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:06.287507 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f3571d-c90e-4642-8fd9-996a9add3492 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:06.293626 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fcb157-f288-4983-af21-ae4014735226 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055439dc35e946f4a82535c684f9b60d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:06.294225 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fcb157-f288-4983-af21-ae4014735226 service nova] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:06.294506 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fcb157-f288-4983-af21-ae4014735226 service nova] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:06.294780 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fcb157-f288-4983-af21-ae4014735226 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:06.302848 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fcb157-f288-4983-af21-ae4014735226 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:06.304443 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fcb157-f288-4983-af21-ae4014735226 service nova] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:06.313902 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1306/2597] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 15:03:06 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:03:07.273549 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e80c45-623b-4a20-809f-10805eaa5cbd None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:07.274459 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e80c45-623b-4a20-809f-10805eaa5cbd None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:07.274943 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e80c45-623b-4a20-809f-10805eaa5cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:07.299070 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-86e80c45-623b-4a20-809f-10805eaa5cbd None None] MFA Rules not processed for user `afbbbf11f3234297ab1dd509f064480f`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:03:07.300518 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-86e80c45-623b-4a20-809f-10805eaa5cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:07.375139 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1292/2598] 10.222.0.72 () {58 vars in 1009 bytes} [Mon Sep 19 15:03:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:03:07.402388 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fcb157-f288-4983-af21-ae4014735226 service nova] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:07.403924 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-50fcb157-f288-4983-af21-ae4014735226 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:07.486885 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fcb157-f288-4983-af21-ae4014735226 service nova] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:07.492067 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de78c4b-2ef9-44cf-b8d4-018f9a02d980 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8504425c3a414608b030d0cf1af78af5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:07.492721 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de78c4b-2ef9-44cf-b8d4-018f9a02d980 service swift] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:07.493000 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de78c4b-2ef9-44cf-b8d4-018f9a02d980 service swift] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:07.493275 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de78c4b-2ef9-44cf-b8d4-018f9a02d980 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:07.505320 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de78c4b-2ef9-44cf-b8d4-018f9a02d980 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:07.507321 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de78c4b-2ef9-44cf-b8d4-018f9a02d980 service swift] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:07.521195 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1307/2599] 10.222.0.72 () {60 vars in 1384 bytes} [Mon Sep 19 15:03:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 15:03:13.452974 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e80c45-623b-4a20-809f-10805eaa5cbd None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:13.514488 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e80c45-623b-4a20-809f-10805eaa5cbd None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:13.518107 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e574cc54-44bb-4f65-a56d-adbd7f3faa02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c2b78646374cb79ded4b7b59ba49c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:13.518710 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e574cc54-44bb-4f65-a56d-adbd7f3faa02 service neutron] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:13.518990 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e574cc54-44bb-4f65-a56d-adbd7f3faa02 service neutron] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:13.519262 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e574cc54-44bb-4f65-a56d-adbd7f3faa02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:13.521158 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-e574cc54-44bb-4f65-a56d-adbd7f3faa02 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:13.721780 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e574cc54-44bb-4f65-a56d-adbd7f3faa02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:13.723453 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e574cc54-44bb-4f65-a56d-adbd7f3faa02 service neutron] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:13.739962 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1293/2600] 10.222.0.72 () {60 vars in 1396 bytes} [Mon Sep 19 15:03:13 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3264 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 15:03:17.517114 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=69 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:03:22.128842 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803b86a4-b9ad-4b92-9c46-649ee6a3011d None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:22.129415 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803b86a4-b9ad-4b92-9c46-649ee6a3011d None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:22.129415 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803b86a4-b9ad-4b92-9c46-649ee6a3011d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:22.148985 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-803b86a4-b9ad-4b92-9c46-649ee6a3011d None None] MFA Rules not processed for user `afbbbf11f3234297ab1dd509f064480f`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:03:22.150193 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-803b86a4-b9ad-4b92-9c46-649ee6a3011d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:22.157965 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1308/2601] 10.222.0.72 () {58 vars in 967 bytes} [Mon Sep 19 15:03:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:03:22.173382 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e574cc54-44bb-4f65-a56d-adbd7f3faa02 service neutron] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:22.188156 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e574cc54-44bb-4f65-a56d-adbd7f3faa02 service neutron] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:22.194820 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a08b7e0-c70d-4f94-b714-df6a3d7f8630 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8504425c3a414608b030d0cf1af78af5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:22.195553 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a08b7e0-c70d-4f94-b714-df6a3d7f8630 service swift] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:22.195936 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a08b7e0-c70d-4f94-b714-df6a3d7f8630 service swift] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:22.196393 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a08b7e0-c70d-4f94-b714-df6a3d7f8630 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:22.207536 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a08b7e0-c70d-4f94-b714-df6a3d7f8630 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:22.209441 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a08b7e0-c70d-4f94-b714-df6a3d7f8630 service swift] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:22.229294 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1294/2602] 10.222.0.72 () {60 vars in 1384 bytes} [Mon Sep 19 15:03:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 15:03:28.581557 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803b86a4-b9ad-4b92-9c46-649ee6a3011d None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:28.583024 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-803b86a4-b9ad-4b92-9c46-649ee6a3011d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:28.640344 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803b86a4-b9ad-4b92-9c46-649ee6a3011d None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:28.643859 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b29c61-fcd7-41b7-8746-dc6c6c55707c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139dc7a4f1dc48fe8faea848bd1ac0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:28.644486 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b29c61-fcd7-41b7-8746-dc6c6c55707c service cinder] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:28.644771 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b29c61-fcd7-41b7-8746-dc6c6c55707c service cinder] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:28.645041 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b29c61-fcd7-41b7-8746-dc6c6c55707c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:28.654494 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b29c61-fcd7-41b7-8746-dc6c6c55707c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:28.655957 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b29c61-fcd7-41b7-8746-dc6c6c55707c service cinder] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:28.665727 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1309/2603] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 15:03:28 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:03:32.217318 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=95 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:03:34.115064 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c6b12-92e2-46b7-87af-6a0db1966b97 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:34.115669 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c6b12-92e2-46b7-87af-6a0db1966b97 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:34.115669 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c6b12-92e2-46b7-87af-6a0db1966b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:34.134604 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-330c6b12-92e2-46b7-87af-6a0db1966b97 None None] MFA Rules not processed for user `4edcf03fc7d244608b7ff8ee15ebfc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:03:34.135942 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-330c6b12-92e2-46b7-87af-6a0db1966b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:34.190614 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1295/2604] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 15:03:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:03:38.661166 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=29 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:03:44.183403 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=25 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:03:47.593433 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b29c61-fcd7-41b7-8746-dc6c6c55707c service cinder] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:47.602831 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b29c61-fcd7-41b7-8746-dc6c6c55707c service cinder] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:47.606590 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b020add8-b5ed-4c41-88c5-7433ee616411 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c2b78646374cb79ded4b7b59ba49c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:47.607190 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b020add8-b5ed-4c41-88c5-7433ee616411 service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:47.607470 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b020add8-b5ed-4c41-88c5-7433ee616411 service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:47.607743 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b020add8-b5ed-4c41-88c5-7433ee616411 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:47.609573 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-b020add8-b5ed-4c41-88c5-7433ee616411 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:47.676411 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b020add8-b5ed-4c41-88c5-7433ee616411 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:47.677853 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b020add8-b5ed-4c41-88c5-7433ee616411 service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:47.687930 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1310/2605] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 15:03:47 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 15:03:49.038593 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330c6b12-92e2-46b7-87af-6a0db1966b97 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:49.040046 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-330c6b12-92e2-46b7-87af-6a0db1966b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:49.113122 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330c6b12-92e2-46b7-87af-6a0db1966b97 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:49.118023 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed9b819-51bf-44d5-8ec8-7fc0acd7670f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e7a0148db8462b8ba24bac6dd15298', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:49.118624 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed9b819-51bf-44d5-8ec8-7fc0acd7670f service placement] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:49.118897 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed9b819-51bf-44d5-8ec8-7fc0acd7670f service placement] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:49.119162 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed9b819-51bf-44d5-8ec8-7fc0acd7670f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:49.120892 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-eed9b819-51bf-44d5-8ec8-7fc0acd7670f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:49.138742 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed9b819-51bf-44d5-8ec8-7fc0acd7670f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:49.141861 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed9b819-51bf-44d5-8ec8-7fc0acd7670f service placement] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:49.143432 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b020add8-b5ed-4c41-88c5-7433ee616411 service neutron] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:49.154861 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1296/2606] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 15:03:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:03:49.229873 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b020add8-b5ed-4c41-88c5-7433ee616411 service neutron] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:49.235001 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828c4a0f-2c99-41f4-b98a-8ce9438e618d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:49.235642 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c4a0f-2c99-41f4-b98a-8ce9438e618d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:49.235928 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c4a0f-2c99-41f4-b98a-8ce9438e618d admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:49.236201 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c4a0f-2c99-41f4-b98a-8ce9438e618d admin admin] PATH_INFO: `/v3/users/8489c99afded4f12a8d29b808414064d` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:49.237533 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828c4a0f-2c99-41f4-b98a-8ce9438e618d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8489c99afded4f12a8d29b808414064d)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:49.239450 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828c4a0f-2c99-41f4-b98a-8ce9438e618d admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:49.298740 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-828c4a0f-2c99-41f4-b98a-8ce9438e618d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8489c99afded4f12a8d29b808414064d'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:49.321149 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-828c4a0f-2c99-41f4-b98a-8ce9438e618d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8489c99afded4f12a8d29b808414064d'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:49.336961 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-828c4a0f-2c99-41f4-b98a-8ce9438e618d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8489c99afded4f12a8d29b808414064d'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:49.347217 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-828c4a0f-2c99-41f4-b98a-8ce9438e618d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8489c99afded4f12a8d29b808414064d'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:49.348034 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-828c4a0f-2c99-41f4-b98a-8ce9438e618d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8489c99afded4f12a8d29b808414064d'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:49.376469 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1311/2607] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Sep 19 15:03:49 2022] DELETE /identity/v3/users/8489c99afded4f12a8d29b808414064d => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:03:49.626126 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed9b819-51bf-44d5-8ec8-7fc0acd7670f service placement] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:49.637344 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed9b819-51bf-44d5-8ec8-7fc0acd7670f service placement] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:49.719613 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4802c3c4-4fe2-43e2-be5e-d6821833da7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:49.720386 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4802c3c4-4fe2-43e2-be5e-d6821833da7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:49.720732 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4802c3c4-4fe2-43e2-be5e-d6821833da7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:49.721068 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4802c3c4-4fe2-43e2-be5e-d6821833da7b admin admin] PATH_INFO: `/v3/projects/ca93cb62537148b58c3d87331fbfb4da` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:49.722288 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4802c3c4-4fe2-43e2-be5e-d6821833da7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca93cb62537148b58c3d87331fbfb4da)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:49.724250 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4802c3c4-4fe2-43e2-be5e-d6821833da7b admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:49.774057 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-4802c3c4-4fe2-43e2-be5e-d6821833da7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca93cb62537148b58c3d87331fbfb4da', 'request_id': 'req-4802c3c4-4fe2-43e2-be5e-d6821833da7b'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:49.781906 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-4802c3c4-4fe2-43e2-be5e-d6821833da7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca93cb62537148b58c3d87331fbfb4da', 'request_id': 'req-4802c3c4-4fe2-43e2-be5e-d6821833da7b'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:49.789011 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-4802c3c4-4fe2-43e2-be5e-d6821833da7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca93cb62537148b58c3d87331fbfb4da', 'request_id': 'req-4802c3c4-4fe2-43e2-be5e-d6821833da7b'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:49.800066 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-4802c3c4-4fe2-43e2-be5e-d6821833da7b admin admin] The token cache is being invalidate because project ca93cb62537148b58c3d87331fbfb4da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:03:49.800379 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-4802c3c4-4fe2-43e2-be5e-d6821833da7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:49.801035 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-4802c3c4-4fe2-43e2-be5e-d6821833da7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:49.802508 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1297/2608] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Sep 19 15:03:49 2022] DELETE /identity/v3/projects/ca93cb62537148b58c3d87331fbfb4da => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:03:49.806687 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828c4a0f-2c99-41f4-b98a-8ce9438e618d admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:49.808145 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-828c4a0f-2c99-41f4-b98a-8ce9438e618d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:49.822374 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828c4a0f-2c99-41f4-b98a-8ce9438e618d admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:49.839614 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:03:49.889702 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc2f770-73b8-45a7-bcbb-f058fb863422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:49.890945 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc2f770-73b8-45a7-bcbb-f058fb863422 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:49.891387 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc2f770-73b8-45a7-bcbb-f058fb863422 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:49.891848 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc2f770-73b8-45a7-bcbb-f058fb863422 admin admin] PATH_INFO: `/v3/users/fb4df43090984fa1baf8c581b219367d` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:49.893211 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc2f770-73b8-45a7-bcbb-f058fb863422 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb4df43090984fa1baf8c581b219367d)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:49.895113 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc2f770-73b8-45a7-bcbb-f058fb863422 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:49.946382 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-5fc2f770-73b8-45a7-bcbb-f058fb863422 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb4df43090984fa1baf8c581b219367d'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:49.959233 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-5fc2f770-73b8-45a7-bcbb-f058fb863422 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb4df43090984fa1baf8c581b219367d'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:49.966282 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-5fc2f770-73b8-45a7-bcbb-f058fb863422 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb4df43090984fa1baf8c581b219367d'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:49.975836 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-5fc2f770-73b8-45a7-bcbb-f058fb863422 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb4df43090984fa1baf8c581b219367d'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:49.976503 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-5fc2f770-73b8-45a7-bcbb-f058fb863422 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb4df43090984fa1baf8c581b219367d'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:49.983656 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1312/2609] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Sep 19 15:03:49 2022] DELETE /identity/v3/users/fb4df43090984fa1baf8c581b219367d => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:03:50.166265 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4802c3c4-4fe2-43e2-be5e-d6821833da7b admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:50.167851 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-4802c3c4-4fe2-43e2-be5e-d6821833da7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:50.181303 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4802c3c4-4fe2-43e2-be5e-d6821833da7b admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:50.199171 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:03:50.242772 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606b852b-655e-4bbb-b004-579fa100dd63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:50.243404 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b852b-655e-4bbb-b004-579fa100dd63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:50.243685 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b852b-655e-4bbb-b004-579fa100dd63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:50.243956 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b852b-655e-4bbb-b004-579fa100dd63 admin admin] PATH_INFO: `/v3/projects/6513a46a53de4ce6975cbaed86ac220f` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:50.245111 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606b852b-655e-4bbb-b004-579fa100dd63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6513a46a53de4ce6975cbaed86ac220f)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:50.246993 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606b852b-655e-4bbb-b004-579fa100dd63 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:50.297498 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-606b852b-655e-4bbb-b004-579fa100dd63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6513a46a53de4ce6975cbaed86ac220f', 'request_id': 'req-606b852b-655e-4bbb-b004-579fa100dd63'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:50.304932 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-606b852b-655e-4bbb-b004-579fa100dd63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6513a46a53de4ce6975cbaed86ac220f', 'request_id': 'req-606b852b-655e-4bbb-b004-579fa100dd63'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:50.311579 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-606b852b-655e-4bbb-b004-579fa100dd63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6513a46a53de4ce6975cbaed86ac220f', 'request_id': 'req-606b852b-655e-4bbb-b004-579fa100dd63'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:50.321660 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-606b852b-655e-4bbb-b004-579fa100dd63 admin admin] The token cache is being invalidate because project 6513a46a53de4ce6975cbaed86ac220f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:03:50.321943 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-606b852b-655e-4bbb-b004-579fa100dd63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:50.322558 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-606b852b-655e-4bbb-b004-579fa100dd63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:50.324292 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1298/2610] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Sep 19 15:03:50 2022] DELETE /identity/v3/projects/6513a46a53de4ce6975cbaed86ac220f => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:03:50.329948 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48a0228-4064-4f69-8ec2-3ff28ad3e3fe None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:50.330440 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48a0228-4064-4f69-8ec2-3ff28ad3e3fe None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:50.330553 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48a0228-4064-4f69-8ec2-3ff28ad3e3fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:50.350442 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-b48a0228-4064-4f69-8ec2-3ff28ad3e3fe None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:03:50.351639 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-b48a0228-4064-4f69-8ec2-3ff28ad3e3fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:50.410408 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1313/2611] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 15:03:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:03:50.417966 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdd3092-b1d6-4853-8c7b-91570abd6f56 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:50.418244 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdd3092-b1d6-4853-8c7b-91570abd6f56 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:50.418513 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdd3092-b1d6-4853-8c7b-91570abd6f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:50.438078 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-ccdd3092-b1d6-4853-8c7b-91570abd6f56 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:03:50.439258 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-ccdd3092-b1d6-4853-8c7b-91570abd6f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:50.447074 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1299/2612] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 15:03:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:03:50.451408 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48a0228-4064-4f69-8ec2-3ff28ad3e3fe None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:50.461672 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48a0228-4064-4f69-8ec2-3ff28ad3e3fe None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:50.466205 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce06623-1eeb-41b0-9ae2-2042a50538c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:50.466812 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce06623-1eeb-41b0-9ae2-2042a50538c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:50.467089 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce06623-1eeb-41b0-9ae2-2042a50538c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:50.468115 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce06623-1eeb-41b0-9ae2-2042a50538c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:50.468986 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce06623-1eeb-41b0-9ae2-2042a50538c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:03:50.469286 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce06623-1eeb-41b0-9ae2-2042a50538c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:50.470865 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce06623-1eeb-41b0-9ae2-2042a50538c7 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:50.482258 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1314/2613] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Sep 19 15:03:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:03:50.486331 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdd3092-b1d6-4853-8c7b-91570abd6f56 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:50.495580 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdd3092-b1d6-4853-8c7b-91570abd6f56 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:50.500705 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d44d086-5391-41ff-932c-da836383a61c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:50.501288 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d44d086-5391-41ff-932c-da836383a61c admin admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:50.501561 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d44d086-5391-41ff-932c-da836383a61c admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:50.501821 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d44d086-5391-41ff-932c-da836383a61c admin admin] PATH_INFO: `/v3/projects` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:50.502470 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d44d086-5391-41ff-932c-da836383a61c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:50.504318 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d44d086-5391-41ff-932c-da836383a61c admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:50.533809 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1300/2614] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Sep 19 15:03:50 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:03:50.537887 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce06623-1eeb-41b0-9ae2-2042a50538c7 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:50.548044 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce06623-1eeb-41b0-9ae2-2042a50538c7 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:50.567905 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:03:50.607441 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9bdaa0-35c9-45b9-abd0-eb9f57447aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:50.608100 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9bdaa0-35c9-45b9-abd0-eb9f57447aa2 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:50.608419 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9bdaa0-35c9-45b9-abd0-eb9f57447aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:50.608697 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9bdaa0-35c9-45b9-abd0-eb9f57447aa2 admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:50.609323 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9bdaa0-35c9-45b9-abd0-eb9f57447aa2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:50.611230 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9bdaa0-35c9-45b9-abd0-eb9f57447aa2 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:50.634792 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1315/2615] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Sep 19 15:03:50 2022] POST /identity/v3/users => generated 287 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:03:50.635941 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d44d086-5391-41ff-932c-da836383a61c admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:50.646814 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d44d086-5391-41ff-932c-da836383a61c admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:50.651458 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bc103c-e8b3-49fd-939b-424403a4b9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:50.652056 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bc103c-e8b3-49fd-939b-424403a4b9da admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:50.652348 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bc103c-e8b3-49fd-939b-424403a4b9da admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:50.652651 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bc103c-e8b3-49fd-939b-424403a4b9da admin admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:50.653287 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bc103c-e8b3-49fd-939b-424403a4b9da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:50.654926 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bc103c-e8b3-49fd-939b-424403a4b9da admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:50.666225 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1301/2616] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 15:03:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 15:03:50.668923 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9bdaa0-35c9-45b9-abd0-eb9f57447aa2 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:50.682014 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9bdaa0-35c9-45b9-abd0-eb9f57447aa2 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:50.688422 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a172a9f-c410-4c9c-b5db-e5a5e1527157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:50.689133 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a172a9f-c410-4c9c-b5db-e5a5e1527157 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:50.689484 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a172a9f-c410-4c9c-b5db-e5a5e1527157 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:50.690279 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a172a9f-c410-4c9c-b5db-e5a5e1527157 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:50.691458 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a172a9f-c410-4c9c-b5db-e5a5e1527157 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:50.692248 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a172a9f-c410-4c9c-b5db-e5a5e1527157 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:50.704864 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1316/2617] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 15:03:50 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:03:50.709033 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bc103c-e8b3-49fd-939b-424403a4b9da admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:50.720641 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bc103c-e8b3-49fd-939b-424403a4b9da admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:50.726123 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa89f43-e116-4c53-87aa-858d6c983e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:50.726820 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa89f43-e116-4c53-87aa-858d6c983e9e admin admin] REQUEST_METHOD: `PUT` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:50.727100 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa89f43-e116-4c53-87aa-858d6c983e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:50.727377 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa89f43-e116-4c53-87aa-858d6c983e9e admin admin] PATH_INFO: `/v3/projects/c7412cc870bf49d8be655a89fadd9938/users/0369f322f1384218b3f26249661bb92f/roles/efa0e5b3413748dc828a89b12d67df79` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:50.744645 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa89f43-e116-4c53-87aa-858d6c983e9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7412cc870bf49d8be655a89fadd9938, user_id=0369f322f1384218b3f26249661bb92f, role_id=efa0e5b3413748dc828a89b12d67df79)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:50.747476 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa89f43-e116-4c53-87aa-858d6c983e9e admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:50.761969 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1302/2618] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 15:03:50 2022] PUT /identity/v3/projects/c7412cc870bf49d8be655a89fadd9938/users/0369f322f1384218b3f26249661bb92f/roles/efa0e5b3413748dc828a89b12d67df79 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:03:50.773613 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56903f42-3cef-446a-96e5-b6b07e81e022 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:50.773902 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56903f42-3cef-446a-96e5-b6b07e81e022 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:50.774189 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56903f42-3cef-446a-96e5-b6b07e81e022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:50.802788 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-56903f42-3cef-446a-96e5-b6b07e81e022 None None] MFA Rules not processed for user `0369f322f1384218b3f26249661bb92f`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:03:50.803988 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-56903f42-3cef-446a-96e5-b6b07e81e022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:50.870096 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1317/2619] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 15:03:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:03:50.881797 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa89f43-e116-4c53-87aa-858d6c983e9e admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:50.883644 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-cfa89f43-e116-4c53-87aa-858d6c983e9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:50.937487 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:03:50.943636 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa89f43-e116-4c53-87aa-858d6c983e9e admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:50.949120 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c9ac32-52d6-4bcd-88d4-ee5164d0e252 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139dc7a4f1dc48fe8faea848bd1ac0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:50.949465 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c9ac32-52d6-4bcd-88d4-ee5164d0e252 service cinder] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:50.949978 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c9ac32-52d6-4bcd-88d4-ee5164d0e252 service cinder] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:50.950247 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c9ac32-52d6-4bcd-88d4-ee5164d0e252 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:50.960292 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c9ac32-52d6-4bcd-88d4-ee5164d0e252 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:50.961888 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c9ac32-52d6-4bcd-88d4-ee5164d0e252 service cinder] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:50.971846 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1303/2620] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 15:03:50 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:03:50.999434 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56903f42-3cef-446a-96e5-b6b07e81e022 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:51.081361 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56903f42-3cef-446a-96e5-b6b07e81e022 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:51.089072 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f758f89-cca7-44d6-a3be-d564d8f29614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:51.089734 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f758f89-cca7-44d6-a3be-d564d8f29614 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:51.090015 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f758f89-cca7-44d6-a3be-d564d8f29614 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:51.090615 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f758f89-cca7-44d6-a3be-d564d8f29614 admin admin] PATH_INFO: `/v3/users/0369f322f1384218b3f26249661bb92f` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:51.091526 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f758f89-cca7-44d6-a3be-d564d8f29614 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0369f322f1384218b3f26249661bb92f)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:51.093760 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f758f89-cca7-44d6-a3be-d564d8f29614 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:51.133137 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:03:51.143780 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-2f758f89-cca7-44d6-a3be-d564d8f29614 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0369f322f1384218b3f26249661bb92f'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:51.156481 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-2f758f89-cca7-44d6-a3be-d564d8f29614 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0369f322f1384218b3f26249661bb92f'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:51.163637 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-2f758f89-cca7-44d6-a3be-d564d8f29614 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0369f322f1384218b3f26249661bb92f'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:51.171947 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-2f758f89-cca7-44d6-a3be-d564d8f29614 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0369f322f1384218b3f26249661bb92f'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:51.173312 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-2f758f89-cca7-44d6-a3be-d564d8f29614 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0369f322f1384218b3f26249661bb92f'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:51.179462 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1318/2621] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Sep 19 15:03:50 2022] DELETE /identity/v3/users/0369f322f1384218b3f26249661bb92f => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:03:51.183897 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6414d31-cf1f-4ba5-b808-730e19be2db3 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:51.184420 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6414d31-cf1f-4ba5-b808-730e19be2db3 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:51.184525 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6414d31-cf1f-4ba5-b808-730e19be2db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:51.204563 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-a6414d31-cf1f-4ba5-b808-730e19be2db3 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:03:51.205689 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-a6414d31-cf1f-4ba5-b808-730e19be2db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:51.266175 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1304/2622] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 15:03:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:03:51.275995 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f758f89-cca7-44d6-a3be-d564d8f29614 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:51.277517 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-2f758f89-cca7-44d6-a3be-d564d8f29614 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:51.338140 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f758f89-cca7-44d6-a3be-d564d8f29614 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:51.341874 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a871d30-7305-482d-a61d-cc1cd8fee990 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c2b78646374cb79ded4b7b59ba49c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:51.342560 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a871d30-7305-482d-a61d-cc1cd8fee990 service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:51.342843 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a871d30-7305-482d-a61d-cc1cd8fee990 service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:51.343113 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a871d30-7305-482d-a61d-cc1cd8fee990 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:51.353296 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a871d30-7305-482d-a61d-cc1cd8fee990 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:51.355917 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a871d30-7305-482d-a61d-cc1cd8fee990 service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:51.367057 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1319/2623] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 15:03:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:03:51.667231 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6414d31-cf1f-4ba5-b808-730e19be2db3 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:51.668801 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-a6414d31-cf1f-4ba5-b808-730e19be2db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:51.687608 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6414d31-cf1f-4ba5-b808-730e19be2db3 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:51.692963 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af02a833-e0c8-45df-8f32-0b75ccd929d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:51.693515 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af02a833-e0c8-45df-8f32-0b75ccd929d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:51.693943 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af02a833-e0c8-45df-8f32-0b75ccd929d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:51.694399 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af02a833-e0c8-45df-8f32-0b75ccd929d8 admin admin] PATH_INFO: `/v3/projects/c7412cc870bf49d8be655a89fadd9938` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:51.695651 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af02a833-e0c8-45df-8f32-0b75ccd929d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7412cc870bf49d8be655a89fadd9938)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:51.698354 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af02a833-e0c8-45df-8f32-0b75ccd929d8 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:51.765853 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-af02a833-e0c8-45df-8f32-0b75ccd929d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7412cc870bf49d8be655a89fadd9938', 'request_id': 'req-af02a833-e0c8-45df-8f32-0b75ccd929d8'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:51.776252 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-af02a833-e0c8-45df-8f32-0b75ccd929d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7412cc870bf49d8be655a89fadd9938', 'request_id': 'req-af02a833-e0c8-45df-8f32-0b75ccd929d8'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:51.784509 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-af02a833-e0c8-45df-8f32-0b75ccd929d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7412cc870bf49d8be655a89fadd9938', 'request_id': 'req-af02a833-e0c8-45df-8f32-0b75ccd929d8'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:51.797225 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-af02a833-e0c8-45df-8f32-0b75ccd929d8 admin admin] The token cache is being invalidate because project c7412cc870bf49d8be655a89fadd9938 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:03:51.797519 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-af02a833-e0c8-45df-8f32-0b75ccd929d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:51.798184 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-af02a833-e0c8-45df-8f32-0b75ccd929d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:51.800176 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1305/2624] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Sep 19 15:03:51 2022] DELETE /identity/v3/projects/c7412cc870bf49d8be655a89fadd9938 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:03:51.804912 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b6209c-7478-4d96-a59b-b9179b2f57d7 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:51.805201 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b6209c-7478-4d96-a59b-b9179b2f57d7 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:51.805538 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b6209c-7478-4d96-a59b-b9179b2f57d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:51.834935 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-37b6209c-7478-4d96-a59b-b9179b2f57d7 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:03:51.836170 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-37b6209c-7478-4d96-a59b-b9179b2f57d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:51.941719 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1320/2625] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 15:03:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:03:51.949296 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e4a514-a5db-4391-9e6a-873bb7a119d3 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:51.949575 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e4a514-a5db-4391-9e6a-873bb7a119d3 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:51.949852 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e4a514-a5db-4391-9e6a-873bb7a119d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:51.970443 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-d9e4a514-a5db-4391-9e6a-873bb7a119d3 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:03:51.971653 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-d9e4a514-a5db-4391-9e6a-873bb7a119d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:51.979720 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1306/2626] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 15:03:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:03:51.988543 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b6209c-7478-4d96-a59b-b9179b2f57d7 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:51.994271 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b6209c-7478-4d96-a59b-b9179b2f57d7 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:51.999132 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faca5c47-0704-4e3d-a54e-3ab37d29910c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:51.999728 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faca5c47-0704-4e3d-a54e-3ab37d29910c admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:52.000005 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faca5c47-0704-4e3d-a54e-3ab37d29910c admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:52.000276 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faca5c47-0704-4e3d-a54e-3ab37d29910c admin admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:52.000944 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faca5c47-0704-4e3d-a54e-3ab37d29910c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:03:52.001275 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faca5c47-0704-4e3d-a54e-3ab37d29910c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:52.002910 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faca5c47-0704-4e3d-a54e-3ab37d29910c admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:52.015100 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1321/2627] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Sep 19 15:03:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:03:52.019443 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e4a514-a5db-4391-9e6a-873bb7a119d3 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:52.028616 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e4a514-a5db-4391-9e6a-873bb7a119d3 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:52.034123 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c3f052-5c22-4893-b88f-ff5396c1ac11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:52.034709 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c3f052-5c22-4893-b88f-ff5396c1ac11 admin admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:52.034987 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c3f052-5c22-4893-b88f-ff5396c1ac11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:52.035257 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c3f052-5c22-4893-b88f-ff5396c1ac11 admin admin] PATH_INFO: `/v3/projects` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:52.035882 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c3f052-5c22-4893-b88f-ff5396c1ac11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:52.037783 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c3f052-5c22-4893-b88f-ff5396c1ac11 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:52.064354 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1307/2628] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Sep 19 15:03:52 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:03:52.068596 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faca5c47-0704-4e3d-a54e-3ab37d29910c admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:52.079381 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faca5c47-0704-4e3d-a54e-3ab37d29910c admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:52.120625 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:03:52.138712 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce5f535-1d1f-4c9b-8171-d9e193735c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:52.140232 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce5f535-1d1f-4c9b-8171-d9e193735c8b admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:52.140546 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce5f535-1d1f-4c9b-8171-d9e193735c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:52.140825 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce5f535-1d1f-4c9b-8171-d9e193735c8b admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:52.141465 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce5f535-1d1f-4c9b-8171-d9e193735c8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:52.143378 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce5f535-1d1f-4c9b-8171-d9e193735c8b admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:52.163486 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1322/2629] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Sep 19 15:03:52 2022] POST /identity/v3/users => generated 288 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:03:52.167587 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c3f052-5c22-4893-b88f-ff5396c1ac11 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:52.178630 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c3f052-5c22-4893-b88f-ff5396c1ac11 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:52.183225 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b40e8e6-dbf8-4d35-b4d4-565cbb63f50b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:52.183968 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b40e8e6-dbf8-4d35-b4d4-565cbb63f50b admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:52.184557 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b40e8e6-dbf8-4d35-b4d4-565cbb63f50b admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:52.184557 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b40e8e6-dbf8-4d35-b4d4-565cbb63f50b admin admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:52.185100 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b40e8e6-dbf8-4d35-b4d4-565cbb63f50b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:52.187211 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b40e8e6-dbf8-4d35-b4d4-565cbb63f50b admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:52.200808 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1308/2630] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 15:03:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 15:03:52.203038 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce5f535-1d1f-4c9b-8171-d9e193735c8b admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:52.214190 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce5f535-1d1f-4c9b-8171-d9e193735c8b admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:52.219691 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d305b080-3e9d-4d19-a693-c4e6e08d7bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:52.220339 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d305b080-3e9d-4d19-a693-c4e6e08d7bfe admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:52.220642 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d305b080-3e9d-4d19-a693-c4e6e08d7bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:52.220913 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d305b080-3e9d-4d19-a693-c4e6e08d7bfe admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:52.221551 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d305b080-3e9d-4d19-a693-c4e6e08d7bfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:52.223936 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d305b080-3e9d-4d19-a693-c4e6e08d7bfe admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:52.235764 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1323/2631] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 15:03:52 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:03:52.240180 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b40e8e6-dbf8-4d35-b4d4-565cbb63f50b admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:52.251152 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b40e8e6-dbf8-4d35-b4d4-565cbb63f50b admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:52.255842 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845e3880-b5ca-4fc9-ba4d-3e405589076c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:52.256523 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845e3880-b5ca-4fc9-ba4d-3e405589076c admin admin] REQUEST_METHOD: `PUT` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:52.256804 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845e3880-b5ca-4fc9-ba4d-3e405589076c admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:52.257077 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845e3880-b5ca-4fc9-ba4d-3e405589076c admin admin] PATH_INFO: `/v3/projects/afccfc7ab2fb4ed390067c185c8ec791/users/1374c3db3a13441e867b18313584bf43/roles/efa0e5b3413748dc828a89b12d67df79` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:52.273186 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845e3880-b5ca-4fc9-ba4d-3e405589076c admin admin] RBAC: Authorizing `identity:create_grant(project_id=afccfc7ab2fb4ed390067c185c8ec791, user_id=1374c3db3a13441e867b18313584bf43, role_id=efa0e5b3413748dc828a89b12d67df79)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:52.275814 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845e3880-b5ca-4fc9-ba4d-3e405589076c admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:52.291972 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1309/2632] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 15:03:52 2022] PUT /identity/v3/projects/afccfc7ab2fb4ed390067c185c8ec791/users/1374c3db3a13441e867b18313584bf43/roles/efa0e5b3413748dc828a89b12d67df79 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:03:52.302577 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc418f7d-316f-407b-9bda-009ae97ca20a None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:52.302910 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc418f7d-316f-407b-9bda-009ae97ca20a None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:52.303140 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc418f7d-316f-407b-9bda-009ae97ca20a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:52.337313 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-cc418f7d-316f-407b-9bda-009ae97ca20a None None] MFA Rules not processed for user `1374c3db3a13441e867b18313584bf43`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:03:52.338529 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-cc418f7d-316f-407b-9bda-009ae97ca20a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:52.402150 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1324/2633] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 15:03:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 15:03:52.413490 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845e3880-b5ca-4fc9-ba4d-3e405589076c admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:52.415146 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-845e3880-b5ca-4fc9-ba4d-3e405589076c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:52.426459 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:03:52.474502 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845e3880-b5ca-4fc9-ba4d-3e405589076c admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:52.478101 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c1288a-d307-4c41-830a-f92ca9ec708a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139dc7a4f1dc48fe8faea848bd1ac0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:52.478699 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c1288a-d307-4c41-830a-f92ca9ec708a service cinder] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:52.478985 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c1288a-d307-4c41-830a-f92ca9ec708a service cinder] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:52.479257 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c1288a-d307-4c41-830a-f92ca9ec708a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:52.487501 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c1288a-d307-4c41-830a-f92ca9ec708a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:52.488971 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c1288a-d307-4c41-830a-f92ca9ec708a service cinder] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:52.497622 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1310/2634] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 15:03:52 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:03:53.238955 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc418f7d-316f-407b-9bda-009ae97ca20a None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:53.240437 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-cc418f7d-316f-407b-9bda-009ae97ca20a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:53.297436 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc418f7d-316f-407b-9bda-009ae97ca20a None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:53.300979 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5078fde1-a3e0-4522-be91-207bc71d6a0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c2b78646374cb79ded4b7b59ba49c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:53.301584 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5078fde1-a3e0-4522-be91-207bc71d6a0f service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:53.301861 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5078fde1-a3e0-4522-be91-207bc71d6a0f service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:53.302135 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5078fde1-a3e0-4522-be91-207bc71d6a0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:53.303861 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-5078fde1-a3e0-4522-be91-207bc71d6a0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:53.366425 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5078fde1-a3e0-4522-be91-207bc71d6a0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:53.367895 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5078fde1-a3e0-4522-be91-207bc71d6a0f service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:53.372858 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:03:53.378119 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1325/2635] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 15:03:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:04:00.204874 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c1288a-d307-4c41-830a-f92ca9ec708a service cinder] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:00.208473 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-24c1288a-d307-4c41-830a-f92ca9ec708a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:00.224142 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c1288a-d307-4c41-830a-f92ca9ec708a service cinder] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:00.229580 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe67fc2-246b-454f-b140-ea455de13c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:00.231023 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe67fc2-246b-454f-b140-ea455de13c9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:00.231303 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe67fc2-246b-454f-b140-ea455de13c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:00.231746 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe67fc2-246b-454f-b140-ea455de13c9e admin admin] PATH_INFO: `/v3/users/c46d1b8b7dc74f82a1911f8edcd6271a` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:00.233178 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe67fc2-246b-454f-b140-ea455de13c9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c46d1b8b7dc74f82a1911f8edcd6271a)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:00.235090 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe67fc2-246b-454f-b140-ea455de13c9e admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:00.287842 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-1fe67fc2-246b-454f-b140-ea455de13c9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c46d1b8b7dc74f82a1911f8edcd6271a'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:00.301186 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-1fe67fc2-246b-454f-b140-ea455de13c9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c46d1b8b7dc74f82a1911f8edcd6271a'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:00.308797 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-1fe67fc2-246b-454f-b140-ea455de13c9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c46d1b8b7dc74f82a1911f8edcd6271a'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:00.309057 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-1fe67fc2-246b-454f-b140-ea455de13c9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c46d1b8b7dc74f82a1911f8edcd6271a'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:00.316945 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-1fe67fc2-246b-454f-b140-ea455de13c9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c46d1b8b7dc74f82a1911f8edcd6271a'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:00.323783 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1311/2636] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Sep 19 15:04:00 2022] DELETE /identity/v3/users/c46d1b8b7dc74f82a1911f8edcd6271a => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:04:00.560273 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5078fde1-a3e0-4522-be91-207bc71d6a0f service neutron] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:00.570773 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5078fde1-a3e0-4522-be91-207bc71d6a0f service neutron] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:00.662275 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b2795b-663c-4927-a575-2f7f4cf08358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:00.664167 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b2795b-663c-4927-a575-2f7f4cf08358 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:00.664387 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b2795b-663c-4927-a575-2f7f4cf08358 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:00.664671 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b2795b-663c-4927-a575-2f7f4cf08358 admin admin] PATH_INFO: `/v3/projects/ba53f89c05d840b2968884c5f4cb39e4` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:00.665841 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b2795b-663c-4927-a575-2f7f4cf08358 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba53f89c05d840b2968884c5f4cb39e4)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:00.668463 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b2795b-663c-4927-a575-2f7f4cf08358 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:00.730519 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-83b2795b-663c-4927-a575-2f7f4cf08358 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba53f89c05d840b2968884c5f4cb39e4', 'request_id': 'req-83b2795b-663c-4927-a575-2f7f4cf08358'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:00.740433 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-83b2795b-663c-4927-a575-2f7f4cf08358 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba53f89c05d840b2968884c5f4cb39e4', 'request_id': 'req-83b2795b-663c-4927-a575-2f7f4cf08358'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:00.748873 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-83b2795b-663c-4927-a575-2f7f4cf08358 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba53f89c05d840b2968884c5f4cb39e4', 'request_id': 'req-83b2795b-663c-4927-a575-2f7f4cf08358'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:00.773656 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-83b2795b-663c-4927-a575-2f7f4cf08358 admin admin] The token cache is being invalidate because project ba53f89c05d840b2968884c5f4cb39e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:04:00.773953 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-83b2795b-663c-4927-a575-2f7f4cf08358 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:00.775276 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-83b2795b-663c-4927-a575-2f7f4cf08358 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:00.781934 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1326/2637] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Sep 19 15:04:00 2022] DELETE /identity/v3/projects/ba53f89c05d840b2968884c5f4cb39e4 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:04:00.785752 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe67fc2-246b-454f-b140-ea455de13c9e admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:00.787185 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-1fe67fc2-246b-454f-b140-ea455de13c9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:00.803257 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe67fc2-246b-454f-b140-ea455de13c9e admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:00.883588 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe8bd02-d1dd-4907-8372-420d1e1635e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:00.884460 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe8bd02-d1dd-4907-8372-420d1e1635e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:00.884815 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe8bd02-d1dd-4907-8372-420d1e1635e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:00.885161 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe8bd02-d1dd-4907-8372-420d1e1635e7 admin admin] PATH_INFO: `/v3/users/e1c795967682473da65e9d2bb78a5ff1` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:00.886428 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe8bd02-d1dd-4907-8372-420d1e1635e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1c795967682473da65e9d2bb78a5ff1)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:00.892376 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe8bd02-d1dd-4907-8372-420d1e1635e7 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:00.921043 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:00.941411 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-6fe8bd02-d1dd-4907-8372-420d1e1635e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1c795967682473da65e9d2bb78a5ff1'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:00.955727 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-6fe8bd02-d1dd-4907-8372-420d1e1635e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1c795967682473da65e9d2bb78a5ff1'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:00.962690 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-6fe8bd02-d1dd-4907-8372-420d1e1635e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1c795967682473da65e9d2bb78a5ff1'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:00.963403 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-6fe8bd02-d1dd-4907-8372-420d1e1635e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1c795967682473da65e9d2bb78a5ff1'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:00.972073 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-6fe8bd02-d1dd-4907-8372-420d1e1635e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1c795967682473da65e9d2bb78a5ff1'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:00.978738 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1312/2638] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Sep 19 15:04:00 2022] DELETE /identity/v3/users/e1c795967682473da65e9d2bb78a5ff1 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:04:01.170838 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b2795b-663c-4927-a575-2f7f4cf08358 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:01.172617 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-83b2795b-663c-4927-a575-2f7f4cf08358 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:01.187716 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b2795b-663c-4927-a575-2f7f4cf08358 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:01.257389 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61df8088-cf3d-4bb2-a847-f6b0439363b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:01.258152 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61df8088-cf3d-4bb2-a847-f6b0439363b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:01.258436 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61df8088-cf3d-4bb2-a847-f6b0439363b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:01.258710 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61df8088-cf3d-4bb2-a847-f6b0439363b2 admin admin] PATH_INFO: `/v3/projects/5ca457777a8f4bf7bea435859add346f` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:01.259958 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61df8088-cf3d-4bb2-a847-f6b0439363b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ca457777a8f4bf7bea435859add346f)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:01.261984 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61df8088-cf3d-4bb2-a847-f6b0439363b2 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:01.297911 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:01.311032 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-61df8088-cf3d-4bb2-a847-f6b0439363b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ca457777a8f4bf7bea435859add346f', 'request_id': 'req-61df8088-cf3d-4bb2-a847-f6b0439363b2'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:01.318523 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-61df8088-cf3d-4bb2-a847-f6b0439363b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ca457777a8f4bf7bea435859add346f', 'request_id': 'req-61df8088-cf3d-4bb2-a847-f6b0439363b2'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:01.325551 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-61df8088-cf3d-4bb2-a847-f6b0439363b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ca457777a8f4bf7bea435859add346f', 'request_id': 'req-61df8088-cf3d-4bb2-a847-f6b0439363b2'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:01.337486 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-61df8088-cf3d-4bb2-a847-f6b0439363b2 admin admin] The token cache is being invalidate because project 5ca457777a8f4bf7bea435859add346f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:04:01.337774 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-61df8088-cf3d-4bb2-a847-f6b0439363b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:01.338416 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-61df8088-cf3d-4bb2-a847-f6b0439363b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:01.339941 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1327/2639] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Sep 19 15:04:01 2022] DELETE /identity/v3/projects/5ca457777a8f4bf7bea435859add346f => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:04:03.572890 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe8bd02-d1dd-4907-8372-420d1e1635e7 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:03.574565 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-6fe8bd02-d1dd-4907-8372-420d1e1635e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:03.634391 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe8bd02-d1dd-4907-8372-420d1e1635e7 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:03.681959 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc40cfc-6322-47a2-91a8-1ef42e247748 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c2b78646374cb79ded4b7b59ba49c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:03.682479 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc40cfc-6322-47a2-91a8-1ef42e247748 service neutron] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:03.682751 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc40cfc-6322-47a2-91a8-1ef42e247748 service neutron] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:03.683017 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc40cfc-6322-47a2-91a8-1ef42e247748 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:03.684771 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-bdc40cfc-6322-47a2-91a8-1ef42e247748 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:03.745247 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc40cfc-6322-47a2-91a8-1ef42e247748 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:03.746642 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc40cfc-6322-47a2-91a8-1ef42e247748 service neutron] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:03.756232 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1313/2640] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 15:04:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:04:04.420107 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61df8088-cf3d-4bb2-a847-f6b0439363b2 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:04.422421 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-61df8088-cf3d-4bb2-a847-f6b0439363b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:04.435053 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61df8088-cf3d-4bb2-a847-f6b0439363b2 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:04.439891 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0a9238-c51b-40cf-b640-7b5270453e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:04.440575 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0a9238-c51b-40cf-b640-7b5270453e6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:04.440860 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0a9238-c51b-40cf-b640-7b5270453e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:04.441131 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0a9238-c51b-40cf-b640-7b5270453e6d admin admin] PATH_INFO: `/v3/users/1374c3db3a13441e867b18313584bf43` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:04.442266 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0a9238-c51b-40cf-b640-7b5270453e6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1374c3db3a13441e867b18313584bf43)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:04.444197 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0a9238-c51b-40cf-b640-7b5270453e6d admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:04.493504 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-ff0a9238-c51b-40cf-b640-7b5270453e6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1374c3db3a13441e867b18313584bf43'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:04.506391 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-ff0a9238-c51b-40cf-b640-7b5270453e6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1374c3db3a13441e867b18313584bf43'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:04.513533 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-ff0a9238-c51b-40cf-b640-7b5270453e6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1374c3db3a13441e867b18313584bf43'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:04.522419 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-ff0a9238-c51b-40cf-b640-7b5270453e6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1374c3db3a13441e867b18313584bf43'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:04.523057 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-ff0a9238-c51b-40cf-b640-7b5270453e6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1374c3db3a13441e867b18313584bf43'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:04.529563 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1328/2641] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Sep 19 15:04:04 2022] DELETE /identity/v3/users/1374c3db3a13441e867b18313584bf43 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:04:04.534989 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d152b97-1d3b-40ca-a95d-feed3206ef6c None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:04.535343 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d152b97-1d3b-40ca-a95d-feed3206ef6c None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:04.535685 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d152b97-1d3b-40ca-a95d-feed3206ef6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:04.556356 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-1d152b97-1d3b-40ca-a95d-feed3206ef6c None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:04:04.557632 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-1d152b97-1d3b-40ca-a95d-feed3206ef6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:04.563429 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:04.626038 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1314/2642] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 15:04:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:04:04.635998 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0a9238-c51b-40cf-b640-7b5270453e6d admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:04.637492 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-ff0a9238-c51b-40cf-b640-7b5270453e6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:04.699562 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0a9238-c51b-40cf-b640-7b5270453e6d admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:04.703421 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80b65f4-0406-4531-87bd-230d1616609d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c2b78646374cb79ded4b7b59ba49c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:04.704027 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80b65f4-0406-4531-87bd-230d1616609d service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:04.704309 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80b65f4-0406-4531-87bd-230d1616609d service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:04.704614 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80b65f4-0406-4531-87bd-230d1616609d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:04.714065 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80b65f4-0406-4531-87bd-230d1616609d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:04.715529 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80b65f4-0406-4531-87bd-230d1616609d service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:04.725388 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1329/2643] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 15:04:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:04:05.191571 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d152b97-1d3b-40ca-a95d-feed3206ef6c None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:05.193851 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-1d152b97-1d3b-40ca-a95d-feed3206ef6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:05.207794 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d152b97-1d3b-40ca-a95d-feed3206ef6c None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:05.211603 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcb01fd-0218-4739-a48f-4ad6d9b93f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:05.212248 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcb01fd-0218-4739-a48f-4ad6d9b93f5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:05.212622 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcb01fd-0218-4739-a48f-4ad6d9b93f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:05.212814 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcb01fd-0218-4739-a48f-4ad6d9b93f5d admin admin] PATH_INFO: `/v3/projects/afccfc7ab2fb4ed390067c185c8ec791` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:05.213924 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcb01fd-0218-4739-a48f-4ad6d9b93f5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=afccfc7ab2fb4ed390067c185c8ec791)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:05.215968 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcb01fd-0218-4739-a48f-4ad6d9b93f5d admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:05.274765 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-abcb01fd-0218-4739-a48f-4ad6d9b93f5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afccfc7ab2fb4ed390067c185c8ec791', 'request_id': 'req-abcb01fd-0218-4739-a48f-4ad6d9b93f5d'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:05.287955 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-abcb01fd-0218-4739-a48f-4ad6d9b93f5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afccfc7ab2fb4ed390067c185c8ec791', 'request_id': 'req-abcb01fd-0218-4739-a48f-4ad6d9b93f5d'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:05.294955 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-abcb01fd-0218-4739-a48f-4ad6d9b93f5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afccfc7ab2fb4ed390067c185c8ec791', 'request_id': 'req-abcb01fd-0218-4739-a48f-4ad6d9b93f5d'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:05.309000 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-abcb01fd-0218-4739-a48f-4ad6d9b93f5d admin admin] The token cache is being invalidate because project afccfc7ab2fb4ed390067c185c8ec791 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:04:05.309364 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-abcb01fd-0218-4739-a48f-4ad6d9b93f5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:05.310029 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-abcb01fd-0218-4739-a48f-4ad6d9b93f5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:05.311681 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1315/2644] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Sep 19 15:04:05 2022] DELETE /identity/v3/projects/afccfc7ab2fb4ed390067c185c8ec791 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:04:05.316712 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fadb929-46ce-482a-a239-4632e42bc3b1 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:05.317105 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fadb929-46ce-482a-a239-4632e42bc3b1 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:05.317451 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fadb929-46ce-482a-a239-4632e42bc3b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:05.340835 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-0fadb929-46ce-482a-a239-4632e42bc3b1 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:04:05.342114 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-0fadb929-46ce-482a-a239-4632e42bc3b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:05.373913 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:05.406981 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1330/2645] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 15:04:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:04:05.414569 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7376d57-af25-4fd9-af69-dbc21506673a None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:05.414855 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7376d57-af25-4fd9-af69-dbc21506673a None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:05.415127 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7376d57-af25-4fd9-af69-dbc21506673a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:05.438222 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-f7376d57-af25-4fd9-af69-dbc21506673a None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:04:05.439517 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-f7376d57-af25-4fd9-af69-dbc21506673a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:05.453673 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1316/2646] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 15:04:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:04:05.453830 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fadb929-46ce-482a-a239-4632e42bc3b1 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:05.463843 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fadb929-46ce-482a-a239-4632e42bc3b1 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:05.469344 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b11fd74-6ea8-4141-af6f-eeb72cc260d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:05.470065 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b11fd74-6ea8-4141-af6f-eeb72cc260d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:05.470446 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b11fd74-6ea8-4141-af6f-eeb72cc260d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:05.470823 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b11fd74-6ea8-4141-af6f-eeb72cc260d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:05.471607 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b11fd74-6ea8-4141-af6f-eeb72cc260d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:04:05.471978 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b11fd74-6ea8-4141-af6f-eeb72cc260d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:05.473712 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b11fd74-6ea8-4141-af6f-eeb72cc260d9 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:05.486149 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1331/2647] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Sep 19 15:04:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:04:05.490802 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7376d57-af25-4fd9-af69-dbc21506673a None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:05.500228 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7376d57-af25-4fd9-af69-dbc21506673a None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:05.505126 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eba008e-ada3-4db6-ba22-80081338571a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:05.505729 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eba008e-ada3-4db6-ba22-80081338571a admin admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:05.506012 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eba008e-ada3-4db6-ba22-80081338571a admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:05.506281 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eba008e-ada3-4db6-ba22-80081338571a admin admin] PATH_INFO: `/v3/projects` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:05.506920 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eba008e-ada3-4db6-ba22-80081338571a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:05.508843 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eba008e-ada3-4db6-ba22-80081338571a admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:05.539872 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1317/2648] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Sep 19 15:04:05 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:04:05.543808 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b11fd74-6ea8-4141-af6f-eeb72cc260d9 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:05.556277 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b11fd74-6ea8-4141-af6f-eeb72cc260d9 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:05.627197 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9468f7e2-b90e-4eef-9deb-f4fa15312c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:05.627729 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9468f7e2-b90e-4eef-9deb-f4fa15312c6b admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:05.628013 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9468f7e2-b90e-4eef-9deb-f4fa15312c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:05.628288 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9468f7e2-b90e-4eef-9deb-f4fa15312c6b admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:05.629114 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9468f7e2-b90e-4eef-9deb-f4fa15312c6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:05.631489 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9468f7e2-b90e-4eef-9deb-f4fa15312c6b admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:05.656136 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1332/2649] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Sep 19 15:04:05 2022] POST /identity/v3/users => generated 293 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 15:04:05.661381 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eba008e-ada3-4db6-ba22-80081338571a admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:05.675374 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eba008e-ada3-4db6-ba22-80081338571a admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:05.681260 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7458ab-d38f-4161-b85f-231322e72446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:05.682145 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7458ab-d38f-4161-b85f-231322e72446 admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:05.682615 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7458ab-d38f-4161-b85f-231322e72446 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:05.683057 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7458ab-d38f-4161-b85f-231322e72446 admin admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:05.684077 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7458ab-d38f-4161-b85f-231322e72446 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:05.685889 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7458ab-d38f-4161-b85f-231322e72446 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:05.697171 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1318/2650] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 15:04:05 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:04:05.701628 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9468f7e2-b90e-4eef-9deb-f4fa15312c6b admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:05.713968 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9468f7e2-b90e-4eef-9deb-f4fa15312c6b admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:05.719397 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0c2987-242e-4c7e-a15a-cf016d93e6a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:05.720413 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0c2987-242e-4c7e-a15a-cf016d93e6a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:05.720843 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0c2987-242e-4c7e-a15a-cf016d93e6a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:05.721307 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0c2987-242e-4c7e-a15a-cf016d93e6a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:05.722044 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0c2987-242e-4c7e-a15a-cf016d93e6a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:05.723872 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0c2987-242e-4c7e-a15a-cf016d93e6a0 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:05.741216 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1333/2651] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 15:04:05 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:04:05.743142 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7458ab-d38f-4161-b85f-231322e72446 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:05.756730 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7458ab-d38f-4161-b85f-231322e72446 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:05.765499 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829611a4-a434-45f6-b449-51b8fe9e3429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:05.766699 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829611a4-a434-45f6-b449-51b8fe9e3429 admin admin] REQUEST_METHOD: `PUT` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:05.766998 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829611a4-a434-45f6-b449-51b8fe9e3429 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:05.767276 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829611a4-a434-45f6-b449-51b8fe9e3429 admin admin] PATH_INFO: `/v3/projects/ba46ba34d2134f5babc7c25b15a4bf94/users/f8ae9fda584346f5b456ed962b6670bd/roles/efa0e5b3413748dc828a89b12d67df79` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:05.783821 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829611a4-a434-45f6-b449-51b8fe9e3429 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba46ba34d2134f5babc7c25b15a4bf94, user_id=f8ae9fda584346f5b456ed962b6670bd, role_id=efa0e5b3413748dc828a89b12d67df79)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:05.786642 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829611a4-a434-45f6-b449-51b8fe9e3429 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:05.801120 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1319/2652] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 15:04:05 2022] PUT /identity/v3/projects/ba46ba34d2134f5babc7c25b15a4bf94/users/f8ae9fda584346f5b456ed962b6670bd/roles/efa0e5b3413748dc828a89b12d67df79 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:04:05.812096 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d2e045-c828-4b62-bf41-ba22bff528b5 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:05.812440 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d2e045-c828-4b62-bf41-ba22bff528b5 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:05.812718 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d2e045-c828-4b62-bf41-ba22bff528b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:05.843193 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-b5d2e045-c828-4b62-bf41-ba22bff528b5 None None] MFA Rules not processed for user `f8ae9fda584346f5b456ed962b6670bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:04:05.844430 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-b5d2e045-c828-4b62-bf41-ba22bff528b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:05.928101 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1334/2653] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 15:04:05 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 15:04:05.932660 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829611a4-a434-45f6-b449-51b8fe9e3429 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:05.971150 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:06.011457 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829611a4-a434-45f6-b449-51b8fe9e3429 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:06.016658 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ad853b-b962-420f-8b0a-77661486b935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:06.017265 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ad853b-b962-420f-8b0a-77661486b935 admin admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:06.017576 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ad853b-b962-420f-8b0a-77661486b935 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:06.017854 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ad853b-b962-420f-8b0a-77661486b935 admin admin] PATH_INFO: `/v3/projects` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:06.018518 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ad853b-b962-420f-8b0a-77661486b935 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:06.020491 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ad853b-b962-420f-8b0a-77661486b935 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:06.052367 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1320/2654] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Sep 19 15:04:05 2022] POST /identity/v3/projects => generated 385 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:04:06.056217 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d2e045-c828-4b62-bf41-ba22bff528b5 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:06.067908 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d2e045-c828-4b62-bf41-ba22bff528b5 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:06.099656 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:06.129189 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c21d9ef-4da6-4452-b216-0b25a5b4b678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:06.129804 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c21d9ef-4da6-4452-b216-0b25a5b4b678 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:06.130089 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c21d9ef-4da6-4452-b216-0b25a5b4b678 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:06.130364 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c21d9ef-4da6-4452-b216-0b25a5b4b678 admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:06.130993 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c21d9ef-4da6-4452-b216-0b25a5b4b678 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:06.132966 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c21d9ef-4da6-4452-b216-0b25a5b4b678 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:06.154552 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1335/2655] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Sep 19 15:04:06 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:04:06.158139 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ad853b-b962-420f-8b0a-77661486b935 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:06.168909 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ad853b-b962-420f-8b0a-77661486b935 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:06.174206 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04806a0-efb6-48ac-b674-06747b5cdc82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:06.174803 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04806a0-efb6-48ac-b674-06747b5cdc82 admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:06.175084 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04806a0-efb6-48ac-b674-06747b5cdc82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:06.175400 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04806a0-efb6-48ac-b674-06747b5cdc82 admin admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:06.176032 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04806a0-efb6-48ac-b674-06747b5cdc82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:06.177652 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04806a0-efb6-48ac-b674-06747b5cdc82 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:06.189290 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1321/2656] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 15:04:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:04:06.194175 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c21d9ef-4da6-4452-b216-0b25a5b4b678 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:06.204163 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c21d9ef-4da6-4452-b216-0b25a5b4b678 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:06.208914 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96895f09-20c1-4d7f-8ce7-b9dbe42b6343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:06.209514 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96895f09-20c1-4d7f-8ce7-b9dbe42b6343 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:06.209796 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96895f09-20c1-4d7f-8ce7-b9dbe42b6343 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:06.210073 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96895f09-20c1-4d7f-8ce7-b9dbe42b6343 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:06.210741 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96895f09-20c1-4d7f-8ce7-b9dbe42b6343 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:06.212352 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96895f09-20c1-4d7f-8ce7-b9dbe42b6343 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:06.224840 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1336/2657] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 15:04:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:04:06.226785 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04806a0-efb6-48ac-b674-06747b5cdc82 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:06.239514 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04806a0-efb6-48ac-b674-06747b5cdc82 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:06.244167 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1421ef5e-df4c-4e34-a642-d8ba8b86d599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:06.244871 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1421ef5e-df4c-4e34-a642-d8ba8b86d599 admin admin] REQUEST_METHOD: `PUT` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:06.245151 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1421ef5e-df4c-4e34-a642-d8ba8b86d599 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:06.245422 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1421ef5e-df4c-4e34-a642-d8ba8b86d599 admin admin] PATH_INFO: `/v3/projects/0d8c0b446bb44404b9afecb443574c78/users/fa07319a349848279a43f74d1e9e8c34/roles/efa0e5b3413748dc828a89b12d67df79` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:06.261722 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1421ef5e-df4c-4e34-a642-d8ba8b86d599 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d8c0b446bb44404b9afecb443574c78, user_id=fa07319a349848279a43f74d1e9e8c34, role_id=efa0e5b3413748dc828a89b12d67df79)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:06.264672 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1421ef5e-df4c-4e34-a642-d8ba8b86d599 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:06.277909 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1322/2658] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 15:04:06 2022] PUT /identity/v3/projects/0d8c0b446bb44404b9afecb443574c78/users/fa07319a349848279a43f74d1e9e8c34/roles/efa0e5b3413748dc828a89b12d67df79 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:04:06.289715 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f2634e-47cf-48ec-964d-811410838f7c None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:06.289921 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f2634e-47cf-48ec-964d-811410838f7c None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:06.290194 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f2634e-47cf-48ec-964d-811410838f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:06.321851 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-d0f2634e-47cf-48ec-964d-811410838f7c None None] MFA Rules not processed for user `fa07319a349848279a43f74d1e9e8c34`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:04:06.323192 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-d0f2634e-47cf-48ec-964d-811410838f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:06.422078 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1337/2659] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 15:04:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:04:06.430021 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1421ef5e-df4c-4e34-a642-d8ba8b86d599 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:06.514082 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1421ef5e-df4c-4e34-a642-d8ba8b86d599 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:06.519452 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b005157-dcb6-4f6c-9576-7b77b9e2a6e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:06.520065 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b005157-dcb6-4f6c-9576-7b77b9e2a6e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:06.520385 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b005157-dcb6-4f6c-9576-7b77b9e2a6e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:06.520642 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b005157-dcb6-4f6c-9576-7b77b9e2a6e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:06.521265 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b005157-dcb6-4f6c-9576-7b77b9e2a6e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:06.523150 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b005157-dcb6-4f6c-9576-7b77b9e2a6e7 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:06.556841 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1323/2660] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Sep 19 15:04:06 2022] POST /identity/v3/projects => generated 385 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:04:06.561792 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f2634e-47cf-48ec-964d-811410838f7c None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:06.573788 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f2634e-47cf-48ec-964d-811410838f7c None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:06.645683 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fc9cae-8755-4aa3-ad20-2e02d1d6dbab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:06.646310 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc9cae-8755-4aa3-ad20-2e02d1d6dbab admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:06.646589 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc9cae-8755-4aa3-ad20-2e02d1d6dbab admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:06.646889 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc9cae-8755-4aa3-ad20-2e02d1d6dbab admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:06.647547 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fc9cae-8755-4aa3-ad20-2e02d1d6dbab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:06.649509 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fc9cae-8755-4aa3-ad20-2e02d1d6dbab admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:06.678987 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1338/2661] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Sep 19 15:04:06 2022] POST /identity/v3/users => generated 299 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 15:04:06.683132 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b005157-dcb6-4f6c-9576-7b77b9e2a6e7 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:06.693617 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b005157-dcb6-4f6c-9576-7b77b9e2a6e7 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:06.698142 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02db82b1-f036-4700-9273-e075187cfb8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:06.698716 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02db82b1-f036-4700-9273-e075187cfb8f admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:06.698996 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02db82b1-f036-4700-9273-e075187cfb8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:06.699524 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02db82b1-f036-4700-9273-e075187cfb8f admin admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:06.700155 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02db82b1-f036-4700-9273-e075187cfb8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:06.701795 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02db82b1-f036-4700-9273-e075187cfb8f admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:06.712460 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1324/2662] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 15:04:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:04:06.716923 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fc9cae-8755-4aa3-ad20-2e02d1d6dbab admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:06.727912 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fc9cae-8755-4aa3-ad20-2e02d1d6dbab admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:06.733473 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27644b0-2096-4fe0-ac50-8aa4f0e19180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:06.734226 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27644b0-2096-4fe0-ac50-8aa4f0e19180 admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:06.734574 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27644b0-2096-4fe0-ac50-8aa4f0e19180 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:06.735449 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27644b0-2096-4fe0-ac50-8aa4f0e19180 admin admin] PATH_INFO: `/v3/projects/ae1695b2d27c4143a97bea90610aaf55/users/c86f205b73db4be8884c593e07bcdcbd/roles/ddb643577b2e4e478100ec370decfaeb` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:06.751353 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27644b0-2096-4fe0-ac50-8aa4f0e19180 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae1695b2d27c4143a97bea90610aaf55, user_id=c86f205b73db4be8884c593e07bcdcbd, role_id=ddb643577b2e4e478100ec370decfaeb)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:06.754106 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27644b0-2096-4fe0-ac50-8aa4f0e19180 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:06.767800 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1339/2663] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 15:04:06 2022] PUT /identity/v3/projects/ae1695b2d27c4143a97bea90610aaf55/users/c86f205b73db4be8884c593e07bcdcbd/roles/ddb643577b2e4e478100ec370decfaeb => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:04:06.774760 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02db82b1-f036-4700-9273-e075187cfb8f admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:06.786672 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02db82b1-f036-4700-9273-e075187cfb8f admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:06.850035 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:06.863701 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116272d0-661f-437b-a1eb-f27c9b98d0be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:06.864668 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116272d0-661f-437b-a1eb-f27c9b98d0be admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:06.864903 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116272d0-661f-437b-a1eb-f27c9b98d0be admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:06.865274 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116272d0-661f-437b-a1eb-f27c9b98d0be admin admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:06.866019 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116272d0-661f-437b-a1eb-f27c9b98d0be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:06.867701 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116272d0-661f-437b-a1eb-f27c9b98d0be admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:06.880383 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1325/2664] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 15:04:06 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:04:06.883305 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27644b0-2096-4fe0-ac50-8aa4f0e19180 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:06.895360 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:06.899686 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27644b0-2096-4fe0-ac50-8aa4f0e19180 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:06.911021 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6e8691-4b85-48bd-8d83-cd0f665986ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:06.912180 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6e8691-4b85-48bd-8d83-cd0f665986ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:06.912655 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6e8691-4b85-48bd-8d83-cd0f665986ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:06.913326 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6e8691-4b85-48bd-8d83-cd0f665986ba admin admin] PATH_INFO: `/v3/projects/ae1695b2d27c4143a97bea90610aaf55/users/c86f205b73db4be8884c593e07bcdcbd/roles/ddb643577b2e4e478100ec370decfaeb` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:06.917428 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6e8691-4b85-48bd-8d83-cd0f665986ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae1695b2d27c4143a97bea90610aaf55, user_id=c86f205b73db4be8884c593e07bcdcbd, role_id=ddb643577b2e4e478100ec370decfaeb)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:06.920090 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6e8691-4b85-48bd-8d83-cd0f665986ba admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:06.940980 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1340/2665] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 15:04:06 2022] PUT /identity/v3/projects/ae1695b2d27c4143a97bea90610aaf55/users/c86f205b73db4be8884c593e07bcdcbd/roles/ddb643577b2e4e478100ec370decfaeb => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:04:06.952075 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e4247e-9239-4118-9b46-209b7c634a57 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:06.952393 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e4247e-9239-4118-9b46-209b7c634a57 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:06.952671 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e4247e-9239-4118-9b46-209b7c634a57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:06.986578 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-88e4247e-9239-4118-9b46-209b7c634a57 None None] MFA Rules not processed for user `c86f205b73db4be8884c593e07bcdcbd`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:04:06.987826 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-88e4247e-9239-4118-9b46-209b7c634a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:07.077580 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1326/2666] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 15:04:06 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:04:07.092110 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6e8691-4b85-48bd-8d83-cd0f665986ba admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:07.093967 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-fd6e8691-4b85-48bd-8d83-cd0f665986ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:07.187065 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e4247e-9239-4118-9b46-209b7c634a57 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:07.188493 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-88e4247e-9239-4118-9b46-209b7c634a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:07.189539 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6e8691-4b85-48bd-8d83-cd0f665986ba admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:07.193321 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97529e6b-5fb6-480f-b7d9-3ce35a8e21df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139dc7a4f1dc48fe8faea848bd1ac0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:07.193960 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97529e6b-5fb6-480f-b7d9-3ce35a8e21df service cinder] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:07.194235 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97529e6b-5fb6-480f-b7d9-3ce35a8e21df service cinder] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:07.194505 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97529e6b-5fb6-480f-b7d9-3ce35a8e21df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:07.253282 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97529e6b-5fb6-480f-b7d9-3ce35a8e21df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:07.254748 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97529e6b-5fb6-480f-b7d9-3ce35a8e21df service cinder] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:07.258919 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e4247e-9239-4118-9b46-209b7c634a57 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:07.263512 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0056bf3-58c4-4d8e-aecc-2b7d209a0830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:07.264031 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1341/2667] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 15:04:07 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:04:07.264181 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0056bf3-58c4-4d8e-aecc-2b7d209a0830 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:07.264608 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0056bf3-58c4-4d8e-aecc-2b7d209a0830 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:07.264878 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0056bf3-58c4-4d8e-aecc-2b7d209a0830 admin admin] PATH_INFO: `/v3/users/b5fbe11b49b24fdb80257652ed9fe298` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:07.266026 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0056bf3-58c4-4d8e-aecc-2b7d209a0830 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5fbe11b49b24fdb80257652ed9fe298)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:07.267948 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0056bf3-58c4-4d8e-aecc-2b7d209a0830 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:07.316395 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-b0056bf3-58c4-4d8e-aecc-2b7d209a0830 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5fbe11b49b24fdb80257652ed9fe298'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:07.328383 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-b0056bf3-58c4-4d8e-aecc-2b7d209a0830 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5fbe11b49b24fdb80257652ed9fe298'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:07.335790 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-b0056bf3-58c4-4d8e-aecc-2b7d209a0830 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5fbe11b49b24fdb80257652ed9fe298'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:07.336644 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-b0056bf3-58c4-4d8e-aecc-2b7d209a0830 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5fbe11b49b24fdb80257652ed9fe298'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:07.339226 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:07.344849 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-b0056bf3-58c4-4d8e-aecc-2b7d209a0830 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5fbe11b49b24fdb80257652ed9fe298'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:07.352037 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1327/2668] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Sep 19 15:04:07 2022] DELETE /identity/v3/users/b5fbe11b49b24fdb80257652ed9fe298 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:04:07.537010 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97529e6b-5fb6-480f-b7d9-3ce35a8e21df service cinder] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:07.552816 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97529e6b-5fb6-480f-b7d9-3ce35a8e21df service cinder] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:07.623040 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5025e0-74a3-4dda-9bd5-e92db5fcfbe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:07.623762 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5025e0-74a3-4dda-9bd5-e92db5fcfbe0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:07.623996 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5025e0-74a3-4dda-9bd5-e92db5fcfbe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:07.624271 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5025e0-74a3-4dda-9bd5-e92db5fcfbe0 admin admin] PATH_INFO: `/v3/projects/b63ae244aeb640d4a87beaf09a3454d9` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:07.625555 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5025e0-74a3-4dda-9bd5-e92db5fcfbe0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b63ae244aeb640d4a87beaf09a3454d9)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:07.627477 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5025e0-74a3-4dda-9bd5-e92db5fcfbe0 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:07.676279 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:07.677874 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-ba5025e0-74a3-4dda-9bd5-e92db5fcfbe0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b63ae244aeb640d4a87beaf09a3454d9', 'request_id': 'req-ba5025e0-74a3-4dda-9bd5-e92db5fcfbe0'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:07.685651 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-ba5025e0-74a3-4dda-9bd5-e92db5fcfbe0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b63ae244aeb640d4a87beaf09a3454d9', 'request_id': 'req-ba5025e0-74a3-4dda-9bd5-e92db5fcfbe0'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:07.691600 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-ba5025e0-74a3-4dda-9bd5-e92db5fcfbe0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b63ae244aeb640d4a87beaf09a3454d9', 'request_id': 'req-ba5025e0-74a3-4dda-9bd5-e92db5fcfbe0'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:07.703473 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-ba5025e0-74a3-4dda-9bd5-e92db5fcfbe0 admin admin] The token cache is being invalidate because project b63ae244aeb640d4a87beaf09a3454d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:04:07.703767 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-ba5025e0-74a3-4dda-9bd5-e92db5fcfbe0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:07.704448 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-ba5025e0-74a3-4dda-9bd5-e92db5fcfbe0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:07.706107 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1342/2669] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Sep 19 15:04:07 2022] DELETE /identity/v3/projects/b63ae244aeb640d4a87beaf09a3454d9 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:04:07.711277 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd170e-ab59-4f64-a05b-112a9fc4169f None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:07.711748 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd170e-ab59-4f64-a05b-112a9fc4169f None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:07.711849 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd170e-ab59-4f64-a05b-112a9fc4169f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:07.731635 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-f1dd170e-ab59-4f64-a05b-112a9fc4169f None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:04:07.732868 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-f1dd170e-ab59-4f64-a05b-112a9fc4169f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:07.792544 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1328/2670] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 15:04:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 15:04:07.800537 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fea353-1525-4a9b-aabf-f70bc22902f5 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:07.800819 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fea353-1525-4a9b-aabf-f70bc22902f5 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:07.801094 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fea353-1525-4a9b-aabf-f70bc22902f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:07.821012 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-43fea353-1525-4a9b-aabf-f70bc22902f5 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:04:07.822265 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-43fea353-1525-4a9b-aabf-f70bc22902f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:07.832931 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1343/2671] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 15:04:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:04:07.835830 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dd170e-ab59-4f64-a05b-112a9fc4169f None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:07.847462 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dd170e-ab59-4f64-a05b-112a9fc4169f None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:07.852124 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0818fa-2481-48b3-ba1a-a61cd33bdc65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:07.852770 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0818fa-2481-48b3-ba1a-a61cd33bdc65 admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:07.853043 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0818fa-2481-48b3-ba1a-a61cd33bdc65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:07.853311 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0818fa-2481-48b3-ba1a-a61cd33bdc65 admin admin] PATH_INFO: `/v3/domains` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:07.853949 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0818fa-2481-48b3-ba1a-a61cd33bdc65 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:04:07.854246 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0818fa-2481-48b3-ba1a-a61cd33bdc65 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:07.855814 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0818fa-2481-48b3-ba1a-a61cd33bdc65 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:07.867752 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1329/2672] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Sep 19 15:04:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:04:07.872218 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fea353-1525-4a9b-aabf-f70bc22902f5 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:07.882063 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fea353-1525-4a9b-aabf-f70bc22902f5 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:07.886817 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80d54c9-7db0-4eb7-b935-c3b44c3c52af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:07.887413 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80d54c9-7db0-4eb7-b935-c3b44c3c52af admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:07.887701 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80d54c9-7db0-4eb7-b935-c3b44c3c52af admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:07.888053 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80d54c9-7db0-4eb7-b935-c3b44c3c52af admin admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:07.888665 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80d54c9-7db0-4eb7-b935-c3b44c3c52af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:07.891255 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80d54c9-7db0-4eb7-b935-c3b44c3c52af admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:07.918826 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1344/2673] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Sep 19 15:04:07 2022] POST /identity/v3/projects => generated 365 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:04:07.923139 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0818fa-2481-48b3-ba1a-a61cd33bdc65 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:07.933583 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0818fa-2481-48b3-ba1a-a61cd33bdc65 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:07.990500 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70495097-3ca1-477f-821f-65e050ea5826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:07.991103 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70495097-3ca1-477f-821f-65e050ea5826 admin admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:07.991387 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70495097-3ca1-477f-821f-65e050ea5826 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:07.991661 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70495097-3ca1-477f-821f-65e050ea5826 admin admin] PATH_INFO: `/v3/users` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:07.992286 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70495097-3ca1-477f-821f-65e050ea5826 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:07.994209 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70495097-3ca1-477f-821f-65e050ea5826 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:08.016028 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1330/2674] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Sep 19 15:04:07 2022] POST /identity/v3/users => generated 283 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:04:08.020184 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80d54c9-7db0-4eb7-b935-c3b44c3c52af admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:08.030597 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80d54c9-7db0-4eb7-b935-c3b44c3c52af admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:08.035195 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eafe0d-9cbb-4eb8-8d3f-67e68949af21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:08.035786 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eafe0d-9cbb-4eb8-8d3f-67e68949af21 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:08.036065 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eafe0d-9cbb-4eb8-8d3f-67e68949af21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:08.036358 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eafe0d-9cbb-4eb8-8d3f-67e68949af21 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:08.036999 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eafe0d-9cbb-4eb8-8d3f-67e68949af21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:08.038577 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eafe0d-9cbb-4eb8-8d3f-67e68949af21 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:08.048480 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1345/2675] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 15:04:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:04:08.052351 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70495097-3ca1-477f-821f-65e050ea5826 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:08.062790 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70495097-3ca1-477f-821f-65e050ea5826 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:08.067525 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80357eb-168d-47fc-9120-336afbc17e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:08.068127 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80357eb-168d-47fc-9120-336afbc17e02 admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:08.068429 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80357eb-168d-47fc-9120-336afbc17e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:08.068705 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80357eb-168d-47fc-9120-336afbc17e02 admin admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:08.069342 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80357eb-168d-47fc-9120-336afbc17e02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:08.070912 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80357eb-168d-47fc-9120-336afbc17e02 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:08.083082 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1331/2676] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 15:04:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:04:08.087168 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eafe0d-9cbb-4eb8-8d3f-67e68949af21 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:08.097618 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eafe0d-9cbb-4eb8-8d3f-67e68949af21 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:08.102678 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e66945c-991c-4883-a092-25b98ffbbdc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:08.103308 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e66945c-991c-4883-a092-25b98ffbbdc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:08.103588 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e66945c-991c-4883-a092-25b98ffbbdc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:08.103862 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e66945c-991c-4883-a092-25b98ffbbdc6 admin admin] PATH_INFO: `/v3/projects/b6a87b62c58f4469af1b156ebb4ec732/users/7903b2d84fc6485cbf07e347b539c009/roles/efa0e5b3413748dc828a89b12d67df79` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:08.119717 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e66945c-991c-4883-a092-25b98ffbbdc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6a87b62c58f4469af1b156ebb4ec732, user_id=7903b2d84fc6485cbf07e347b539c009, role_id=efa0e5b3413748dc828a89b12d67df79)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:08.122473 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e66945c-991c-4883-a092-25b98ffbbdc6 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:08.137773 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1346/2677] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 15:04:08 2022] PUT /identity/v3/projects/b6a87b62c58f4469af1b156ebb4ec732/users/7903b2d84fc6485cbf07e347b539c009/roles/efa0e5b3413748dc828a89b12d67df79 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:04:08.149096 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea42fa81-e1e5-4835-9d28-64a30b43c769 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:08.149407 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea42fa81-e1e5-4835-9d28-64a30b43c769 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:08.149681 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea42fa81-e1e5-4835-9d28-64a30b43c769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:08.183825 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-ea42fa81-e1e5-4835-9d28-64a30b43c769 None None] MFA Rules not processed for user `7903b2d84fc6485cbf07e347b539c009`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:04:08.185864 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-ea42fa81-e1e5-4835-9d28-64a30b43c769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:08.235189 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:08.254314 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1332/2678] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 15:04:08 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 15:04:08.266187 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e66945c-991c-4883-a092-25b98ffbbdc6 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:08.267912 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-5e66945c-991c-4883-a092-25b98ffbbdc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:08.326046 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e66945c-991c-4883-a092-25b98ffbbdc6 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:08.330218 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20849ec1-5ca2-4cae-b90b-603f0c9aa789 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139dc7a4f1dc48fe8faea848bd1ac0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:08.330845 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20849ec1-5ca2-4cae-b90b-603f0c9aa789 service cinder] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:08.331127 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20849ec1-5ca2-4cae-b90b-603f0c9aa789 service cinder] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:08.331397 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20849ec1-5ca2-4cae-b90b-603f0c9aa789 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:08.339654 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20849ec1-5ca2-4cae-b90b-603f0c9aa789 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:08.341100 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20849ec1-5ca2-4cae-b90b-603f0c9aa789 service cinder] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:08.350828 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1347/2679] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 15:04:08 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:04:08.800072 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea42fa81-e1e5-4835-9d28-64a30b43c769 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:08.801480 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-ea42fa81-e1e5-4835-9d28-64a30b43c769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:08.813955 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea42fa81-e1e5-4835-9d28-64a30b43c769 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:08.817598 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76ba52e-7c69-491d-981c-2e419a4d35d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139dc7a4f1dc48fe8faea848bd1ac0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:08.818182 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76ba52e-7c69-491d-981c-2e419a4d35d8 service cinder] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:08.818454 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76ba52e-7c69-491d-981c-2e419a4d35d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:08.818724 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76ba52e-7c69-491d-981c-2e419a4d35d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:08.820382 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-b76ba52e-7c69-491d-981c-2e419a4d35d8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:08.882073 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76ba52e-7c69-491d-981c-2e419a4d35d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:08.883567 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76ba52e-7c69-491d-981c-2e419a4d35d8 service cinder] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:08.893475 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1333/2680] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 15:04:08 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:04:09.410422 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20849ec1-5ca2-4cae-b90b-603f0c9aa789 service cinder] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:09.419114 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20849ec1-5ca2-4cae-b90b-603f0c9aa789 service cinder] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:09.423346 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9f4e41-d795-4f79-861b-551a9dff8377 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139dc7a4f1dc48fe8faea848bd1ac0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:09.423940 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f4e41-d795-4f79-861b-551a9dff8377 service cinder] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:09.424220 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f4e41-d795-4f79-861b-551a9dff8377 service cinder] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:09.424525 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f4e41-d795-4f79-861b-551a9dff8377 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:09.426260 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-8c9f4e41-d795-4f79-861b-551a9dff8377 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:09.488168 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9f4e41-d795-4f79-861b-551a9dff8377 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:09.489630 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9f4e41-d795-4f79-861b-551a9dff8377 service cinder] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:09.498986 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1348/2681] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 15:04:09 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:04:13.376573 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76ba52e-7c69-491d-981c-2e419a4d35d8 service cinder] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:13.381196 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-b76ba52e-7c69-491d-981c-2e419a4d35d8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:13.446175 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76ba52e-7c69-491d-981c-2e419a4d35d8 service cinder] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:13.450928 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553a8cbf-38d0-45a2-a05a-af797a1f6e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:13.451548 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553a8cbf-38d0-45a2-a05a-af797a1f6e1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:13.451837 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553a8cbf-38d0-45a2-a05a-af797a1f6e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:13.452087 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553a8cbf-38d0-45a2-a05a-af797a1f6e1f admin admin] PATH_INFO: `/v3/users/f8ae9fda584346f5b456ed962b6670bd` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:13.453245 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553a8cbf-38d0-45a2-a05a-af797a1f6e1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8ae9fda584346f5b456ed962b6670bd)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:13.455938 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553a8cbf-38d0-45a2-a05a-af797a1f6e1f admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:13.502157 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-553a8cbf-38d0-45a2-a05a-af797a1f6e1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8ae9fda584346f5b456ed962b6670bd'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:13.514189 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-553a8cbf-38d0-45a2-a05a-af797a1f6e1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8ae9fda584346f5b456ed962b6670bd'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:13.521661 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-553a8cbf-38d0-45a2-a05a-af797a1f6e1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8ae9fda584346f5b456ed962b6670bd'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:13.522348 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-553a8cbf-38d0-45a2-a05a-af797a1f6e1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8ae9fda584346f5b456ed962b6670bd'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:13.529743 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-553a8cbf-38d0-45a2-a05a-af797a1f6e1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8ae9fda584346f5b456ed962b6670bd'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:13.536549 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1334/2682] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Sep 19 15:04:13 2022] DELETE /identity/v3/users/f8ae9fda584346f5b456ed962b6670bd => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:04:13.541090 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a48b76-f451-4427-a571-d550da65fecc None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:13.541555 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a48b76-f451-4427-a571-d550da65fecc None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:13.541760 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a48b76-f451-4427-a571-d550da65fecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:13.564444 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-d2a48b76-f451-4427-a571-d550da65fecc None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:04:13.565585 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-d2a48b76-f451-4427-a571-d550da65fecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:13.569817 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:13.630397 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1349/2683] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 15:04:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:04:13.640100 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553a8cbf-38d0-45a2-a05a-af797a1f6e1f admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:13.641691 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-553a8cbf-38d0-45a2-a05a-af797a1f6e1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:13.652079 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:13.707393 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553a8cbf-38d0-45a2-a05a-af797a1f6e1f admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:13.710976 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dffaf8-9de0-48b9-bea2-2e52a80ae955 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c2b78646374cb79ded4b7b59ba49c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:13.711581 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dffaf8-9de0-48b9-bea2-2e52a80ae955 service neutron] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:13.711948 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dffaf8-9de0-48b9-bea2-2e52a80ae955 service neutron] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:13.712218 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dffaf8-9de0-48b9-bea2-2e52a80ae955 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:13.722625 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dffaf8-9de0-48b9-bea2-2e52a80ae955 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:13.724075 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dffaf8-9de0-48b9-bea2-2e52a80ae955 service neutron] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:13.733982 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1335/2684] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 15:04:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:04:14.002213 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a48b76-f451-4427-a571-d550da65fecc None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:14.003645 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-d2a48b76-f451-4427-a571-d550da65fecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:14.015380 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a48b76-f451-4427-a571-d550da65fecc None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:14.020680 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fd5f6f-63a8-4dad-a840-c934b96ebd94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:14.021307 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd5f6f-63a8-4dad-a840-c934b96ebd94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:14.021584 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd5f6f-63a8-4dad-a840-c934b96ebd94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:14.021849 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd5f6f-63a8-4dad-a840-c934b96ebd94 admin admin] PATH_INFO: `/v3/projects/ba46ba34d2134f5babc7c25b15a4bf94` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:14.022960 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fd5f6f-63a8-4dad-a840-c934b96ebd94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba46ba34d2134f5babc7c25b15a4bf94)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:14.024878 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fd5f6f-63a8-4dad-a840-c934b96ebd94 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:14.073197 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-36fd5f6f-63a8-4dad-a840-c934b96ebd94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba46ba34d2134f5babc7c25b15a4bf94', 'request_id': 'req-36fd5f6f-63a8-4dad-a840-c934b96ebd94'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:14.080903 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-36fd5f6f-63a8-4dad-a840-c934b96ebd94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba46ba34d2134f5babc7c25b15a4bf94', 'request_id': 'req-36fd5f6f-63a8-4dad-a840-c934b96ebd94'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:14.086469 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-36fd5f6f-63a8-4dad-a840-c934b96ebd94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba46ba34d2134f5babc7c25b15a4bf94', 'request_id': 'req-36fd5f6f-63a8-4dad-a840-c934b96ebd94'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:14.097923 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-36fd5f6f-63a8-4dad-a840-c934b96ebd94 admin admin] The token cache is being invalidate because project ba46ba34d2134f5babc7c25b15a4bf94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:04:14.098216 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-36fd5f6f-63a8-4dad-a840-c934b96ebd94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:14.098873 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-36fd5f6f-63a8-4dad-a840-c934b96ebd94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:14.100350 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1350/2685] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Sep 19 15:04:14 2022] DELETE /identity/v3/projects/ba46ba34d2134f5babc7c25b15a4bf94 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:04:14.104320 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dffaf8-9de0-48b9-bea2-2e52a80ae955 service neutron] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:14.114614 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dffaf8-9de0-48b9-bea2-2e52a80ae955 service neutron] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:14.170504 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a64279-13ac-4ad9-8de9-53881b1f97b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:14.171115 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a64279-13ac-4ad9-8de9-53881b1f97b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:14.171399 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a64279-13ac-4ad9-8de9-53881b1f97b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:14.171678 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a64279-13ac-4ad9-8de9-53881b1f97b4 admin admin] PATH_INFO: `/v3/users/fa07319a349848279a43f74d1e9e8c34` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:14.173597 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a64279-13ac-4ad9-8de9-53881b1f97b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa07319a349848279a43f74d1e9e8c34)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:14.175491 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a64279-13ac-4ad9-8de9-53881b1f97b4 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:14.221242 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-69a64279-13ac-4ad9-8de9-53881b1f97b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa07319a349848279a43f74d1e9e8c34'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:14.232826 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-69a64279-13ac-4ad9-8de9-53881b1f97b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa07319a349848279a43f74d1e9e8c34'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:14.239734 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-69a64279-13ac-4ad9-8de9-53881b1f97b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa07319a349848279a43f74d1e9e8c34'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:14.240421 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-69a64279-13ac-4ad9-8de9-53881b1f97b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa07319a349848279a43f74d1e9e8c34'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:14.247555 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-69a64279-13ac-4ad9-8de9-53881b1f97b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa07319a349848279a43f74d1e9e8c34'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:14.253477 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1336/2686] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Sep 19 15:04:14 2022] DELETE /identity/v3/users/fa07319a349848279a43f74d1e9e8c34 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:04:14.530357 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fd5f6f-63a8-4dad-a840-c934b96ebd94 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:14.532546 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-36fd5f6f-63a8-4dad-a840-c934b96ebd94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:14.548596 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fd5f6f-63a8-4dad-a840-c934b96ebd94 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:14.621106 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75752b71-9ae4-46ed-bb07-300ad9e44ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:14.621423 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75752b71-9ae4-46ed-bb07-300ad9e44ad9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:14.621708 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75752b71-9ae4-46ed-bb07-300ad9e44ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:14.621987 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75752b71-9ae4-46ed-bb07-300ad9e44ad9 admin admin] PATH_INFO: `/v3/projects/0d8c0b446bb44404b9afecb443574c78` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:14.623116 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75752b71-9ae4-46ed-bb07-300ad9e44ad9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d8c0b446bb44404b9afecb443574c78)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:14.625140 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75752b71-9ae4-46ed-bb07-300ad9e44ad9 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:14.664733 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:14.678070 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-75752b71-9ae4-46ed-bb07-300ad9e44ad9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d8c0b446bb44404b9afecb443574c78', 'request_id': 'req-75752b71-9ae4-46ed-bb07-300ad9e44ad9'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:14.685893 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-75752b71-9ae4-46ed-bb07-300ad9e44ad9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d8c0b446bb44404b9afecb443574c78', 'request_id': 'req-75752b71-9ae4-46ed-bb07-300ad9e44ad9'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:14.692574 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-75752b71-9ae4-46ed-bb07-300ad9e44ad9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d8c0b446bb44404b9afecb443574c78', 'request_id': 'req-75752b71-9ae4-46ed-bb07-300ad9e44ad9'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:14.704447 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-75752b71-9ae4-46ed-bb07-300ad9e44ad9 admin admin] The token cache is being invalidate because project 0d8c0b446bb44404b9afecb443574c78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:04:14.704746 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-75752b71-9ae4-46ed-bb07-300ad9e44ad9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:14.705400 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-75752b71-9ae4-46ed-bb07-300ad9e44ad9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:14.706960 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1351/2687] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Sep 19 15:04:14 2022] DELETE /identity/v3/projects/0d8c0b446bb44404b9afecb443574c78 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:04:14.710992 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a64279-13ac-4ad9-8de9-53881b1f97b4 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:14.712462 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-69a64279-13ac-4ad9-8de9-53881b1f97b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:14.727206 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a64279-13ac-4ad9-8de9-53881b1f97b4 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:14.755301 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:14.788573 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8ff31c-27d8-4724-b41c-3c5edf7817da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:14.789213 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8ff31c-27d8-4724-b41c-3c5edf7817da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:14.789491 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8ff31c-27d8-4724-b41c-3c5edf7817da admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:14.789762 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8ff31c-27d8-4724-b41c-3c5edf7817da admin admin] PATH_INFO: `/v3/users/c86f205b73db4be8884c593e07bcdcbd` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:14.790898 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8ff31c-27d8-4724-b41c-3c5edf7817da admin admin] RBAC: Authorizing `identity:delete_user(user_id=c86f205b73db4be8884c593e07bcdcbd)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:14.792821 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8ff31c-27d8-4724-b41c-3c5edf7817da admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:14.850606 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-4f8ff31c-27d8-4724-b41c-3c5edf7817da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c86f205b73db4be8884c593e07bcdcbd'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:14.866540 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-4f8ff31c-27d8-4724-b41c-3c5edf7817da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c86f205b73db4be8884c593e07bcdcbd'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:14.873451 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-4f8ff31c-27d8-4724-b41c-3c5edf7817da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c86f205b73db4be8884c593e07bcdcbd'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:14.874121 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-4f8ff31c-27d8-4724-b41c-3c5edf7817da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c86f205b73db4be8884c593e07bcdcbd'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:14.883320 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-4f8ff31c-27d8-4724-b41c-3c5edf7817da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c86f205b73db4be8884c593e07bcdcbd'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:14.889632 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1337/2688] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Sep 19 15:04:14 2022] DELETE /identity/v3/users/c86f205b73db4be8884c593e07bcdcbd => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:04:15.218857 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75752b71-9ae4-46ed-bb07-300ad9e44ad9 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:15.221158 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-75752b71-9ae4-46ed-bb07-300ad9e44ad9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:15.236155 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75752b71-9ae4-46ed-bb07-300ad9e44ad9 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:15.304160 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a63e819-67ee-4083-b44f-316d53656179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:15.304832 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a63e819-67ee-4083-b44f-316d53656179 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:15.305117 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a63e819-67ee-4083-b44f-316d53656179 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:15.305394 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a63e819-67ee-4083-b44f-316d53656179 admin admin] PATH_INFO: `/v3/projects/ae1695b2d27c4143a97bea90610aaf55` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:15.306529 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a63e819-67ee-4083-b44f-316d53656179 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae1695b2d27c4143a97bea90610aaf55)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:15.308479 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a63e819-67ee-4083-b44f-316d53656179 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:15.362655 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-5a63e819-67ee-4083-b44f-316d53656179 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae1695b2d27c4143a97bea90610aaf55', 'request_id': 'req-5a63e819-67ee-4083-b44f-316d53656179'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:15.370632 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-5a63e819-67ee-4083-b44f-316d53656179 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae1695b2d27c4143a97bea90610aaf55', 'request_id': 'req-5a63e819-67ee-4083-b44f-316d53656179'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:15.377980 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-5a63e819-67ee-4083-b44f-316d53656179 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae1695b2d27c4143a97bea90610aaf55', 'request_id': 'req-5a63e819-67ee-4083-b44f-316d53656179'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:15.391180 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-5a63e819-67ee-4083-b44f-316d53656179 admin admin] The token cache is being invalidate because project ae1695b2d27c4143a97bea90610aaf55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:04:15.391403 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-5a63e819-67ee-4083-b44f-316d53656179 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:15.392775 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-5a63e819-67ee-4083-b44f-316d53656179 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:15.394800 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1352/2689] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Sep 19 15:04:15 2022] DELETE /identity/v3/projects/ae1695b2d27c4143a97bea90610aaf55 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:04:16.746869 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8ff31c-27d8-4724-b41c-3c5edf7817da admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:16.748363 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-4f8ff31c-27d8-4724-b41c-3c5edf7817da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:16.761490 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8ff31c-27d8-4724-b41c-3c5edf7817da admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:16.818945 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ce9f07-4462-4e2d-aa48-e7d382f343e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:16.819571 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce9f07-4462-4e2d-aa48-e7d382f343e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:16.819856 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce9f07-4462-4e2d-aa48-e7d382f343e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:16.820122 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce9f07-4462-4e2d-aa48-e7d382f343e3 admin admin] PATH_INFO: `/v3/users/7903b2d84fc6485cbf07e347b539c009` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:16.821273 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ce9f07-4462-4e2d-aa48-e7d382f343e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7903b2d84fc6485cbf07e347b539c009)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:16.823167 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ce9f07-4462-4e2d-aa48-e7d382f343e3 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:16.868448 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-75ce9f07-4462-4e2d-aa48-e7d382f343e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7903b2d84fc6485cbf07e347b539c009'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:16.870298 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:16.882987 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-75ce9f07-4462-4e2d-aa48-e7d382f343e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7903b2d84fc6485cbf07e347b539c009'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:16.889884 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-75ce9f07-4462-4e2d-aa48-e7d382f343e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7903b2d84fc6485cbf07e347b539c009'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:16.890621 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-75ce9f07-4462-4e2d-aa48-e7d382f343e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7903b2d84fc6485cbf07e347b539c009'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:16.898648 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-75ce9f07-4462-4e2d-aa48-e7d382f343e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7903b2d84fc6485cbf07e347b539c009'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:16.904704 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1338/2690] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Sep 19 15:04:16 2022] DELETE /identity/v3/users/7903b2d84fc6485cbf07e347b539c009 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:04:16.909347 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dba0ffe-a3ea-446d-a5df-1f6280da0570 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:16.909826 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dba0ffe-a3ea-446d-a5df-1f6280da0570 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:16.910074 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dba0ffe-a3ea-446d-a5df-1f6280da0570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:16.929725 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-7dba0ffe-a3ea-446d-a5df-1f6280da0570 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:04:16.930934 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-7dba0ffe-a3ea-446d-a5df-1f6280da0570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:16.984760 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:17.002825 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1353/2691] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 15:04:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:04:17.012611 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ce9f07-4462-4e2d-aa48-e7d382f343e3 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:17.014089 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-75ce9f07-4462-4e2d-aa48-e7d382f343e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:17.071223 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ce9f07-4462-4e2d-aa48-e7d382f343e3 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:17.075115 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667bc86e-8ddc-4b71-be24-845f9cb3bc62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c2b78646374cb79ded4b7b59ba49c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:17.075713 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667bc86e-8ddc-4b71-be24-845f9cb3bc62 service neutron] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:17.075988 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667bc86e-8ddc-4b71-be24-845f9cb3bc62 service neutron] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:17.076259 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667bc86e-8ddc-4b71-be24-845f9cb3bc62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:17.085809 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667bc86e-8ddc-4b71-be24-845f9cb3bc62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:17.087211 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667bc86e-8ddc-4b71-be24-845f9cb3bc62 service neutron] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:17.096766 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1339/2692] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 15:04:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:04:17.360445 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dba0ffe-a3ea-446d-a5df-1f6280da0570 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:17.362029 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-7dba0ffe-a3ea-446d-a5df-1f6280da0570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:17.377521 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dba0ffe-a3ea-446d-a5df-1f6280da0570 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:17.383216 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ef5ad8-d669-4d15-9eb9-314f712ef404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:17.383853 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef5ad8-d669-4d15-9eb9-314f712ef404 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:17.384143 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef5ad8-d669-4d15-9eb9-314f712ef404 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:17.384463 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef5ad8-d669-4d15-9eb9-314f712ef404 admin admin] PATH_INFO: `/v3/projects/b6a87b62c58f4469af1b156ebb4ec732` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:17.385572 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ef5ad8-d669-4d15-9eb9-314f712ef404 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6a87b62c58f4469af1b156ebb4ec732)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:17.387579 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ef5ad8-d669-4d15-9eb9-314f712ef404 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:17.433673 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-91ef5ad8-d669-4d15-9eb9-314f712ef404 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6a87b62c58f4469af1b156ebb4ec732', 'request_id': 'req-91ef5ad8-d669-4d15-9eb9-314f712ef404'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:17.441354 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-91ef5ad8-d669-4d15-9eb9-314f712ef404 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6a87b62c58f4469af1b156ebb4ec732', 'request_id': 'req-91ef5ad8-d669-4d15-9eb9-314f712ef404'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:17.447489 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-91ef5ad8-d669-4d15-9eb9-314f712ef404 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6a87b62c58f4469af1b156ebb4ec732', 'request_id': 'req-91ef5ad8-d669-4d15-9eb9-314f712ef404'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:17.458709 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-91ef5ad8-d669-4d15-9eb9-314f712ef404 admin admin] The token cache is being invalidate because project b6a87b62c58f4469af1b156ebb4ec732 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:04:17.459003 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-91ef5ad8-d669-4d15-9eb9-314f712ef404 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:17.459638 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-91ef5ad8-d669-4d15-9eb9-314f712ef404 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:17.461132 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1354/2693] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Sep 19 15:04:17 2022] DELETE /identity/v3/projects/b6a87b62c58f4469af1b156ebb4ec732 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:04:17.466012 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9511d4-6e28-480f-8129-7272ef87e324 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:17.466301 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9511d4-6e28-480f-8129-7272ef87e324 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:17.466602 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9511d4-6e28-480f-8129-7272ef87e324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:17.487422 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-ba9511d4-6e28-480f-8129-7272ef87e324 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:04:17.488629 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-ba9511d4-6e28-480f-8129-7272ef87e324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:17.545927 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1340/2694] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 15:04:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:04:17.554395 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aa777a-8c1a-4461-818c-deb14f7b9173 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:17.554684 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aa777a-8c1a-4461-818c-deb14f7b9173 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:17.554987 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aa777a-8c1a-4461-818c-deb14f7b9173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:17.576454 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-82aa777a-8c1a-4461-818c-deb14f7b9173 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:04:17.577659 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-82aa777a-8c1a-4461-818c-deb14f7b9173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:17.585861 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1355/2695] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 15:04:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:04:17.590053 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9511d4-6e28-480f-8129-7272ef87e324 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:17.600055 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9511d4-6e28-480f-8129-7272ef87e324 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:17.604613 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b990f229-ddaa-4f56-8841-f0eae91b1c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:17.605202 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b990f229-ddaa-4f56-8841-f0eae91b1c30 admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:17.605481 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b990f229-ddaa-4f56-8841-f0eae91b1c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:17.605751 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b990f229-ddaa-4f56-8841-f0eae91b1c30 admin admin] PATH_INFO: `/v3/domains` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:17.606381 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b990f229-ddaa-4f56-8841-f0eae91b1c30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:04:17.606678 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b990f229-ddaa-4f56-8841-f0eae91b1c30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:17.608250 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b990f229-ddaa-4f56-8841-f0eae91b1c30 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:17.620305 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1341/2696] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Sep 19 15:04:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:04:17.624536 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aa777a-8c1a-4461-818c-deb14f7b9173 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:17.634044 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aa777a-8c1a-4461-818c-deb14f7b9173 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:17.638757 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc03ec16-ebd6-41b3-996b-ce4121afb90c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:17.639343 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc03ec16-ebd6-41b3-996b-ce4121afb90c admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:17.639625 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc03ec16-ebd6-41b3-996b-ce4121afb90c admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:17.639901 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc03ec16-ebd6-41b3-996b-ce4121afb90c admin admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:17.640583 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc03ec16-ebd6-41b3-996b-ce4121afb90c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:17.642606 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc03ec16-ebd6-41b3-996b-ce4121afb90c admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:17.669800 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1356/2697] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Sep 19 15:04:17 2022] POST /identity/v3/projects => generated 403 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:04:17.674671 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b990f229-ddaa-4f56-8841-f0eae91b1c30 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:17.684491 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b990f229-ddaa-4f56-8841-f0eae91b1c30 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:17.733503 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:17.741007 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5d29ed-4e69-4a29-ab54-a6573f7c7e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:17.741652 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5d29ed-4e69-4a29-ab54-a6573f7c7e12 admin admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:17.741979 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5d29ed-4e69-4a29-ab54-a6573f7c7e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:17.742255 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5d29ed-4e69-4a29-ab54-a6573f7c7e12 admin admin] PATH_INFO: `/v3/users` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:17.742892 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5d29ed-4e69-4a29-ab54-a6573f7c7e12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:17.745238 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5d29ed-4e69-4a29-ab54-a6573f7c7e12 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:17.765137 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1342/2698] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Sep 19 15:04:17 2022] POST /identity/v3/users => generated 302 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:04:17.769307 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc03ec16-ebd6-41b3-996b-ce4121afb90c admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:17.779721 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc03ec16-ebd6-41b3-996b-ce4121afb90c admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:17.786296 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24913ced-35a8-4ce5-a6dc-8ecac4a315dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:17.786909 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24913ced-35a8-4ce5-a6dc-8ecac4a315dd admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:17.787191 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24913ced-35a8-4ce5-a6dc-8ecac4a315dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:17.787469 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24913ced-35a8-4ce5-a6dc-8ecac4a315dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:17.788114 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24913ced-35a8-4ce5-a6dc-8ecac4a315dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:17.789747 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24913ced-35a8-4ce5-a6dc-8ecac4a315dd admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:17.801401 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1357/2699] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 15:04:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:04:17.805460 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5d29ed-4e69-4a29-ab54-a6573f7c7e12 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:17.815420 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5d29ed-4e69-4a29-ab54-a6573f7c7e12 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:17.820108 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7405dd-8c6f-427d-8247-8419e5a5ee57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:17.820733 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7405dd-8c6f-427d-8247-8419e5a5ee57 admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:17.821013 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7405dd-8c6f-427d-8247-8419e5a5ee57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:17.821284 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7405dd-8c6f-427d-8247-8419e5a5ee57 admin admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:17.821947 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7405dd-8c6f-427d-8247-8419e5a5ee57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:17.823538 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7405dd-8c6f-427d-8247-8419e5a5ee57 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:17.834320 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1343/2700] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 15:04:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 15:04:17.839063 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24913ced-35a8-4ce5-a6dc-8ecac4a315dd admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:17.851494 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24913ced-35a8-4ce5-a6dc-8ecac4a315dd admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:17.856095 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76bd01e-97f6-4781-a7c7-2581fc47cae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:17.856790 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76bd01e-97f6-4781-a7c7-2581fc47cae0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:17.857069 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76bd01e-97f6-4781-a7c7-2581fc47cae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:17.857341 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76bd01e-97f6-4781-a7c7-2581fc47cae0 admin admin] PATH_INFO: `/v3/projects/cda4ffb4cb63459e94da3140813d3d02/users/a07a6a4f8fab4936bd3ae2fbb5e9e6f4/roles/efa0e5b3413748dc828a89b12d67df79` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:17.872478 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76bd01e-97f6-4781-a7c7-2581fc47cae0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cda4ffb4cb63459e94da3140813d3d02, user_id=a07a6a4f8fab4936bd3ae2fbb5e9e6f4, role_id=efa0e5b3413748dc828a89b12d67df79)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:17.875105 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76bd01e-97f6-4781-a7c7-2581fc47cae0 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:17.887856 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1358/2701] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 15:04:17 2022] PUT /identity/v3/projects/cda4ffb4cb63459e94da3140813d3d02/users/a07a6a4f8fab4936bd3ae2fbb5e9e6f4/roles/efa0e5b3413748dc828a89b12d67df79 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:04:17.898474 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57cae58-d279-4594-b554-37733e7e6a2a None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:17.898793 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57cae58-d279-4594-b554-37733e7e6a2a None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:17.899072 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57cae58-d279-4594-b554-37733e7e6a2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:17.927964 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-a57cae58-d279-4594-b554-37733e7e6a2a None None] MFA Rules not processed for user `a07a6a4f8fab4936bd3ae2fbb5e9e6f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:04:17.929274 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-a57cae58-d279-4594-b554-37733e7e6a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:17.993106 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1344/2702] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 15:04:17 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 15:04:17.997705 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76bd01e-97f6-4781-a7c7-2581fc47cae0 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:18.058727 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76bd01e-97f6-4781-a7c7-2581fc47cae0 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:18.063406 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60104c05-79a7-498e-bda0-1b240e377be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:18.064015 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60104c05-79a7-498e-bda0-1b240e377be2 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:18.064298 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60104c05-79a7-498e-bda0-1b240e377be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:18.064600 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60104c05-79a7-498e-bda0-1b240e377be2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:18.065230 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60104c05-79a7-498e-bda0-1b240e377be2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:18.067115 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60104c05-79a7-498e-bda0-1b240e377be2 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:18.096693 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:18.105319 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1359/2703] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Sep 19 15:04:17 2022] POST /identity/v3/projects => generated 405 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:04:18.109171 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57cae58-d279-4594-b554-37733e7e6a2a None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:18.120273 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57cae58-d279-4594-b554-37733e7e6a2a None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:18.182338 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e47998c-e36c-42b4-b887-998390e5c020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:18.182970 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e47998c-e36c-42b4-b887-998390e5c020 admin admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:18.183246 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e47998c-e36c-42b4-b887-998390e5c020 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:18.183515 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e47998c-e36c-42b4-b887-998390e5c020 admin admin] PATH_INFO: `/v3/users` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:18.184141 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e47998c-e36c-42b4-b887-998390e5c020 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:18.186062 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e47998c-e36c-42b4-b887-998390e5c020 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:18.207449 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1345/2704] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Sep 19 15:04:18 2022] POST /identity/v3/users => generated 309 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 15:04:18.211589 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60104c05-79a7-498e-bda0-1b240e377be2 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:18.222664 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60104c05-79a7-498e-bda0-1b240e377be2 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:18.227276 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bb31e5-438c-4f5b-aa82-1520584461ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:18.227870 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb31e5-438c-4f5b-aa82-1520584461ee admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:18.228159 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb31e5-438c-4f5b-aa82-1520584461ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:18.228497 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb31e5-438c-4f5b-aa82-1520584461ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:18.229123 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bb31e5-438c-4f5b-aa82-1520584461ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:18.230715 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bb31e5-438c-4f5b-aa82-1520584461ee admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:18.241234 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1360/2705] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 15:04:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:04:18.245419 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e47998c-e36c-42b4-b887-998390e5c020 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:18.255590 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e47998c-e36c-42b4-b887-998390e5c020 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:18.260182 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b1541a-f2f0-461f-9058-8aecc053c091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:18.260852 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b1541a-f2f0-461f-9058-8aecc053c091 admin admin] REQUEST_METHOD: `PUT` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:18.261135 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b1541a-f2f0-461f-9058-8aecc053c091 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:18.261411 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b1541a-f2f0-461f-9058-8aecc053c091 admin admin] PATH_INFO: `/v3/projects/a11374c5d0d145c98948e74f2c70637f/users/e2e43520137c40e1b933212c546dbd9b/roles/ddb643577b2e4e478100ec370decfaeb` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:18.276834 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b1541a-f2f0-461f-9058-8aecc053c091 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a11374c5d0d145c98948e74f2c70637f, user_id=e2e43520137c40e1b933212c546dbd9b, role_id=ddb643577b2e4e478100ec370decfaeb)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:18.279469 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b1541a-f2f0-461f-9058-8aecc053c091 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:18.292543 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1346/2706] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 15:04:18 2022] PUT /identity/v3/projects/a11374c5d0d145c98948e74f2c70637f/users/e2e43520137c40e1b933212c546dbd9b/roles/ddb643577b2e4e478100ec370decfaeb => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:04:18.296450 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bb31e5-438c-4f5b-aa82-1520584461ee admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:18.306535 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bb31e5-438c-4f5b-aa82-1520584461ee admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:18.363384 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97be9c89-928c-40fc-bcb0-6f6507260253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:18.363915 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be9c89-928c-40fc-bcb0-6f6507260253 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:18.364196 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be9c89-928c-40fc-bcb0-6f6507260253 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:18.364501 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be9c89-928c-40fc-bcb0-6f6507260253 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:18.365145 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97be9c89-928c-40fc-bcb0-6f6507260253 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:18.366797 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97be9c89-928c-40fc-bcb0-6f6507260253 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:18.377460 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1361/2707] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 15:04:18 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:04:18.381746 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b1541a-f2f0-461f-9058-8aecc053c091 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:18.392569 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b1541a-f2f0-461f-9058-8aecc053c091 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:18.397184 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49ee149-39f5-4df7-8514-2c2b69bc1e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:18.397827 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ee149-39f5-4df7-8514-2c2b69bc1e82 admin admin] REQUEST_METHOD: `PUT` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:18.398106 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ee149-39f5-4df7-8514-2c2b69bc1e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:18.398381 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ee149-39f5-4df7-8514-2c2b69bc1e82 admin admin] PATH_INFO: `/v3/projects/a11374c5d0d145c98948e74f2c70637f/users/e2e43520137c40e1b933212c546dbd9b/roles/ddb643577b2e4e478100ec370decfaeb` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:18.400514 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49ee149-39f5-4df7-8514-2c2b69bc1e82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a11374c5d0d145c98948e74f2c70637f, user_id=e2e43520137c40e1b933212c546dbd9b, role_id=ddb643577b2e4e478100ec370decfaeb)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:18.403190 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49ee149-39f5-4df7-8514-2c2b69bc1e82 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:18.413407 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1347/2708] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 15:04:18 2022] PUT /identity/v3/projects/a11374c5d0d145c98948e74f2c70637f/users/e2e43520137c40e1b933212c546dbd9b/roles/ddb643577b2e4e478100ec370decfaeb => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:04:18.424873 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511a8b28-b2ab-452e-98c6-3d32ef42ad20 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:18.425161 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511a8b28-b2ab-452e-98c6-3d32ef42ad20 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:18.425438 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511a8b28-b2ab-452e-98c6-3d32ef42ad20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:18.453267 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-511a8b28-b2ab-452e-98c6-3d32ef42ad20 None None] MFA Rules not processed for user `e2e43520137c40e1b933212c546dbd9b`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:04:18.455394 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-511a8b28-b2ab-452e-98c6-3d32ef42ad20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:18.522303 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1362/2709] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 15:04:18 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:04:18.533004 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49ee149-39f5-4df7-8514-2c2b69bc1e82 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:18.534728 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-a49ee149-39f5-4df7-8514-2c2b69bc1e82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:18.555123 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:18.594101 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49ee149-39f5-4df7-8514-2c2b69bc1e82 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:18.597873 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b17d70-b574-477d-98be-8d053b6f3dc7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139dc7a4f1dc48fe8faea848bd1ac0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:18.598471 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b17d70-b574-477d-98be-8d053b6f3dc7 service cinder] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:18.598752 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b17d70-b574-477d-98be-8d053b6f3dc7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:18.599026 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b17d70-b574-477d-98be-8d053b6f3dc7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:18.607957 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b17d70-b574-477d-98be-8d053b6f3dc7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:18.609413 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b17d70-b574-477d-98be-8d053b6f3dc7 service cinder] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:18.618923 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1348/2710] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 15:04:18 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:04:18.756433 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511a8b28-b2ab-452e-98c6-3d32ef42ad20 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:18.821188 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511a8b28-b2ab-452e-98c6-3d32ef42ad20 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:18.826008 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea8d687-10ef-46dd-b9f0-a44ff148641e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:18.826628 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea8d687-10ef-46dd-b9f0-a44ff148641e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:18.826911 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea8d687-10ef-46dd-b9f0-a44ff148641e admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:18.827189 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea8d687-10ef-46dd-b9f0-a44ff148641e admin admin] PATH_INFO: `/v3/users/a07a6a4f8fab4936bd3ae2fbb5e9e6f4` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:18.828303 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea8d687-10ef-46dd-b9f0-a44ff148641e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a07a6a4f8fab4936bd3ae2fbb5e9e6f4)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:18.830278 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea8d687-10ef-46dd-b9f0-a44ff148641e admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:18.840581 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=100 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:18.876836 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-dea8d687-10ef-46dd-b9f0-a44ff148641e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a07a6a4f8fab4936bd3ae2fbb5e9e6f4'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:18.888922 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-dea8d687-10ef-46dd-b9f0-a44ff148641e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a07a6a4f8fab4936bd3ae2fbb5e9e6f4'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:18.896422 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-dea8d687-10ef-46dd-b9f0-a44ff148641e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a07a6a4f8fab4936bd3ae2fbb5e9e6f4'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:18.903766 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-dea8d687-10ef-46dd-b9f0-a44ff148641e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a07a6a4f8fab4936bd3ae2fbb5e9e6f4'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:18.904415 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-dea8d687-10ef-46dd-b9f0-a44ff148641e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a07a6a4f8fab4936bd3ae2fbb5e9e6f4'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:18.910685 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1363/2711] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Sep 19 15:04:18 2022] DELETE /identity/v3/users/a07a6a4f8fab4936bd3ae2fbb5e9e6f4 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:04:18.915195 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2ba950-5ea4-490d-b2e1-00d3b83c4f35 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:18.915673 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2ba950-5ea4-490d-b2e1-00d3b83c4f35 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:18.915817 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2ba950-5ea4-490d-b2e1-00d3b83c4f35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:18.934980 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-4c2ba950-5ea4-490d-b2e1-00d3b83c4f35 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:04:18.936208 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-4c2ba950-5ea4-490d-b2e1-00d3b83c4f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:18.995510 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1349/2712] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 15:04:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 15:04:19.006290 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea8d687-10ef-46dd-b9f0-a44ff148641e admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:19.007882 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-dea8d687-10ef-46dd-b9f0-a44ff148641e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:19.074934 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea8d687-10ef-46dd-b9f0-a44ff148641e admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:19.078627 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1278e458-b23c-45b3-a96d-3a952267d69b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c2b78646374cb79ded4b7b59ba49c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:19.079230 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1278e458-b23c-45b3-a96d-3a952267d69b service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:19.079516 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1278e458-b23c-45b3-a96d-3a952267d69b service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:19.079792 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1278e458-b23c-45b3-a96d-3a952267d69b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:19.088949 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1278e458-b23c-45b3-a96d-3a952267d69b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:19.090380 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1278e458-b23c-45b3-a96d-3a952267d69b service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:19.101180 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1364/2713] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 15:04:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:04:19.369810 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2ba950-5ea4-490d-b2e1-00d3b83c4f35 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:19.371300 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-4c2ba950-5ea4-490d-b2e1-00d3b83c4f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:19.386174 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2ba950-5ea4-490d-b2e1-00d3b83c4f35 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:19.390938 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659c740d-5077-4951-9718-51c14882b477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:19.392390 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c740d-5077-4951-9718-51c14882b477 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:19.392697 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c740d-5077-4951-9718-51c14882b477 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:19.392971 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c740d-5077-4951-9718-51c14882b477 admin admin] PATH_INFO: `/v3/projects/cda4ffb4cb63459e94da3140813d3d02` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:19.394133 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659c740d-5077-4951-9718-51c14882b477 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cda4ffb4cb63459e94da3140813d3d02)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:19.396041 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659c740d-5077-4951-9718-51c14882b477 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:19.443108 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-659c740d-5077-4951-9718-51c14882b477 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cda4ffb4cb63459e94da3140813d3d02', 'request_id': 'req-659c740d-5077-4951-9718-51c14882b477'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:19.450058 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-659c740d-5077-4951-9718-51c14882b477 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cda4ffb4cb63459e94da3140813d3d02', 'request_id': 'req-659c740d-5077-4951-9718-51c14882b477'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:19.457108 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-659c740d-5077-4951-9718-51c14882b477 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cda4ffb4cb63459e94da3140813d3d02', 'request_id': 'req-659c740d-5077-4951-9718-51c14882b477'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:19.467017 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-659c740d-5077-4951-9718-51c14882b477 admin admin] The token cache is being invalidate because project cda4ffb4cb63459e94da3140813d3d02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:04:19.467301 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-659c740d-5077-4951-9718-51c14882b477 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:19.467926 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-659c740d-5077-4951-9718-51c14882b477 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:19.469536 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1350/2714] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Sep 19 15:04:19 2022] DELETE /identity/v3/projects/cda4ffb4cb63459e94da3140813d3d02 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:04:19.473542 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1278e458-b23c-45b3-a96d-3a952267d69b service neutron] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:19.483150 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1278e458-b23c-45b3-a96d-3a952267d69b service neutron] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:19.539013 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d94ac99-6985-4502-9f24-b259a8ec2345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:19.539633 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d94ac99-6985-4502-9f24-b259a8ec2345 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:19.539916 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d94ac99-6985-4502-9f24-b259a8ec2345 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:19.540190 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d94ac99-6985-4502-9f24-b259a8ec2345 admin admin] PATH_INFO: `/v3/users/e2e43520137c40e1b933212c546dbd9b` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:19.541339 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d94ac99-6985-4502-9f24-b259a8ec2345 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2e43520137c40e1b933212c546dbd9b)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:19.543312 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d94ac99-6985-4502-9f24-b259a8ec2345 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:19.578398 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:19.593085 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-0d94ac99-6985-4502-9f24-b259a8ec2345 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2e43520137c40e1b933212c546dbd9b'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:19.605060 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-0d94ac99-6985-4502-9f24-b259a8ec2345 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2e43520137c40e1b933212c546dbd9b'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:19.612423 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-0d94ac99-6985-4502-9f24-b259a8ec2345 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2e43520137c40e1b933212c546dbd9b'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:19.620282 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-0d94ac99-6985-4502-9f24-b259a8ec2345 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2e43520137c40e1b933212c546dbd9b'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:19.620931 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-0d94ac99-6985-4502-9f24-b259a8ec2345 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2e43520137c40e1b933212c546dbd9b'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:19.627313 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1365/2715] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Sep 19 15:04:19 2022] DELETE /identity/v3/users/e2e43520137c40e1b933212c546dbd9b => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:04:19.893645 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659c740d-5077-4951-9718-51c14882b477 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:19.895217 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-659c740d-5077-4951-9718-51c14882b477 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:19.916729 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659c740d-5077-4951-9718-51c14882b477 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:19.959582 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:19.976712 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8201da-8db1-4532-b282-a5bbdbf5d36c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:19.977283 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8201da-8db1-4532-b282-a5bbdbf5d36c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:19.977569 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8201da-8db1-4532-b282-a5bbdbf5d36c admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:19.977843 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8201da-8db1-4532-b282-a5bbdbf5d36c admin admin] PATH_INFO: `/v3/projects/a11374c5d0d145c98948e74f2c70637f` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:19.978957 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8201da-8db1-4532-b282-a5bbdbf5d36c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a11374c5d0d145c98948e74f2c70637f)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:19.980888 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8201da-8db1-4532-b282-a5bbdbf5d36c admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:20.027844 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-3f8201da-8db1-4532-b282-a5bbdbf5d36c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a11374c5d0d145c98948e74f2c70637f', 'request_id': 'req-3f8201da-8db1-4532-b282-a5bbdbf5d36c'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:20.035170 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-3f8201da-8db1-4532-b282-a5bbdbf5d36c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a11374c5d0d145c98948e74f2c70637f', 'request_id': 'req-3f8201da-8db1-4532-b282-a5bbdbf5d36c'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:20.041620 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-3f8201da-8db1-4532-b282-a5bbdbf5d36c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a11374c5d0d145c98948e74f2c70637f', 'request_id': 'req-3f8201da-8db1-4532-b282-a5bbdbf5d36c'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:20.052663 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-3f8201da-8db1-4532-b282-a5bbdbf5d36c admin admin] The token cache is being invalidate because project a11374c5d0d145c98948e74f2c70637f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:04:20.052945 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-3f8201da-8db1-4532-b282-a5bbdbf5d36c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:20.053577 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-3f8201da-8db1-4532-b282-a5bbdbf5d36c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:20.055030 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1351/2716] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Sep 19 15:04:19 2022] DELETE /identity/v3/projects/a11374c5d0d145c98948e74f2c70637f => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:04:20.059877 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da31f412-d1c4-4b2c-894a-45c160bd4aca None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:20.060385 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da31f412-d1c4-4b2c-894a-45c160bd4aca None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:20.060486 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da31f412-d1c4-4b2c-894a-45c160bd4aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:20.080109 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-da31f412-d1c4-4b2c-894a-45c160bd4aca None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:04:20.081421 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-da31f412-d1c4-4b2c-894a-45c160bd4aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:20.140702 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1366/2717] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 15:04:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:04:20.148391 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ba1cb7-371f-477a-86cd-b0fd9db4d5f1 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:20.148675 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ba1cb7-371f-477a-86cd-b0fd9db4d5f1 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:20.148947 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ba1cb7-371f-477a-86cd-b0fd9db4d5f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:20.168969 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-24ba1cb7-371f-477a-86cd-b0fd9db4d5f1 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:04:20.170180 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-24ba1cb7-371f-477a-86cd-b0fd9db4d5f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:20.178475 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1352/2718] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 15:04:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:04:20.182574 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da31f412-d1c4-4b2c-894a-45c160bd4aca None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:20.192556 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da31f412-d1c4-4b2c-894a-45c160bd4aca None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:20.197139 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b79d96-9a8e-455d-8d40-1cdc2c7d1179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:20.197725 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b79d96-9a8e-455d-8d40-1cdc2c7d1179 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:20.198007 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b79d96-9a8e-455d-8d40-1cdc2c7d1179 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:20.198282 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b79d96-9a8e-455d-8d40-1cdc2c7d1179 admin admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:20.198920 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b79d96-9a8e-455d-8d40-1cdc2c7d1179 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:04:20.199226 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b79d96-9a8e-455d-8d40-1cdc2c7d1179 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:20.201125 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b79d96-9a8e-455d-8d40-1cdc2c7d1179 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:20.213109 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1367/2719] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Sep 19 15:04:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:04:20.217306 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ba1cb7-371f-477a-86cd-b0fd9db4d5f1 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:20.227085 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ba1cb7-371f-477a-86cd-b0fd9db4d5f1 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:20.231705 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9668a02-cddf-4c82-bc2b-ebd1377cde99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:20.232297 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9668a02-cddf-4c82-bc2b-ebd1377cde99 admin admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:20.232605 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9668a02-cddf-4c82-bc2b-ebd1377cde99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:20.232878 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9668a02-cddf-4c82-bc2b-ebd1377cde99 admin admin] PATH_INFO: `/v3/projects` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:20.233506 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9668a02-cddf-4c82-bc2b-ebd1377cde99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:20.235469 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9668a02-cddf-4c82-bc2b-ebd1377cde99 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:20.262618 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1353/2720] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Sep 19 15:04:20 2022] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:04:20.267603 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b79d96-9a8e-455d-8d40-1cdc2c7d1179 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:20.277419 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b79d96-9a8e-455d-8d40-1cdc2c7d1179 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:20.332331 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34ddda9-0bea-4bbb-aa26-a0c0030ec912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:20.332942 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ddda9-0bea-4bbb-aa26-a0c0030ec912 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:20.333220 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ddda9-0bea-4bbb-aa26-a0c0030ec912 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:20.333491 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ddda9-0bea-4bbb-aa26-a0c0030ec912 admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:20.334103 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34ddda9-0bea-4bbb-aa26-a0c0030ec912 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:20.335996 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34ddda9-0bea-4bbb-aa26-a0c0030ec912 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:20.357532 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1368/2721] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Sep 19 15:04:20 2022] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:04:20.361840 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9668a02-cddf-4c82-bc2b-ebd1377cde99 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:20.372118 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9668a02-cddf-4c82-bc2b-ebd1377cde99 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:20.376773 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65cbe5a-ea98-49e8-8a8f-ff400df2de97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:20.377355 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65cbe5a-ea98-49e8-8a8f-ff400df2de97 admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:20.377629 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65cbe5a-ea98-49e8-8a8f-ff400df2de97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:20.377896 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65cbe5a-ea98-49e8-8a8f-ff400df2de97 admin admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:20.378522 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65cbe5a-ea98-49e8-8a8f-ff400df2de97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:20.380080 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65cbe5a-ea98-49e8-8a8f-ff400df2de97 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:20.389787 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1354/2722] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 15:04:20 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:04:20.394219 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34ddda9-0bea-4bbb-aa26-a0c0030ec912 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:20.404048 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34ddda9-0bea-4bbb-aa26-a0c0030ec912 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:20.409254 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6fc796-3d13-4938-a064-0bc4c39338c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:20.409835 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6fc796-3d13-4938-a064-0bc4c39338c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:20.410115 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6fc796-3d13-4938-a064-0bc4c39338c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:20.410388 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6fc796-3d13-4938-a064-0bc4c39338c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:20.411019 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6fc796-3d13-4938-a064-0bc4c39338c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:20.412621 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6fc796-3d13-4938-a064-0bc4c39338c0 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:20.423083 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1369/2723] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 15:04:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:04:20.426909 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65cbe5a-ea98-49e8-8a8f-ff400df2de97 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:20.436842 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65cbe5a-ea98-49e8-8a8f-ff400df2de97 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:20.441557 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5712c116-38d3-4844-a401-f849ebe9b170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:20.442191 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5712c116-38d3-4844-a401-f849ebe9b170 admin admin] REQUEST_METHOD: `PUT` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:20.442471 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5712c116-38d3-4844-a401-f849ebe9b170 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:20.442743 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5712c116-38d3-4844-a401-f849ebe9b170 admin admin] PATH_INFO: `/v3/projects/64d00d2d07534efeb974a0bb731c3f2c/users/5ad9292cd1644812964476ea13586c12/roles/efa0e5b3413748dc828a89b12d67df79` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:20.457923 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5712c116-38d3-4844-a401-f849ebe9b170 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64d00d2d07534efeb974a0bb731c3f2c, user_id=5ad9292cd1644812964476ea13586c12, role_id=efa0e5b3413748dc828a89b12d67df79)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:20.460668 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5712c116-38d3-4844-a401-f849ebe9b170 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:20.474581 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1355/2724] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 15:04:20 2022] PUT /identity/v3/projects/64d00d2d07534efeb974a0bb731c3f2c/users/5ad9292cd1644812964476ea13586c12/roles/efa0e5b3413748dc828a89b12d67df79 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:04:20.484946 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b8654-b136-464e-891d-c1932a333017 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:20.485149 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b8654-b136-464e-891d-c1932a333017 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:20.485448 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b8654-b136-464e-891d-c1932a333017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:20.512167 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-989b8654-b136-464e-891d-c1932a333017 None None] MFA Rules not processed for user `5ad9292cd1644812964476ea13586c12`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:04:20.513396 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-989b8654-b136-464e-891d-c1932a333017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:20.517825 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:20.580233 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1370/2725] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 15:04:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:04:20.584834 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5712c116-38d3-4844-a401-f849ebe9b170 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:20.646813 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5712c116-38d3-4844-a401-f849ebe9b170 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:20.651421 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36605227-36cc-4782-a370-781e010402e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:20.652038 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36605227-36cc-4782-a370-781e010402e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:20.652312 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36605227-36cc-4782-a370-781e010402e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:20.652640 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36605227-36cc-4782-a370-781e010402e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:20.653266 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36605227-36cc-4782-a370-781e010402e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:20.655133 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36605227-36cc-4782-a370-781e010402e0 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:20.670527 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:20.682719 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1356/2726] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Sep 19 15:04:20 2022] POST /identity/v3/projects => generated 377 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:04:20.686764 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989b8654-b136-464e-891d-c1932a333017 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:20.697858 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989b8654-b136-464e-891d-c1932a333017 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:20.755380 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d799cc14-8189-45e4-b25b-489c6cd023b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:20.755914 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d799cc14-8189-45e4-b25b-489c6cd023b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:20.756199 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d799cc14-8189-45e4-b25b-489c6cd023b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:20.756513 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d799cc14-8189-45e4-b25b-489c6cd023b2 admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:20.757149 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d799cc14-8189-45e4-b25b-489c6cd023b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:20.759087 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d799cc14-8189-45e4-b25b-489c6cd023b2 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:20.780541 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1371/2727] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Sep 19 15:04:20 2022] POST /identity/v3/users => generated 295 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:04:20.784609 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36605227-36cc-4782-a370-781e010402e0 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:20.794677 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36605227-36cc-4782-a370-781e010402e0 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:20.799249 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54421fc7-69d6-4650-b0a8-70d340452861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:20.799840 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54421fc7-69d6-4650-b0a8-70d340452861 admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:20.800170 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54421fc7-69d6-4650-b0a8-70d340452861 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:20.800479 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54421fc7-69d6-4650-b0a8-70d340452861 admin admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:20.801119 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54421fc7-69d6-4650-b0a8-70d340452861 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:20.802691 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54421fc7-69d6-4650-b0a8-70d340452861 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:20.813484 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1357/2728] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 15:04:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:04:20.817632 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d799cc14-8189-45e4-b25b-489c6cd023b2 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:20.827779 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d799cc14-8189-45e4-b25b-489c6cd023b2 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:20.833041 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b59db0-8c89-4df1-8d2b-9841d06e8256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:20.833684 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b59db0-8c89-4df1-8d2b-9841d06e8256 admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:20.833961 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b59db0-8c89-4df1-8d2b-9841d06e8256 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:20.834235 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b59db0-8c89-4df1-8d2b-9841d06e8256 admin admin] PATH_INFO: `/v3/projects/4ec4be0b3aab4acab9a9445ac101688f/users/b1f295844d0e42e0977048a0447d0b43/roles/ddb643577b2e4e478100ec370decfaeb` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:20.848864 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b59db0-8c89-4df1-8d2b-9841d06e8256 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ec4be0b3aab4acab9a9445ac101688f, user_id=b1f295844d0e42e0977048a0447d0b43, role_id=ddb643577b2e4e478100ec370decfaeb)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:20.851501 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b59db0-8c89-4df1-8d2b-9841d06e8256 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:20.863867 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1372/2729] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 15:04:20 2022] PUT /identity/v3/projects/4ec4be0b3aab4acab9a9445ac101688f/users/b1f295844d0e42e0977048a0447d0b43/roles/ddb643577b2e4e478100ec370decfaeb => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:04:20.867806 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54421fc7-69d6-4650-b0a8-70d340452861 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:20.878669 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54421fc7-69d6-4650-b0a8-70d340452861 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:20.935978 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17517c4e-f9ab-4ca8-9178-4313bc50f818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:20.936604 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17517c4e-f9ab-4ca8-9178-4313bc50f818 admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:20.936884 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17517c4e-f9ab-4ca8-9178-4313bc50f818 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:20.937157 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17517c4e-f9ab-4ca8-9178-4313bc50f818 admin admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:20.938638 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17517c4e-f9ab-4ca8-9178-4313bc50f818 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:20.940239 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17517c4e-f9ab-4ca8-9178-4313bc50f818 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:20.950312 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1358/2730] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 15:04:20 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 15:04:20.955860 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b59db0-8c89-4df1-8d2b-9841d06e8256 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:20.966306 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b59db0-8c89-4df1-8d2b-9841d06e8256 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:20.971150 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60e0750-9fae-45b5-81e3-64ead30db84f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:20.971793 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60e0750-9fae-45b5-81e3-64ead30db84f admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:20.972075 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60e0750-9fae-45b5-81e3-64ead30db84f admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:20.972377 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60e0750-9fae-45b5-81e3-64ead30db84f admin admin] PATH_INFO: `/v3/projects/4ec4be0b3aab4acab9a9445ac101688f/users/b1f295844d0e42e0977048a0447d0b43/roles/ddb643577b2e4e478100ec370decfaeb` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:20.974281 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60e0750-9fae-45b5-81e3-64ead30db84f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ec4be0b3aab4acab9a9445ac101688f, user_id=b1f295844d0e42e0977048a0447d0b43, role_id=ddb643577b2e4e478100ec370decfaeb)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:20.976967 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60e0750-9fae-45b5-81e3-64ead30db84f admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:20.988077 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1373/2731] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 15:04:20 2022] PUT /identity/v3/projects/4ec4be0b3aab4acab9a9445ac101688f/users/b1f295844d0e42e0977048a0447d0b43/roles/ddb643577b2e4e478100ec370decfaeb => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:04:20.999347 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e474641-b23c-47ad-bd07-6810f04e21c1 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:20.999710 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e474641-b23c-47ad-bd07-6810f04e21c1 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:21.000059 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e474641-b23c-47ad-bd07-6810f04e21c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:21.028838 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-5e474641-b23c-47ad-bd07-6810f04e21c1 None None] MFA Rules not processed for user `b1f295844d0e42e0977048a0447d0b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:04:21.029975 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-5e474641-b23c-47ad-bd07-6810f04e21c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:21.099108 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1359/2732] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 15:04:20 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 15:04:21.111040 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60e0750-9fae-45b5-81e3-64ead30db84f admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:21.112809 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-e60e0750-9fae-45b5-81e3-64ead30db84f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:21.169265 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60e0750-9fae-45b5-81e3-64ead30db84f admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:21.173563 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aced59-84dd-4665-9590-5f741b4c8809 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139dc7a4f1dc48fe8faea848bd1ac0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:21.174154 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aced59-84dd-4665-9590-5f741b4c8809 service cinder] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:21.174438 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aced59-84dd-4665-9590-5f741b4c8809 service cinder] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:21.174714 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aced59-84dd-4665-9590-5f741b4c8809 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:21.183891 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:21.231594 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aced59-84dd-4665-9590-5f741b4c8809 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:21.233100 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aced59-84dd-4665-9590-5f741b4c8809 service cinder] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:21.242378 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1374/2733] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 15:04:21 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:04:22.597193 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e474641-b23c-47ad-bd07-6810f04e21c1 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:22.606902 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e474641-b23c-47ad-bd07-6810f04e21c1 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:22.610975 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2fac62-597c-4cd0-b3a6-272578e92652 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139dc7a4f1dc48fe8faea848bd1ac0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:22.611566 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2fac62-597c-4cd0-b3a6-272578e92652 service cinder] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:22.611844 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2fac62-597c-4cd0-b3a6-272578e92652 service cinder] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:22.612113 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2fac62-597c-4cd0-b3a6-272578e92652 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:22.620940 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2fac62-597c-4cd0-b3a6-272578e92652 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:22.622361 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2fac62-597c-4cd0-b3a6-272578e92652 service cinder] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:22.632434 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1360/2734] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 15:04:22 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:04:26.428900 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aced59-84dd-4665-9590-5f741b4c8809 service cinder] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:26.497105 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aced59-84dd-4665-9590-5f741b4c8809 service cinder] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:26.503632 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e210688-7217-46b4-8d70-98728631498a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:26.504650 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e210688-7217-46b4-8d70-98728631498a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:26.504849 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e210688-7217-46b4-8d70-98728631498a admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:26.505272 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e210688-7217-46b4-8d70-98728631498a admin admin] PATH_INFO: `/v3/users/5ad9292cd1644812964476ea13586c12` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:26.507166 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e210688-7217-46b4-8d70-98728631498a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ad9292cd1644812964476ea13586c12)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:26.510491 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e210688-7217-46b4-8d70-98728631498a admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:26.563709 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-2e210688-7217-46b4-8d70-98728631498a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ad9292cd1644812964476ea13586c12'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:26.576354 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-2e210688-7217-46b4-8d70-98728631498a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ad9292cd1644812964476ea13586c12'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:26.583481 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-2e210688-7217-46b4-8d70-98728631498a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ad9292cd1644812964476ea13586c12'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:26.591107 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-2e210688-7217-46b4-8d70-98728631498a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ad9292cd1644812964476ea13586c12'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:26.591829 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-2e210688-7217-46b4-8d70-98728631498a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ad9292cd1644812964476ea13586c12'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:26.598365 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1375/2735] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Sep 19 15:04:26 2022] DELETE /identity/v3/users/5ad9292cd1644812964476ea13586c12 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:04:26.603009 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c76235-a43a-4ad4-af03-040dbb60f573 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:26.603481 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c76235-a43a-4ad4-af03-040dbb60f573 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:26.603704 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c76235-a43a-4ad4-af03-040dbb60f573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:26.622755 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-04c76235-a43a-4ad4-af03-040dbb60f573 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:04:26.623948 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-04c76235-a43a-4ad4-af03-040dbb60f573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:26.674151 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:26.686923 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1361/2736] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 15:04:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:04:26.697366 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e210688-7217-46b4-8d70-98728631498a admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:26.698768 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-2e210688-7217-46b4-8d70-98728631498a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:26.733090 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:26.759153 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e210688-7217-46b4-8d70-98728631498a admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:26.762895 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470daf41-f19d-4089-881a-b4eaf8f12c17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c2b78646374cb79ded4b7b59ba49c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:26.763497 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470daf41-f19d-4089-881a-b4eaf8f12c17 service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:26.763781 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470daf41-f19d-4089-881a-b4eaf8f12c17 service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:26.764057 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470daf41-f19d-4089-881a-b4eaf8f12c17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:26.773655 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470daf41-f19d-4089-881a-b4eaf8f12c17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:26.775076 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470daf41-f19d-4089-881a-b4eaf8f12c17 service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:26.784731 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1376/2737] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 15:04:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:04:27.060146 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c76235-a43a-4ad4-af03-040dbb60f573 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:27.061647 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-04c76235-a43a-4ad4-af03-040dbb60f573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:27.075421 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c76235-a43a-4ad4-af03-040dbb60f573 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:27.081042 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6700ac7f-b3cb-49a8-bdf5-7767f280d867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:27.081692 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6700ac7f-b3cb-49a8-bdf5-7767f280d867 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:27.081973 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6700ac7f-b3cb-49a8-bdf5-7767f280d867 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:27.082246 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6700ac7f-b3cb-49a8-bdf5-7767f280d867 admin admin] PATH_INFO: `/v3/projects/64d00d2d07534efeb974a0bb731c3f2c` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:27.083392 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6700ac7f-b3cb-49a8-bdf5-7767f280d867 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64d00d2d07534efeb974a0bb731c3f2c)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:27.085407 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6700ac7f-b3cb-49a8-bdf5-7767f280d867 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:27.135926 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-6700ac7f-b3cb-49a8-bdf5-7767f280d867 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64d00d2d07534efeb974a0bb731c3f2c', 'request_id': 'req-6700ac7f-b3cb-49a8-bdf5-7767f280d867'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:27.143816 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-6700ac7f-b3cb-49a8-bdf5-7767f280d867 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64d00d2d07534efeb974a0bb731c3f2c', 'request_id': 'req-6700ac7f-b3cb-49a8-bdf5-7767f280d867'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:27.151261 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-6700ac7f-b3cb-49a8-bdf5-7767f280d867 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64d00d2d07534efeb974a0bb731c3f2c', 'request_id': 'req-6700ac7f-b3cb-49a8-bdf5-7767f280d867'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:27.163673 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-6700ac7f-b3cb-49a8-bdf5-7767f280d867 admin admin] The token cache is being invalidate because project 64d00d2d07534efeb974a0bb731c3f2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:04:27.163963 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-6700ac7f-b3cb-49a8-bdf5-7767f280d867 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:27.164660 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-6700ac7f-b3cb-49a8-bdf5-7767f280d867 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:27.166136 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1362/2738] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Sep 19 15:04:27 2022] DELETE /identity/v3/projects/64d00d2d07534efeb974a0bb731c3f2c => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:04:27.170126 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470daf41-f19d-4089-881a-b4eaf8f12c17 service neutron] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:27.180554 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470daf41-f19d-4089-881a-b4eaf8f12c17 service neutron] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:27.238644 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64df76f-8cb3-40f2-be59-3f537989a268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:27.239277 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64df76f-8cb3-40f2-be59-3f537989a268 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:27.239555 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64df76f-8cb3-40f2-be59-3f537989a268 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:27.239828 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64df76f-8cb3-40f2-be59-3f537989a268 admin admin] PATH_INFO: `/v3/users/b1f295844d0e42e0977048a0447d0b43` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:27.241020 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64df76f-8cb3-40f2-be59-3f537989a268 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1f295844d0e42e0977048a0447d0b43)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:27.242967 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64df76f-8cb3-40f2-be59-3f537989a268 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:27.287389 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-d64df76f-8cb3-40f2-be59-3f537989a268 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1f295844d0e42e0977048a0447d0b43'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:27.299869 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-d64df76f-8cb3-40f2-be59-3f537989a268 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1f295844d0e42e0977048a0447d0b43'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:27.306892 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-d64df76f-8cb3-40f2-be59-3f537989a268 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1f295844d0e42e0977048a0447d0b43'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:27.314140 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-d64df76f-8cb3-40f2-be59-3f537989a268 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1f295844d0e42e0977048a0447d0b43'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:27.314818 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-d64df76f-8cb3-40f2-be59-3f537989a268 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1f295844d0e42e0977048a0447d0b43'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:27.320956 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1377/2739] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Sep 19 15:04:27 2022] DELETE /identity/v3/users/b1f295844d0e42e0977048a0447d0b43 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:04:27.589902 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6700ac7f-b3cb-49a8-bdf5-7767f280d867 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:27.591469 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-6700ac7f-b3cb-49a8-bdf5-7767f280d867 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:27.606970 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6700ac7f-b3cb-49a8-bdf5-7767f280d867 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:27.671155 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfe3326-6a7f-4722-a24e-558c3bd424ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:27.671786 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfe3326-6a7f-4722-a24e-558c3bd424ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:27.672766 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfe3326-6a7f-4722-a24e-558c3bd424ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:27.673152 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfe3326-6a7f-4722-a24e-558c3bd424ec admin admin] PATH_INFO: `/v3/projects/4ec4be0b3aab4acab9a9445ac101688f` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:27.674320 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfe3326-6a7f-4722-a24e-558c3bd424ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ec4be0b3aab4acab9a9445ac101688f)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:27.676240 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfe3326-6a7f-4722-a24e-558c3bd424ec admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:27.725489 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-adfe3326-6a7f-4722-a24e-558c3bd424ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ec4be0b3aab4acab9a9445ac101688f', 'request_id': 'req-adfe3326-6a7f-4722-a24e-558c3bd424ec'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:27.733318 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-adfe3326-6a7f-4722-a24e-558c3bd424ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ec4be0b3aab4acab9a9445ac101688f', 'request_id': 'req-adfe3326-6a7f-4722-a24e-558c3bd424ec'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:27.740019 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-adfe3326-6a7f-4722-a24e-558c3bd424ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ec4be0b3aab4acab9a9445ac101688f', 'request_id': 'req-adfe3326-6a7f-4722-a24e-558c3bd424ec'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:27.751085 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-adfe3326-6a7f-4722-a24e-558c3bd424ec admin admin] The token cache is being invalidate because project 4ec4be0b3aab4acab9a9445ac101688f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:04:27.751371 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-adfe3326-6a7f-4722-a24e-558c3bd424ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:27.752030 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-adfe3326-6a7f-4722-a24e-558c3bd424ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:27.753654 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1363/2740] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Sep 19 15:04:27 2022] DELETE /identity/v3/projects/4ec4be0b3aab4acab9a9445ac101688f => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:04:27.758985 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b788f2dc-c1ba-4b45-9229-8554ee913d9f None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:27.759464 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b788f2dc-c1ba-4b45-9229-8554ee913d9f None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:27.759581 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b788f2dc-c1ba-4b45-9229-8554ee913d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:27.779742 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-b788f2dc-c1ba-4b45-9229-8554ee913d9f None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:04:27.781011 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-b788f2dc-c1ba-4b45-9229-8554ee913d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:27.833667 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:27.850121 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1378/2741] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 15:04:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:04:27.857958 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba123b2-8518-4260-ba86-4f41aeed339f None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:27.858349 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba123b2-8518-4260-ba86-4f41aeed339f None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:27.858628 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba123b2-8518-4260-ba86-4f41aeed339f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:27.872976 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:27.878853 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-eba123b2-8518-4260-ba86-4f41aeed339f None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:04:27.881332 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-eba123b2-8518-4260-ba86-4f41aeed339f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:27.893874 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1364/2742] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 15:04:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 15:04:27.897506 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b788f2dc-c1ba-4b45-9229-8554ee913d9f None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:27.910539 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b788f2dc-c1ba-4b45-9229-8554ee913d9f None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:27.915558 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2366d2-d303-44b5-8dcf-d2f627d6f22f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:27.916177 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2366d2-d303-44b5-8dcf-d2f627d6f22f admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:27.916502 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2366d2-d303-44b5-8dcf-d2f627d6f22f admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:27.916782 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2366d2-d303-44b5-8dcf-d2f627d6f22f admin admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:27.917454 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2366d2-d303-44b5-8dcf-d2f627d6f22f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:04:27.917748 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2366d2-d303-44b5-8dcf-d2f627d6f22f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:27.919380 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2366d2-d303-44b5-8dcf-d2f627d6f22f admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:27.931558 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1379/2743] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Sep 19 15:04:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:04:27.935934 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba123b2-8518-4260-ba86-4f41aeed339f None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:27.945531 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba123b2-8518-4260-ba86-4f41aeed339f None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:27.950589 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e5360b-4e13-46b7-bfe8-1ba828d66c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:27.951182 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e5360b-4e13-46b7-bfe8-1ba828d66c28 admin admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:27.951461 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e5360b-4e13-46b7-bfe8-1ba828d66c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:27.951731 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e5360b-4e13-46b7-bfe8-1ba828d66c28 admin admin] PATH_INFO: `/v3/projects` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:27.952432 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e5360b-4e13-46b7-bfe8-1ba828d66c28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:27.955105 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e5360b-4e13-46b7-bfe8-1ba828d66c28 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:27.983189 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1365/2744] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Sep 19 15:04:27 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 15:04:27.987461 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2366d2-d303-44b5-8dcf-d2f627d6f22f admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:27.997312 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2366d2-d303-44b5-8dcf-d2f627d6f22f admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:28.052079 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bef0a10-ce0b-4752-acf1-e218fd858ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:28.052700 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bef0a10-ce0b-4752-acf1-e218fd858ff9 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:28.052979 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bef0a10-ce0b-4752-acf1-e218fd858ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:28.053253 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bef0a10-ce0b-4752-acf1-e218fd858ff9 admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:28.053879 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bef0a10-ce0b-4752-acf1-e218fd858ff9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:28.055802 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bef0a10-ce0b-4752-acf1-e218fd858ff9 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:28.079180 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1380/2745] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Sep 19 15:04:27 2022] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 15:04:28.083430 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e5360b-4e13-46b7-bfe8-1ba828d66c28 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:28.093666 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e5360b-4e13-46b7-bfe8-1ba828d66c28 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:28.098591 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a5b02c-6675-498f-bdf8-7bf7de9eb718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:28.099176 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a5b02c-6675-498f-bdf8-7bf7de9eb718 admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:28.099454 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a5b02c-6675-498f-bdf8-7bf7de9eb718 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:28.099756 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a5b02c-6675-498f-bdf8-7bf7de9eb718 admin admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:28.100674 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a5b02c-6675-498f-bdf8-7bf7de9eb718 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:28.101988 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a5b02c-6675-498f-bdf8-7bf7de9eb718 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:28.112274 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1366/2746] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 15:04:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:04:28.116185 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bef0a10-ce0b-4752-acf1-e218fd858ff9 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:28.126921 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bef0a10-ce0b-4752-acf1-e218fd858ff9 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:28.131640 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09390d41-f1fe-4b28-b07e-4b6ee7570ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:28.132230 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09390d41-f1fe-4b28-b07e-4b6ee7570ae0 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:28.132542 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09390d41-f1fe-4b28-b07e-4b6ee7570ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:28.132843 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09390d41-f1fe-4b28-b07e-4b6ee7570ae0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:28.133480 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09390d41-f1fe-4b28-b07e-4b6ee7570ae0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:28.135060 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09390d41-f1fe-4b28-b07e-4b6ee7570ae0 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:28.146181 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1381/2747] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 15:04:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:04:28.150325 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a5b02c-6675-498f-bdf8-7bf7de9eb718 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:28.160252 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a5b02c-6675-498f-bdf8-7bf7de9eb718 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:28.165030 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07219b8-a1ae-4878-b64c-9aa3f25177cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:28.165687 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07219b8-a1ae-4878-b64c-9aa3f25177cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:28.165964 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07219b8-a1ae-4878-b64c-9aa3f25177cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:28.166233 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07219b8-a1ae-4878-b64c-9aa3f25177cc admin admin] PATH_INFO: `/v3/projects/5603228e2db949fc927da22e2388dc19/users/67402c50675740a18d81c662f62431b8/roles/efa0e5b3413748dc828a89b12d67df79` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:28.180846 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07219b8-a1ae-4878-b64c-9aa3f25177cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=5603228e2db949fc927da22e2388dc19, user_id=67402c50675740a18d81c662f62431b8, role_id=efa0e5b3413748dc828a89b12d67df79)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:28.183465 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07219b8-a1ae-4878-b64c-9aa3f25177cc admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:28.197302 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1367/2748] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 15:04:28 2022] PUT /identity/v3/projects/5603228e2db949fc927da22e2388dc19/users/67402c50675740a18d81c662f62431b8/roles/efa0e5b3413748dc828a89b12d67df79 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:04:28.208758 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c947f3-9fbd-404f-9325-174d3333f7bc None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:28.209050 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c947f3-9fbd-404f-9325-174d3333f7bc None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:28.209331 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c947f3-9fbd-404f-9325-174d3333f7bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:28.236953 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-21c947f3-9fbd-404f-9325-174d3333f7bc None None] MFA Rules not processed for user `67402c50675740a18d81c662f62431b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:04:28.238163 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-21c947f3-9fbd-404f-9325-174d3333f7bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:28.301952 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1382/2749] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 15:04:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 15:04:28.306537 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07219b8-a1ae-4878-b64c-9aa3f25177cc admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:28.367780 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07219b8-a1ae-4878-b64c-9aa3f25177cc admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:28.372242 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3b64bb-8da1-443e-8211-49c13f031396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:28.372866 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3b64bb-8da1-443e-8211-49c13f031396 admin admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:28.373142 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3b64bb-8da1-443e-8211-49c13f031396 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:28.373410 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3b64bb-8da1-443e-8211-49c13f031396 admin admin] PATH_INFO: `/v3/projects` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:28.374028 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3b64bb-8da1-443e-8211-49c13f031396 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:28.376651 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3b64bb-8da1-443e-8211-49c13f031396 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:28.402495 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1368/2750] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Sep 19 15:04:28 2022] POST /identity/v3/projects => generated 383 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 15:04:28.406714 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c947f3-9fbd-404f-9325-174d3333f7bc None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:28.417455 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c947f3-9fbd-404f-9325-174d3333f7bc None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:28.462069 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:28.475168 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4743c5a2-d7cf-48c0-950c-58b9b0ade822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:28.475772 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4743c5a2-d7cf-48c0-950c-58b9b0ade822 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:28.476054 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4743c5a2-d7cf-48c0-950c-58b9b0ade822 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:28.476342 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4743c5a2-d7cf-48c0-950c-58b9b0ade822 admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:28.476988 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4743c5a2-d7cf-48c0-950c-58b9b0ade822 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:28.478963 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4743c5a2-d7cf-48c0-950c-58b9b0ade822 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:28.499928 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1383/2751] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Sep 19 15:04:28 2022] POST /identity/v3/users => generated 298 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:04:28.504616 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3b64bb-8da1-443e-8211-49c13f031396 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:28.514800 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3b64bb-8da1-443e-8211-49c13f031396 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:28.519545 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e91b132-984a-4da8-88e9-3e2d39125dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:28.520138 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e91b132-984a-4da8-88e9-3e2d39125dc1 admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:28.520452 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e91b132-984a-4da8-88e9-3e2d39125dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:28.520728 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e91b132-984a-4da8-88e9-3e2d39125dc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:28.521370 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e91b132-984a-4da8-88e9-3e2d39125dc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:28.522950 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e91b132-984a-4da8-88e9-3e2d39125dc1 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:28.533520 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1369/2752] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 15:04:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:04:28.537507 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4743c5a2-d7cf-48c0-950c-58b9b0ade822 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:28.547924 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4743c5a2-d7cf-48c0-950c-58b9b0ade822 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:28.552784 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223be2a9-8003-4f10-add9-a498e2406676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:28.553479 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223be2a9-8003-4f10-add9-a498e2406676 admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:28.553747 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223be2a9-8003-4f10-add9-a498e2406676 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:28.554118 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223be2a9-8003-4f10-add9-a498e2406676 admin admin] PATH_INFO: `/v3/projects/aa4ba7226f3a47e8bc9ca77c0429981f/users/0b05b52f07e944278285f493a9214bb0/roles/ddb643577b2e4e478100ec370decfaeb` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:28.570765 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223be2a9-8003-4f10-add9-a498e2406676 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa4ba7226f3a47e8bc9ca77c0429981f, user_id=0b05b52f07e944278285f493a9214bb0, role_id=ddb643577b2e4e478100ec370decfaeb)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:28.573485 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223be2a9-8003-4f10-add9-a498e2406676 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:28.586859 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1384/2753] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 15:04:28 2022] PUT /identity/v3/projects/aa4ba7226f3a47e8bc9ca77c0429981f/users/0b05b52f07e944278285f493a9214bb0/roles/ddb643577b2e4e478100ec370decfaeb => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:04:28.590784 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e91b132-984a-4da8-88e9-3e2d39125dc1 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:28.600972 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e91b132-984a-4da8-88e9-3e2d39125dc1 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:28.655757 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcbf21b-b775-4f9b-a5e8-285dbaad21ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:28.656506 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcbf21b-b775-4f9b-a5e8-285dbaad21ba admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:28.656628 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcbf21b-b775-4f9b-a5e8-285dbaad21ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:28.656951 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcbf21b-b775-4f9b-a5e8-285dbaad21ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:28.657673 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcbf21b-b775-4f9b-a5e8-285dbaad21ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:28.659390 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcbf21b-b775-4f9b-a5e8-285dbaad21ba admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:28.669531 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1370/2754] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 15:04:28 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 15:04:28.674522 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223be2a9-8003-4f10-add9-a498e2406676 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:28.685051 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223be2a9-8003-4f10-add9-a498e2406676 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:28.690782 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e7328a-0465-4a31-bb2c-ab4d5befb189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:28.691429 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e7328a-0465-4a31-bb2c-ab4d5befb189 admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:28.691711 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e7328a-0465-4a31-bb2c-ab4d5befb189 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:28.691988 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e7328a-0465-4a31-bb2c-ab4d5befb189 admin admin] PATH_INFO: `/v3/projects/aa4ba7226f3a47e8bc9ca77c0429981f/users/0b05b52f07e944278285f493a9214bb0/roles/ddb643577b2e4e478100ec370decfaeb` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:28.693946 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e7328a-0465-4a31-bb2c-ab4d5befb189 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa4ba7226f3a47e8bc9ca77c0429981f, user_id=0b05b52f07e944278285f493a9214bb0, role_id=ddb643577b2e4e478100ec370decfaeb)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:28.696588 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e7328a-0465-4a31-bb2c-ab4d5befb189 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:28.707270 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1385/2755] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 15:04:28 2022] PUT /identity/v3/projects/aa4ba7226f3a47e8bc9ca77c0429981f/users/0b05b52f07e944278285f493a9214bb0/roles/ddb643577b2e4e478100ec370decfaeb => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:04:28.718194 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f8698-080d-45b0-a252-6a6d3c8e1ecd None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:28.718510 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f8698-080d-45b0-a252-6a6d3c8e1ecd None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:28.718790 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f8698-080d-45b0-a252-6a6d3c8e1ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:28.744068 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:28.747481 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-d95f8698-080d-45b0-a252-6a6d3c8e1ecd None None] MFA Rules not processed for user `0b05b52f07e944278285f493a9214bb0`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:04:28.749284 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-d95f8698-080d-45b0-a252-6a6d3c8e1ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:28.818724 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1371/2756] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 15:04:28 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:04:28.829839 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e7328a-0465-4a31-bb2c-ab4d5befb189 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:28.831578 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-a7e7328a-0465-4a31-bb2c-ab4d5befb189 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:29.010692 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e7328a-0465-4a31-bb2c-ab4d5befb189 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:29.014388 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9581e5e-deb9-4848-b525-53f589b3a4d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139dc7a4f1dc48fe8faea848bd1ac0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:29.014989 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9581e5e-deb9-4848-b525-53f589b3a4d2 service cinder] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:29.015254 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9581e5e-deb9-4848-b525-53f589b3a4d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:29.015530 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9581e5e-deb9-4848-b525-53f589b3a4d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:29.025973 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9581e5e-deb9-4848-b525-53f589b3a4d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:29.027387 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9581e5e-deb9-4848-b525-53f589b3a4d2 service cinder] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:29.037916 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1386/2757] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 15:04:28 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:04:29.144278 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95f8698-080d-45b0-a252-6a6d3c8e1ecd None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:29.154186 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95f8698-080d-45b0-a252-6a6d3c8e1ecd None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:29.158832 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7213296-50fd-4dd5-b5ba-07b73be9237e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139dc7a4f1dc48fe8faea848bd1ac0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:29.159437 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7213296-50fd-4dd5-b5ba-07b73be9237e service cinder] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:29.159714 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7213296-50fd-4dd5-b5ba-07b73be9237e service cinder] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:29.159985 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7213296-50fd-4dd5-b5ba-07b73be9237e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:29.218322 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7213296-50fd-4dd5-b5ba-07b73be9237e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:29.220393 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7213296-50fd-4dd5-b5ba-07b73be9237e service cinder] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:29.229145 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1372/2758] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 15:04:29 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:04:31.838243 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9581e5e-deb9-4848-b525-53f589b3a4d2 service cinder] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:31.924559 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9581e5e-deb9-4848-b525-53f589b3a4d2 service cinder] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:31.929983 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa6a3b9-5372-4e34-81bf-ae539ffee872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:31.930624 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa6a3b9-5372-4e34-81bf-ae539ffee872 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:31.930908 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa6a3b9-5372-4e34-81bf-ae539ffee872 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:31.931183 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa6a3b9-5372-4e34-81bf-ae539ffee872 admin admin] PATH_INFO: `/v3/users/67402c50675740a18d81c662f62431b8` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:31.932499 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa6a3b9-5372-4e34-81bf-ae539ffee872 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67402c50675740a18d81c662f62431b8)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:31.934419 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa6a3b9-5372-4e34-81bf-ae539ffee872 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:31.985019 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:31.987718 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-baa6a3b9-5372-4e34-81bf-ae539ffee872 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67402c50675740a18d81c662f62431b8'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:32.003317 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-baa6a3b9-5372-4e34-81bf-ae539ffee872 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67402c50675740a18d81c662f62431b8'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:32.012871 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-baa6a3b9-5372-4e34-81bf-ae539ffee872 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67402c50675740a18d81c662f62431b8'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:32.021357 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-baa6a3b9-5372-4e34-81bf-ae539ffee872 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67402c50675740a18d81c662f62431b8'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:32.022158 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-baa6a3b9-5372-4e34-81bf-ae539ffee872 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67402c50675740a18d81c662f62431b8'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:32.029253 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1387/2759] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Sep 19 15:04:31 2022] DELETE /identity/v3/users/67402c50675740a18d81c662f62431b8 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:04:32.034395 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2a0071-5076-44ef-8961-0cc1e2cf09e1 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:32.034845 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2a0071-5076-44ef-8961-0cc1e2cf09e1 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:32.034944 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2a0071-5076-44ef-8961-0cc1e2cf09e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:32.059483 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-af2a0071-5076-44ef-8961-0cc1e2cf09e1 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:04:32.060762 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-af2a0071-5076-44ef-8961-0cc1e2cf09e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:32.124080 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1373/2760] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 15:04:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:04:32.133835 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa6a3b9-5372-4e34-81bf-ae539ffee872 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:32.135372 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-baa6a3b9-5372-4e34-81bf-ae539ffee872 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:32.202721 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa6a3b9-5372-4e34-81bf-ae539ffee872 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:32.207303 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855e4955-c56c-4b9f-9bc0-0fbda11b67c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c2b78646374cb79ded4b7b59ba49c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:32.207910 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e4955-c56c-4b9f-9bc0-0fbda11b67c0 service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:32.208187 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e4955-c56c-4b9f-9bc0-0fbda11b67c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:32.208493 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e4955-c56c-4b9f-9bc0-0fbda11b67c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:32.217950 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855e4955-c56c-4b9f-9bc0-0fbda11b67c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:32.219945 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855e4955-c56c-4b9f-9bc0-0fbda11b67c0 service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:32.237547 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1388/2761] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 15:04:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:04:32.597749 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2a0071-5076-44ef-8961-0cc1e2cf09e1 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:32.599190 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-af2a0071-5076-44ef-8961-0cc1e2cf09e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:32.626388 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2a0071-5076-44ef-8961-0cc1e2cf09e1 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:32.632743 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f9a90-5ca8-4a9b-9532-fd8bbd865ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:32.633556 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f9a90-5ca8-4a9b-9532-fd8bbd865ba8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:32.633978 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f9a90-5ca8-4a9b-9532-fd8bbd865ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:32.634249 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f9a90-5ca8-4a9b-9532-fd8bbd865ba8 admin admin] PATH_INFO: `/v3/projects/5603228e2db949fc927da22e2388dc19` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:32.635444 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3f9a90-5ca8-4a9b-9532-fd8bbd865ba8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5603228e2db949fc927da22e2388dc19)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:32.637468 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3f9a90-5ca8-4a9b-9532-fd8bbd865ba8 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:32.675609 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:32.689591 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-fb3f9a90-5ca8-4a9b-9532-fd8bbd865ba8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5603228e2db949fc927da22e2388dc19', 'request_id': 'req-fb3f9a90-5ca8-4a9b-9532-fd8bbd865ba8'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:32.697085 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-fb3f9a90-5ca8-4a9b-9532-fd8bbd865ba8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5603228e2db949fc927da22e2388dc19', 'request_id': 'req-fb3f9a90-5ca8-4a9b-9532-fd8bbd865ba8'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:32.704156 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-fb3f9a90-5ca8-4a9b-9532-fd8bbd865ba8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5603228e2db949fc927da22e2388dc19', 'request_id': 'req-fb3f9a90-5ca8-4a9b-9532-fd8bbd865ba8'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:32.715501 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-fb3f9a90-5ca8-4a9b-9532-fd8bbd865ba8 admin admin] The token cache is being invalidate because project 5603228e2db949fc927da22e2388dc19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:04:32.715873 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-fb3f9a90-5ca8-4a9b-9532-fd8bbd865ba8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:32.716556 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-fb3f9a90-5ca8-4a9b-9532-fd8bbd865ba8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:32.718038 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1374/2762] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Sep 19 15:04:32 2022] DELETE /identity/v3/projects/5603228e2db949fc927da22e2388dc19 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:04:32.723168 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855e4955-c56c-4b9f-9bc0-0fbda11b67c0 service neutron] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:32.735153 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855e4955-c56c-4b9f-9bc0-0fbda11b67c0 service neutron] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:32.799372 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ad70f3-3eb9-43c5-a345-b40e7889d6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:32.799901 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ad70f3-3eb9-43c5-a345-b40e7889d6dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:32.800185 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ad70f3-3eb9-43c5-a345-b40e7889d6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:32.800511 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ad70f3-3eb9-43c5-a345-b40e7889d6dd admin admin] PATH_INFO: `/v3/users/0b05b52f07e944278285f493a9214bb0` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:32.801730 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ad70f3-3eb9-43c5-a345-b40e7889d6dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b05b52f07e944278285f493a9214bb0)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:32.803681 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ad70f3-3eb9-43c5-a345-b40e7889d6dd admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:32.856849 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-27ad70f3-3eb9-43c5-a345-b40e7889d6dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b05b52f07e944278285f493a9214bb0'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:32.871660 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-27ad70f3-3eb9-43c5-a345-b40e7889d6dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b05b52f07e944278285f493a9214bb0'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:32.873713 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:32.881184 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-27ad70f3-3eb9-43c5-a345-b40e7889d6dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b05b52f07e944278285f493a9214bb0'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:32.890117 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-27ad70f3-3eb9-43c5-a345-b40e7889d6dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b05b52f07e944278285f493a9214bb0'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:32.891634 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-27ad70f3-3eb9-43c5-a345-b40e7889d6dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b05b52f07e944278285f493a9214bb0'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:32.898348 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1389/2763] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Sep 19 15:04:32 2022] DELETE /identity/v3/users/0b05b52f07e944278285f493a9214bb0 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:04:33.186842 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f9a90-5ca8-4a9b-9532-fd8bbd865ba8 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:33.189034 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-fb3f9a90-5ca8-4a9b-9532-fd8bbd865ba8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:33.205205 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f9a90-5ca8-4a9b-9532-fd8bbd865ba8 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:33.274131 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba623f8b-ccdb-4352-8106-54208beffa66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:33.274770 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba623f8b-ccdb-4352-8106-54208beffa66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:33.275072 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba623f8b-ccdb-4352-8106-54208beffa66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:33.275345 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba623f8b-ccdb-4352-8106-54208beffa66 admin admin] PATH_INFO: `/v3/projects/aa4ba7226f3a47e8bc9ca77c0429981f` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:33.276628 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba623f8b-ccdb-4352-8106-54208beffa66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa4ba7226f3a47e8bc9ca77c0429981f)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:33.278607 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba623f8b-ccdb-4352-8106-54208beffa66 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:33.326826 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-ba623f8b-ccdb-4352-8106-54208beffa66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa4ba7226f3a47e8bc9ca77c0429981f', 'request_id': 'req-ba623f8b-ccdb-4352-8106-54208beffa66'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:33.335018 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-ba623f8b-ccdb-4352-8106-54208beffa66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa4ba7226f3a47e8bc9ca77c0429981f', 'request_id': 'req-ba623f8b-ccdb-4352-8106-54208beffa66'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:33.341887 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-ba623f8b-ccdb-4352-8106-54208beffa66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa4ba7226f3a47e8bc9ca77c0429981f', 'request_id': 'req-ba623f8b-ccdb-4352-8106-54208beffa66'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:33.353491 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-ba623f8b-ccdb-4352-8106-54208beffa66 admin admin] The token cache is being invalidate because project aa4ba7226f3a47e8bc9ca77c0429981f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:04:33.353831 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-ba623f8b-ccdb-4352-8106-54208beffa66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:33.354488 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-ba623f8b-ccdb-4352-8106-54208beffa66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:33.356066 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1375/2764] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Sep 19 15:04:33 2022] DELETE /identity/v3/projects/aa4ba7226f3a47e8bc9ca77c0429981f => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:04:33.361550 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7774a53d-ead2-4483-a18a-818d84e9a53c None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:33.361841 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7774a53d-ead2-4483-a18a-818d84e9a53c None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:33.362122 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7774a53d-ead2-4483-a18a-818d84e9a53c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:33.381112 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-7774a53d-ead2-4483-a18a-818d84e9a53c None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:04:33.382331 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-7774a53d-ead2-4483-a18a-818d84e9a53c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:33.443655 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1390/2765] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 15:04:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:04:33.451691 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb0bf91-cc6a-42f9-bae9-cb1dfc1a3292 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:33.452113 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb0bf91-cc6a-42f9-bae9-cb1dfc1a3292 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:33.452430 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb0bf91-cc6a-42f9-bae9-cb1dfc1a3292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:33.473530 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-bdb0bf91-cc6a-42f9-bae9-cb1dfc1a3292 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:04:33.474853 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-bdb0bf91-cc6a-42f9-bae9-cb1dfc1a3292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:33.482923 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1376/2766] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 15:04:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 15:04:33.488132 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7774a53d-ead2-4483-a18a-818d84e9a53c None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:33.498028 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7774a53d-ead2-4483-a18a-818d84e9a53c None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:33.503180 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87abaeb5-719c-4b17-b463-28f1d70b3861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:33.503924 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87abaeb5-719c-4b17-b463-28f1d70b3861 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:33.504276 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87abaeb5-719c-4b17-b463-28f1d70b3861 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:33.504650 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87abaeb5-719c-4b17-b463-28f1d70b3861 admin admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:33.505381 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87abaeb5-719c-4b17-b463-28f1d70b3861 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:04:33.505785 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87abaeb5-719c-4b17-b463-28f1d70b3861 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:33.507546 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87abaeb5-719c-4b17-b463-28f1d70b3861 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:33.519821 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1391/2767] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Sep 19 15:04:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 15:04:33.524174 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb0bf91-cc6a-42f9-bae9-cb1dfc1a3292 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:33.534515 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb0bf91-cc6a-42f9-bae9-cb1dfc1a3292 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:33.539379 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc959541-c31c-4631-8fec-61cf0984af22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:33.539979 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc959541-c31c-4631-8fec-61cf0984af22 admin admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:33.540263 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc959541-c31c-4631-8fec-61cf0984af22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:33.540561 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc959541-c31c-4631-8fec-61cf0984af22 admin admin] PATH_INFO: `/v3/projects` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:33.541192 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc959541-c31c-4631-8fec-61cf0984af22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:33.543097 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc959541-c31c-4631-8fec-61cf0984af22 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:33.571528 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1377/2768] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Sep 19 15:04:33 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 15:04:33.575606 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87abaeb5-719c-4b17-b463-28f1d70b3861 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:33.576985 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cc13a3-4f4f-45f1-9e96-598837feaef3 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:33.577267 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cc13a3-4f4f-45f1-9e96-598837feaef3 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:33.577537 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cc13a3-4f4f-45f1-9e96-598837feaef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:33.586029 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87abaeb5-719c-4b17-b463-28f1d70b3861 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:33.597314 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-a3cc13a3-4f4f-45f1-9e96-598837feaef3 None None] MFA Rules not processed for user `4edcf03fc7d244608b7ff8ee15ebfc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:04:33.598499 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-a3cc13a3-4f4f-45f1-9e96-598837feaef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:33.616038 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:33.645619 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6e903b-98cd-4579-9d47-b9edbce31136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:33.646220 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6e903b-98cd-4579-9d47-b9edbce31136 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:33.646500 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6e903b-98cd-4579-9d47-b9edbce31136 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:33.646769 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6e903b-98cd-4579-9d47-b9edbce31136 admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:33.647405 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6e903b-98cd-4579-9d47-b9edbce31136 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:33.649392 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6e903b-98cd-4579-9d47-b9edbce31136 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:33.658505 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1378/2769] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 15:04:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:04:33.672998 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1392/2770] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Sep 19 15:04:33 2022] POST /identity/v3/users => generated 289 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:04:33.677277 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cc13a3-4f4f-45f1-9e96-598837feaef3 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:33.688441 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cc13a3-4f4f-45f1-9e96-598837feaef3 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:33.693794 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ec53cf-07d4-4227-83e1-7e107aed3c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:33.694194 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ec53cf-07d4-4227-83e1-7e107aed3c8e admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:33.694423 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ec53cf-07d4-4227-83e1-7e107aed3c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:33.694644 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ec53cf-07d4-4227-83e1-7e107aed3c8e admin admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:33.695167 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ec53cf-07d4-4227-83e1-7e107aed3c8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:33.696808 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ec53cf-07d4-4227-83e1-7e107aed3c8e admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:33.710917 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1379/2771] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 15:04:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:04:33.713444 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6e903b-98cd-4579-9d47-b9edbce31136 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:33.725214 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6e903b-98cd-4579-9d47-b9edbce31136 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:33.729953 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23468461-b75c-47ab-89cc-0249498f7fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:33.730619 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23468461-b75c-47ab-89cc-0249498f7fd6 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:33.730962 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23468461-b75c-47ab-89cc-0249498f7fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:33.731305 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23468461-b75c-47ab-89cc-0249498f7fd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:33.732012 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23468461-b75c-47ab-89cc-0249498f7fd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:33.733740 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23468461-b75c-47ab-89cc-0249498f7fd6 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:33.745661 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1393/2772] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 15:04:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:04:33.749724 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ec53cf-07d4-4227-83e1-7e107aed3c8e admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:33.761420 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ec53cf-07d4-4227-83e1-7e107aed3c8e admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:33.767981 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78037d84-6820-415a-9115-7a509577a0e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:33.768699 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78037d84-6820-415a-9115-7a509577a0e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:33.769018 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78037d84-6820-415a-9115-7a509577a0e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:33.769296 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78037d84-6820-415a-9115-7a509577a0e1 admin admin] PATH_INFO: `/v3/projects/0c681f159940487084e207577aebf62d/users/579090f61dad408096b16b5539dc1c0a/roles/efa0e5b3413748dc828a89b12d67df79` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:33.784976 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78037d84-6820-415a-9115-7a509577a0e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c681f159940487084e207577aebf62d, user_id=579090f61dad408096b16b5539dc1c0a, role_id=efa0e5b3413748dc828a89b12d67df79)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:33.787803 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78037d84-6820-415a-9115-7a509577a0e1 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:33.801248 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1380/2773] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 15:04:33 2022] PUT /identity/v3/projects/0c681f159940487084e207577aebf62d/users/579090f61dad408096b16b5539dc1c0a/roles/efa0e5b3413748dc828a89b12d67df79 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:04:33.812241 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688320cf-cf68-46f0-a4de-b97d708c1497 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:33.812931 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688320cf-cf68-46f0-a4de-b97d708c1497 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:33.813163 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688320cf-cf68-46f0-a4de-b97d708c1497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:33.843152 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-688320cf-cf68-46f0-a4de-b97d708c1497 None None] MFA Rules not processed for user `579090f61dad408096b16b5539dc1c0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:04:33.844951 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-688320cf-cf68-46f0-a4de-b97d708c1497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:33.885423 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:33.914201 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1394/2774] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 15:04:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:04:33.918715 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78037d84-6820-415a-9115-7a509577a0e1 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:33.983867 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78037d84-6820-415a-9115-7a509577a0e1 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:33.988719 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c392af-dc79-4253-8d3b-2dabd0de4d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:33.989312 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c392af-dc79-4253-8d3b-2dabd0de4d67 admin admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:33.989593 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c392af-dc79-4253-8d3b-2dabd0de4d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:33.989874 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c392af-dc79-4253-8d3b-2dabd0de4d67 admin admin] PATH_INFO: `/v3/projects` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:33.990580 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c392af-dc79-4253-8d3b-2dabd0de4d67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:33.992501 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c392af-dc79-4253-8d3b-2dabd0de4d67 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:34.020636 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1381/2775] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Sep 19 15:04:33 2022] POST /identity/v3/projects => generated 377 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:04:34.024692 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688320cf-cf68-46f0-a4de-b97d708c1497 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:34.036087 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688320cf-cf68-46f0-a4de-b97d708c1497 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:34.095601 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366ca166-f791-4595-a181-da7dbe07db12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:34.096212 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ca166-f791-4595-a181-da7dbe07db12 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:34.096531 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ca166-f791-4595-a181-da7dbe07db12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:34.096809 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ca166-f791-4595-a181-da7dbe07db12 admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:34.097456 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366ca166-f791-4595-a181-da7dbe07db12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:34.099400 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366ca166-f791-4595-a181-da7dbe07db12 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:34.123477 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1395/2776] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Sep 19 15:04:34 2022] POST /identity/v3/users => generated 289 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 15:04:34.128353 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c392af-dc79-4253-8d3b-2dabd0de4d67 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:34.139024 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c392af-dc79-4253-8d3b-2dabd0de4d67 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:34.144735 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1341e4-4a1e-4c68-844e-d55be71fa1ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:34.145330 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1341e4-4a1e-4c68-844e-d55be71fa1ff admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:34.145606 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1341e4-4a1e-4c68-844e-d55be71fa1ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:34.145874 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1341e4-4a1e-4c68-844e-d55be71fa1ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:34.146506 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1341e4-4a1e-4c68-844e-d55be71fa1ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:34.148075 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1341e4-4a1e-4c68-844e-d55be71fa1ff admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:34.160202 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1382/2777] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 15:04:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:04:34.164419 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366ca166-f791-4595-a181-da7dbe07db12 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:34.174725 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366ca166-f791-4595-a181-da7dbe07db12 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:34.179067 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ef5cb3-7922-4695-81c3-641fe387ac85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:34.179666 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef5cb3-7922-4695-81c3-641fe387ac85 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:34.179946 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef5cb3-7922-4695-81c3-641fe387ac85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:34.180224 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef5cb3-7922-4695-81c3-641fe387ac85 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:34.180896 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ef5cb3-7922-4695-81c3-641fe387ac85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:34.182473 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ef5cb3-7922-4695-81c3-641fe387ac85 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:34.193218 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1396/2778] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 15:04:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:04:34.197595 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1341e4-4a1e-4c68-844e-d55be71fa1ff admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:34.209140 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1341e4-4a1e-4c68-844e-d55be71fa1ff admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:34.213916 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97230768-e528-4692-bf2b-3c60aca2a67a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:34.214666 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97230768-e528-4692-bf2b-3c60aca2a67a admin admin] REQUEST_METHOD: `PUT` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:34.215078 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97230768-e528-4692-bf2b-3c60aca2a67a admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:34.215418 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97230768-e528-4692-bf2b-3c60aca2a67a admin admin] PATH_INFO: `/v3/projects/fc8fb6fe17cf4c389aa5a44c202016c8/users/228411a4c4884d2e93e27c0f1a17e360/roles/efa0e5b3413748dc828a89b12d67df79` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:34.230194 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97230768-e528-4692-bf2b-3c60aca2a67a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc8fb6fe17cf4c389aa5a44c202016c8, user_id=228411a4c4884d2e93e27c0f1a17e360, role_id=efa0e5b3413748dc828a89b12d67df79)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:34.232839 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97230768-e528-4692-bf2b-3c60aca2a67a admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:34.245545 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1383/2779] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 15:04:34 2022] PUT /identity/v3/projects/fc8fb6fe17cf4c389aa5a44c202016c8/users/228411a4c4884d2e93e27c0f1a17e360/roles/efa0e5b3413748dc828a89b12d67df79 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:04:34.317942 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec614aff-6dc4-4669-9b56-ad80183f09c7 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:34.318358 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec614aff-6dc4-4669-9b56-ad80183f09c7 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:34.318651 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec614aff-6dc4-4669-9b56-ad80183f09c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:34.351393 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-ec614aff-6dc4-4669-9b56-ad80183f09c7 None None] MFA Rules not processed for user `228411a4c4884d2e93e27c0f1a17e360`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:04:34.352828 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-ec614aff-6dc4-4669-9b56-ad80183f09c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:34.424247 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1397/2780] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 15:04:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:04:34.428688 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97230768-e528-4692-bf2b-3c60aca2a67a admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:34.475288 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:34.494713 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97230768-e528-4692-bf2b-3c60aca2a67a admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:34.499427 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0c4321-0a37-4fe3-9fe2-6c1969cd95de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:34.500091 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0c4321-0a37-4fe3-9fe2-6c1969cd95de admin admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:34.500489 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0c4321-0a37-4fe3-9fe2-6c1969cd95de admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:34.500774 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0c4321-0a37-4fe3-9fe2-6c1969cd95de admin admin] PATH_INFO: `/v3/projects` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:34.501401 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0c4321-0a37-4fe3-9fe2-6c1969cd95de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:34.503293 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0c4321-0a37-4fe3-9fe2-6c1969cd95de admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:34.534171 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1384/2781] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Sep 19 15:04:34 2022] POST /identity/v3/projects => generated 377 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 15:04:34.537996 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec614aff-6dc4-4669-9b56-ad80183f09c7 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:34.549172 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec614aff-6dc4-4669-9b56-ad80183f09c7 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:34.597697 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:34.611466 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb42b30-4d64-4003-810d-742ebd5eb052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:34.612203 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb42b30-4d64-4003-810d-742ebd5eb052 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:34.612521 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb42b30-4d64-4003-810d-742ebd5eb052 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:34.612799 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb42b30-4d64-4003-810d-742ebd5eb052 admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:34.613436 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb42b30-4d64-4003-810d-742ebd5eb052 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:34.615345 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb42b30-4d64-4003-810d-742ebd5eb052 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:34.636988 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1398/2782] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Sep 19 15:04:34 2022] POST /identity/v3/users => generated 295 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:04:34.641779 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0c4321-0a37-4fe3-9fe2-6c1969cd95de admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:34.652808 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0c4321-0a37-4fe3-9fe2-6c1969cd95de admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:34.659396 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd78b56-0323-4906-80ce-757c47922d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:34.660165 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd78b56-0323-4906-80ce-757c47922d53 admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:34.660571 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd78b56-0323-4906-80ce-757c47922d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:34.660942 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd78b56-0323-4906-80ce-757c47922d53 admin admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:34.661743 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd78b56-0323-4906-80ce-757c47922d53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:34.663465 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd78b56-0323-4906-80ce-757c47922d53 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:34.675455 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1385/2783] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 15:04:34 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 15:04:34.679878 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb42b30-4d64-4003-810d-742ebd5eb052 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:34.690119 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb42b30-4d64-4003-810d-742ebd5eb052 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:34.694983 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4bbcdc-0240-48ae-8748-5678195a4322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:34.695631 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4bbcdc-0240-48ae-8748-5678195a4322 admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:34.695912 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4bbcdc-0240-48ae-8748-5678195a4322 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:34.696187 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4bbcdc-0240-48ae-8748-5678195a4322 admin admin] PATH_INFO: `/v3/projects/b023e36010ed4bdbb8f82ea663745e5f/users/6a9ed59e904142338a512e264893ec75/roles/ddb643577b2e4e478100ec370decfaeb` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:34.712175 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4bbcdc-0240-48ae-8748-5678195a4322 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b023e36010ed4bdbb8f82ea663745e5f, user_id=6a9ed59e904142338a512e264893ec75, role_id=ddb643577b2e4e478100ec370decfaeb)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:34.714862 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4bbcdc-0240-48ae-8748-5678195a4322 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:34.730273 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1399/2784] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 15:04:34 2022] PUT /identity/v3/projects/b023e36010ed4bdbb8f82ea663745e5f/users/6a9ed59e904142338a512e264893ec75/roles/ddb643577b2e4e478100ec370decfaeb => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:04:34.735030 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd78b56-0323-4906-80ce-757c47922d53 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:34.747189 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd78b56-0323-4906-80ce-757c47922d53 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:34.809186 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ad3f35-ed08-453f-9b77-065fed0a1d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:34.809778 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad3f35-ed08-453f-9b77-065fed0a1d66 admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:34.810060 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad3f35-ed08-453f-9b77-065fed0a1d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:34.810335 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad3f35-ed08-453f-9b77-065fed0a1d66 admin admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:34.811067 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ad3f35-ed08-453f-9b77-065fed0a1d66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:34.813523 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ad3f35-ed08-453f-9b77-065fed0a1d66 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:34.823760 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1386/2785] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 15:04:34 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:04:34.828389 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4bbcdc-0240-48ae-8748-5678195a4322 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:34.838731 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4bbcdc-0240-48ae-8748-5678195a4322 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:34.843363 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e03892-03dc-44e0-b443-3d312eed65cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:34.844636 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e03892-03dc-44e0-b443-3d312eed65cb admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:34.844981 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e03892-03dc-44e0-b443-3d312eed65cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:34.845261 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e03892-03dc-44e0-b443-3d312eed65cb admin admin] PATH_INFO: `/v3/projects/b023e36010ed4bdbb8f82ea663745e5f/users/6a9ed59e904142338a512e264893ec75/roles/ddb643577b2e4e478100ec370decfaeb` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:34.847234 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e03892-03dc-44e0-b443-3d312eed65cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=b023e36010ed4bdbb8f82ea663745e5f, user_id=6a9ed59e904142338a512e264893ec75, role_id=ddb643577b2e4e478100ec370decfaeb)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:34.849897 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e03892-03dc-44e0-b443-3d312eed65cb admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:34.861334 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1400/2786] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 15:04:34 2022] PUT /identity/v3/projects/b023e36010ed4bdbb8f82ea663745e5f/users/6a9ed59e904142338a512e264893ec75/roles/ddb643577b2e4e478100ec370decfaeb => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:04:34.871545 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aee66e-26c8-4909-a89d-1acbc2119d90 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:34.871828 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aee66e-26c8-4909-a89d-1acbc2119d90 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:34.872130 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aee66e-26c8-4909-a89d-1acbc2119d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:34.902484 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-07aee66e-26c8-4909-a89d-1acbc2119d90 None None] MFA Rules not processed for user `6a9ed59e904142338a512e264893ec75`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:04:34.903726 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-07aee66e-26c8-4909-a89d-1acbc2119d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:34.976603 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1387/2787] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 15:04:34 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:04:34.988863 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e03892-03dc-44e0-b443-3d312eed65cb admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:34.990624 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-72e03892-03dc-44e0-b443-3d312eed65cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:35.049410 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e03892-03dc-44e0-b443-3d312eed65cb admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:35.053069 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7090b6ed-3a38-47b6-8820-10f566a95cc2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139dc7a4f1dc48fe8faea848bd1ac0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:35.053667 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7090b6ed-3a38-47b6-8820-10f566a95cc2 service cinder] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:35.053942 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7090b6ed-3a38-47b6-8820-10f566a95cc2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:35.054211 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7090b6ed-3a38-47b6-8820-10f566a95cc2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:35.063283 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7090b6ed-3a38-47b6-8820-10f566a95cc2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:35.064751 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7090b6ed-3a38-47b6-8820-10f566a95cc2 service cinder] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:35.074409 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1401/2788] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 15:04:34 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:04:35.116273 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aee66e-26c8-4909-a89d-1acbc2119d90 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:35.117610 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-07aee66e-26c8-4909-a89d-1acbc2119d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:35.129568 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aee66e-26c8-4909-a89d-1acbc2119d90 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:35.133120 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a69d802-039e-4d0d-b90a-82ba484c3abb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139dc7a4f1dc48fe8faea848bd1ac0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:35.133708 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a69d802-039e-4d0d-b90a-82ba484c3abb service cinder] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:35.133983 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a69d802-039e-4d0d-b90a-82ba484c3abb service cinder] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:35.134252 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a69d802-039e-4d0d-b90a-82ba484c3abb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:35.167929 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:35.192666 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a69d802-039e-4d0d-b90a-82ba484c3abb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:35.194089 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a69d802-039e-4d0d-b90a-82ba484c3abb service cinder] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:35.203690 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1388/2789] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 15:04:35 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:04:38.198766 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7090b6ed-3a38-47b6-8820-10f566a95cc2 service cinder] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:38.263186 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7090b6ed-3a38-47b6-8820-10f566a95cc2 service cinder] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:38.268450 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f288ed-df2f-4165-80c2-77960285a7f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:38.269126 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f288ed-df2f-4165-80c2-77960285a7f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:38.269362 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f288ed-df2f-4165-80c2-77960285a7f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:38.269655 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f288ed-df2f-4165-80c2-77960285a7f3 admin admin] PATH_INFO: `/v3/users/579090f61dad408096b16b5539dc1c0a` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:38.270862 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f288ed-df2f-4165-80c2-77960285a7f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=579090f61dad408096b16b5539dc1c0a)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:38.272806 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f288ed-df2f-4165-80c2-77960285a7f3 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:38.329371 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:38.332107 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-43f288ed-df2f-4165-80c2-77960285a7f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '579090f61dad408096b16b5539dc1c0a'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:38.351367 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-43f288ed-df2f-4165-80c2-77960285a7f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '579090f61dad408096b16b5539dc1c0a'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:38.359732 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-43f288ed-df2f-4165-80c2-77960285a7f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '579090f61dad408096b16b5539dc1c0a'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:38.368788 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-43f288ed-df2f-4165-80c2-77960285a7f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '579090f61dad408096b16b5539dc1c0a'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:38.369489 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-43f288ed-df2f-4165-80c2-77960285a7f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '579090f61dad408096b16b5539dc1c0a'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:38.376568 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1402/2790] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Sep 19 15:04:38 2022] DELETE /identity/v3/users/579090f61dad408096b16b5539dc1c0a => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:04:38.381129 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8574b3bc-7c59-401e-95c5-46ef0d410bf3 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:38.381636 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8574b3bc-7c59-401e-95c5-46ef0d410bf3 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:38.381725 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8574b3bc-7c59-401e-95c5-46ef0d410bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:38.402496 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-8574b3bc-7c59-401e-95c5-46ef0d410bf3 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:04:38.403707 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-8574b3bc-7c59-401e-95c5-46ef0d410bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:38.472916 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1389/2791] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 15:04:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:04:38.483145 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f288ed-df2f-4165-80c2-77960285a7f3 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:38.485228 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-43f288ed-df2f-4165-80c2-77960285a7f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:38.551335 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f288ed-df2f-4165-80c2-77960285a7f3 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:38.555869 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64580a91-6fd1-44c6-a5ff-48573f9e9d0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c2b78646374cb79ded4b7b59ba49c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:38.556607 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64580a91-6fd1-44c6-a5ff-48573f9e9d0f service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:38.556959 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64580a91-6fd1-44c6-a5ff-48573f9e9d0f service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:38.557300 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64580a91-6fd1-44c6-a5ff-48573f9e9d0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:38.568591 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64580a91-6fd1-44c6-a5ff-48573f9e9d0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:38.570126 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64580a91-6fd1-44c6-a5ff-48573f9e9d0f service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:38.582081 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1403/2792] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 15:04:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:04:38.864097 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8574b3bc-7c59-401e-95c5-46ef0d410bf3 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:38.865620 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-8574b3bc-7c59-401e-95c5-46ef0d410bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:38.878327 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8574b3bc-7c59-401e-95c5-46ef0d410bf3 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:38.883092 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9c6c3a-2e1f-4c9c-8745-0dd26360ce1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:38.883724 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9c6c3a-2e1f-4c9c-8745-0dd26360ce1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:38.884000 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9c6c3a-2e1f-4c9c-8745-0dd26360ce1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:38.884268 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9c6c3a-2e1f-4c9c-8745-0dd26360ce1d admin admin] PATH_INFO: `/v3/projects/0c681f159940487084e207577aebf62d` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:38.885440 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9c6c3a-2e1f-4c9c-8745-0dd26360ce1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c681f159940487084e207577aebf62d)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:38.887320 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9c6c3a-2e1f-4c9c-8745-0dd26360ce1d admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:38.938015 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-fe9c6c3a-2e1f-4c9c-8745-0dd26360ce1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c681f159940487084e207577aebf62d', 'request_id': 'req-fe9c6c3a-2e1f-4c9c-8745-0dd26360ce1d'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:38.945090 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-fe9c6c3a-2e1f-4c9c-8745-0dd26360ce1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c681f159940487084e207577aebf62d', 'request_id': 'req-fe9c6c3a-2e1f-4c9c-8745-0dd26360ce1d'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:38.951677 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-fe9c6c3a-2e1f-4c9c-8745-0dd26360ce1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c681f159940487084e207577aebf62d', 'request_id': 'req-fe9c6c3a-2e1f-4c9c-8745-0dd26360ce1d'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:38.963101 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-fe9c6c3a-2e1f-4c9c-8745-0dd26360ce1d admin admin] The token cache is being invalidate because project 0c681f159940487084e207577aebf62d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:04:38.963391 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-fe9c6c3a-2e1f-4c9c-8745-0dd26360ce1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:38.964100 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-fe9c6c3a-2e1f-4c9c-8745-0dd26360ce1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:38.965659 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1390/2793] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Sep 19 15:04:38 2022] DELETE /identity/v3/projects/0c681f159940487084e207577aebf62d => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:04:38.970674 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64580a91-6fd1-44c6-a5ff-48573f9e9d0f service neutron] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:38.980503 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64580a91-6fd1-44c6-a5ff-48573f9e9d0f service neutron] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:39.039261 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb0811e-9433-49aa-82ab-9580473dd22a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:39.040048 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb0811e-9433-49aa-82ab-9580473dd22a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:39.040440 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb0811e-9433-49aa-82ab-9580473dd22a admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:39.040778 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb0811e-9433-49aa-82ab-9580473dd22a admin admin] PATH_INFO: `/v3/users/228411a4c4884d2e93e27c0f1a17e360` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:39.041994 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb0811e-9433-49aa-82ab-9580473dd22a admin admin] RBAC: Authorizing `identity:delete_user(user_id=228411a4c4884d2e93e27c0f1a17e360)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:39.043951 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb0811e-9433-49aa-82ab-9580473dd22a admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:39.092985 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-adb0811e-9433-49aa-82ab-9580473dd22a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '228411a4c4884d2e93e27c0f1a17e360'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:39.105525 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-adb0811e-9433-49aa-82ab-9580473dd22a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '228411a4c4884d2e93e27c0f1a17e360'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:39.108161 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:39.115368 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-adb0811e-9433-49aa-82ab-9580473dd22a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '228411a4c4884d2e93e27c0f1a17e360'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:39.123537 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-adb0811e-9433-49aa-82ab-9580473dd22a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '228411a4c4884d2e93e27c0f1a17e360'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:39.124206 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-adb0811e-9433-49aa-82ab-9580473dd22a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '228411a4c4884d2e93e27c0f1a17e360'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:39.130882 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1404/2794] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Sep 19 15:04:38 2022] DELETE /identity/v3/users/228411a4c4884d2e93e27c0f1a17e360 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:04:39.407651 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9c6c3a-2e1f-4c9c-8745-0dd26360ce1d admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:39.409624 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-fe9c6c3a-2e1f-4c9c-8745-0dd26360ce1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:39.425700 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9c6c3a-2e1f-4c9c-8745-0dd26360ce1d admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:39.485514 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2736ca-8ce4-4224-bc8f-a59540bd5301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:39.486074 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2736ca-8ce4-4224-bc8f-a59540bd5301 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:39.486358 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2736ca-8ce4-4224-bc8f-a59540bd5301 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:39.486627 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2736ca-8ce4-4224-bc8f-a59540bd5301 admin admin] PATH_INFO: `/v3/projects/fc8fb6fe17cf4c389aa5a44c202016c8` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:39.487752 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2736ca-8ce4-4224-bc8f-a59540bd5301 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc8fb6fe17cf4c389aa5a44c202016c8)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:39.489669 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2736ca-8ce4-4224-bc8f-a59540bd5301 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:39.491099 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:39.536447 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-ed2736ca-8ce4-4224-bc8f-a59540bd5301 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc8fb6fe17cf4c389aa5a44c202016c8', 'request_id': 'req-ed2736ca-8ce4-4224-bc8f-a59540bd5301'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:39.543552 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-ed2736ca-8ce4-4224-bc8f-a59540bd5301 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc8fb6fe17cf4c389aa5a44c202016c8', 'request_id': 'req-ed2736ca-8ce4-4224-bc8f-a59540bd5301'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:39.550566 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-ed2736ca-8ce4-4224-bc8f-a59540bd5301 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc8fb6fe17cf4c389aa5a44c202016c8', 'request_id': 'req-ed2736ca-8ce4-4224-bc8f-a59540bd5301'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:39.560601 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-ed2736ca-8ce4-4224-bc8f-a59540bd5301 admin admin] The token cache is being invalidate because project fc8fb6fe17cf4c389aa5a44c202016c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:04:39.560885 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-ed2736ca-8ce4-4224-bc8f-a59540bd5301 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:39.561526 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-ed2736ca-8ce4-4224-bc8f-a59540bd5301 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:39.563033 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1391/2795] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Sep 19 15:04:39 2022] DELETE /identity/v3/projects/fc8fb6fe17cf4c389aa5a44c202016c8 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:04:39.567250 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb0811e-9433-49aa-82ab-9580473dd22a admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:39.568733 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-adb0811e-9433-49aa-82ab-9580473dd22a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:39.581799 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb0811e-9433-49aa-82ab-9580473dd22a admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:39.637727 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef6d936-3242-4c00-894d-bd192946b175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:39.638353 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef6d936-3242-4c00-894d-bd192946b175 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:39.638636 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef6d936-3242-4c00-894d-bd192946b175 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:39.638907 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef6d936-3242-4c00-894d-bd192946b175 admin admin] PATH_INFO: `/v3/users/6a9ed59e904142338a512e264893ec75` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:39.640114 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef6d936-3242-4c00-894d-bd192946b175 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a9ed59e904142338a512e264893ec75)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:39.642264 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef6d936-3242-4c00-894d-bd192946b175 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:39.689820 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-cef6d936-3242-4c00-894d-bd192946b175 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a9ed59e904142338a512e264893ec75'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:39.701704 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-cef6d936-3242-4c00-894d-bd192946b175 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a9ed59e904142338a512e264893ec75'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:39.709054 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-cef6d936-3242-4c00-894d-bd192946b175 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a9ed59e904142338a512e264893ec75'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:39.716348 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-cef6d936-3242-4c00-894d-bd192946b175 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a9ed59e904142338a512e264893ec75'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:39.716965 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-cef6d936-3242-4c00-894d-bd192946b175 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a9ed59e904142338a512e264893ec75'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:39.723305 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1405/2796] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Sep 19 15:04:39 2022] DELETE /identity/v3/users/6a9ed59e904142338a512e264893ec75 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:04:39.990265 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2736ca-8ce4-4224-bc8f-a59540bd5301 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:39.991793 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-ed2736ca-8ce4-4224-bc8f-a59540bd5301 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:40.008139 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2736ca-8ce4-4224-bc8f-a59540bd5301 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:40.069567 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c432cf-f821-4a91-9f5a-eded017c8c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:40.070206 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c432cf-f821-4a91-9f5a-eded017c8c62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:40.070490 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c432cf-f821-4a91-9f5a-eded017c8c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:40.070766 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c432cf-f821-4a91-9f5a-eded017c8c62 admin admin] PATH_INFO: `/v3/projects/b023e36010ed4bdbb8f82ea663745e5f` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:40.071879 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c432cf-f821-4a91-9f5a-eded017c8c62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b023e36010ed4bdbb8f82ea663745e5f)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:40.073807 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c432cf-f821-4a91-9f5a-eded017c8c62 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:40.120544 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-14c432cf-f821-4a91-9f5a-eded017c8c62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b023e36010ed4bdbb8f82ea663745e5f', 'request_id': 'req-14c432cf-f821-4a91-9f5a-eded017c8c62'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:40.128903 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-14c432cf-f821-4a91-9f5a-eded017c8c62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b023e36010ed4bdbb8f82ea663745e5f', 'request_id': 'req-14c432cf-f821-4a91-9f5a-eded017c8c62'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:40.135329 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-14c432cf-f821-4a91-9f5a-eded017c8c62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b023e36010ed4bdbb8f82ea663745e5f', 'request_id': 'req-14c432cf-f821-4a91-9f5a-eded017c8c62'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:40.146411 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-14c432cf-f821-4a91-9f5a-eded017c8c62 admin admin] The token cache is being invalidate because project b023e36010ed4bdbb8f82ea663745e5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:04:40.146694 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-14c432cf-f821-4a91-9f5a-eded017c8c62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:40.147335 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-14c432cf-f821-4a91-9f5a-eded017c8c62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:40.148856 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1392/2797] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Sep 19 15:04:39 2022] DELETE /identity/v3/projects/b023e36010ed4bdbb8f82ea663745e5f => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:04:40.154620 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f38c021-c233-4628-9cc0-45154ee2c4c3 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:40.154901 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f38c021-c233-4628-9cc0-45154ee2c4c3 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:40.155169 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f38c021-c233-4628-9cc0-45154ee2c4c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:40.174959 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-0f38c021-c233-4628-9cc0-45154ee2c4c3 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:04:40.176164 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-0f38c021-c233-4628-9cc0-45154ee2c4c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:40.240080 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1406/2798] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 15:04:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:04:40.250956 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc76b2b-4ec6-42a6-8a9f-7fd9a48ec557 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:40.251305 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc76b2b-4ec6-42a6-8a9f-7fd9a48ec557 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:40.251582 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc76b2b-4ec6-42a6-8a9f-7fd9a48ec557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:40.285596 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-edc76b2b-4ec6-42a6-8a9f-7fd9a48ec557 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:04:40.286957 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-edc76b2b-4ec6-42a6-8a9f-7fd9a48ec557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:40.301085 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1393/2799] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 15:04:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:04:40.305143 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f38c021-c233-4628-9cc0-45154ee2c4c3 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:40.311477 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:40.316181 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f38c021-c233-4628-9cc0-45154ee2c4c3 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:40.321976 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4abfe82-6d90-4a62-aeb1-5be10cc55b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:40.323124 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4abfe82-6d90-4a62-aeb1-5be10cc55b56 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:40.323822 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4abfe82-6d90-4a62-aeb1-5be10cc55b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:40.324271 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4abfe82-6d90-4a62-aeb1-5be10cc55b56 admin admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:40.325542 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4abfe82-6d90-4a62-aeb1-5be10cc55b56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:04:40.326233 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4abfe82-6d90-4a62-aeb1-5be10cc55b56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:40.327857 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4abfe82-6d90-4a62-aeb1-5be10cc55b56 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:40.345400 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1407/2800] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Sep 19 15:04:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:04:40.346992 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc76b2b-4ec6-42a6-8a9f-7fd9a48ec557 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:40.358484 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc76b2b-4ec6-42a6-8a9f-7fd9a48ec557 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:40.364068 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a81d49-f657-45eb-8cd7-fcf99eb00fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:40.364718 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a81d49-f657-45eb-8cd7-fcf99eb00fa9 admin admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:40.365055 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a81d49-f657-45eb-8cd7-fcf99eb00fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:40.365468 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a81d49-f657-45eb-8cd7-fcf99eb00fa9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:40.366278 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a81d49-f657-45eb-8cd7-fcf99eb00fa9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:40.368199 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a81d49-f657-45eb-8cd7-fcf99eb00fa9 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:40.380319 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:40.399439 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1394/2801] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Sep 19 15:04:40 2022] POST /identity/v3/projects => generated 371 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:04:40.403741 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4abfe82-6d90-4a62-aeb1-5be10cc55b56 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:40.414571 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4abfe82-6d90-4a62-aeb1-5be10cc55b56 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:40.482378 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f208ba6-3fdf-4377-8b80-ff47f43c3f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:40.483222 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f208ba6-3fdf-4377-8b80-ff47f43c3f15 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:40.483506 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f208ba6-3fdf-4377-8b80-ff47f43c3f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:40.483843 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f208ba6-3fdf-4377-8b80-ff47f43c3f15 admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:40.485063 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f208ba6-3fdf-4377-8b80-ff47f43c3f15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:40.487200 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f208ba6-3fdf-4377-8b80-ff47f43c3f15 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:40.508721 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1408/2802] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Sep 19 15:04:40 2022] POST /identity/v3/users => generated 286 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:04:40.512697 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a81d49-f657-45eb-8cd7-fcf99eb00fa9 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:40.523009 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a81d49-f657-45eb-8cd7-fcf99eb00fa9 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:40.528519 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac21b48-aab7-45b4-94b7-9e11bd043c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:40.529158 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac21b48-aab7-45b4-94b7-9e11bd043c55 admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:40.529439 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac21b48-aab7-45b4-94b7-9e11bd043c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:40.529695 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac21b48-aab7-45b4-94b7-9e11bd043c55 admin admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:40.530340 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac21b48-aab7-45b4-94b7-9e11bd043c55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:40.531959 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac21b48-aab7-45b4-94b7-9e11bd043c55 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:40.542535 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1395/2803] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 15:04:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:04:40.546405 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f208ba6-3fdf-4377-8b80-ff47f43c3f15 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:40.557438 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f208ba6-3fdf-4377-8b80-ff47f43c3f15 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:40.562116 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63578470-2ab4-42d3-aabb-2c48b463d10e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:40.563609 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63578470-2ab4-42d3-aabb-2c48b463d10e admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:40.563806 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63578470-2ab4-42d3-aabb-2c48b463d10e admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:40.564206 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63578470-2ab4-42d3-aabb-2c48b463d10e admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:40.564882 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63578470-2ab4-42d3-aabb-2c48b463d10e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:40.566473 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63578470-2ab4-42d3-aabb-2c48b463d10e admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:40.578128 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1409/2804] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 15:04:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:04:40.582582 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac21b48-aab7-45b4-94b7-9e11bd043c55 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:40.592819 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac21b48-aab7-45b4-94b7-9e11bd043c55 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:40.597766 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb71f23e-8bcf-4d7f-bfc0-bc70ae1e33ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:40.598417 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb71f23e-8bcf-4d7f-bfc0-bc70ae1e33ca admin admin] REQUEST_METHOD: `PUT` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:40.598692 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb71f23e-8bcf-4d7f-bfc0-bc70ae1e33ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:40.598961 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb71f23e-8bcf-4d7f-bfc0-bc70ae1e33ca admin admin] PATH_INFO: `/v3/projects/069fc00ee7e34e84a27e5189da6e556e/users/160bd3ee43244275a92578e69afe3f9e/roles/efa0e5b3413748dc828a89b12d67df79` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:40.614241 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb71f23e-8bcf-4d7f-bfc0-bc70ae1e33ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=069fc00ee7e34e84a27e5189da6e556e, user_id=160bd3ee43244275a92578e69afe3f9e, role_id=efa0e5b3413748dc828a89b12d67df79)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:40.616906 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb71f23e-8bcf-4d7f-bfc0-bc70ae1e33ca admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:40.631807 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1396/2805] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 15:04:40 2022] PUT /identity/v3/projects/069fc00ee7e34e84a27e5189da6e556e/users/160bd3ee43244275a92578e69afe3f9e/roles/efa0e5b3413748dc828a89b12d67df79 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:04:40.637015 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc92f5-fe0a-4050-8594-f787df95d1fd None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:40.637300 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc92f5-fe0a-4050-8594-f787df95d1fd None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:40.637575 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc92f5-fe0a-4050-8594-f787df95d1fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:40.656643 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-8bcc92f5-fe0a-4050-8594-f787df95d1fd None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:04:40.657872 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-8bcc92f5-fe0a-4050-8594-f787df95d1fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:40.720450 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1410/2806] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 15:04:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:04:40.729716 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb71f23e-8bcf-4d7f-bfc0-bc70ae1e33ca admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:40.731448 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-eb71f23e-8bcf-4d7f-bfc0-bc70ae1e33ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:40.788197 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb71f23e-8bcf-4d7f-bfc0-bc70ae1e33ca admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:40.791825 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595a822d-3fb1-477e-93ab-f5195a6f7547 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c2b78646374cb79ded4b7b59ba49c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:40.792465 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a822d-3fb1-477e-93ab-f5195a6f7547 service neutron] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:40.792748 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a822d-3fb1-477e-93ab-f5195a6f7547 service neutron] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:40.793022 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a822d-3fb1-477e-93ab-f5195a6f7547 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:40.802689 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595a822d-3fb1-477e-93ab-f5195a6f7547 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:40.804105 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595a822d-3fb1-477e-93ab-f5195a6f7547 service neutron] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:40.814237 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1397/2807] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 15:04:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:04:41.440748 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8191c66-b80b-46bb-969d-e18eb189cd56 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:41.441109 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8191c66-b80b-46bb-969d-e18eb189cd56 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:41.441523 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8191c66-b80b-46bb-969d-e18eb189cd56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:41.474545 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-a8191c66-b80b-46bb-969d-e18eb189cd56 None None] MFA Rules not processed for user `160bd3ee43244275a92578e69afe3f9e`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:04:41.475965 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-a8191c66-b80b-46bb-969d-e18eb189cd56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:41.548885 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:41.557645 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1411/2808] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 15:04:41 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:04:41.565110 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595a822d-3fb1-477e-93ab-f5195a6f7547 service neutron] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:41.566485 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-595a822d-3fb1-477e-93ab-f5195a6f7547 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:41.626767 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595a822d-3fb1-477e-93ab-f5195a6f7547 service neutron] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:41.630509 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f2a374-e46a-4911-a02a-54641377c4b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139dc7a4f1dc48fe8faea848bd1ac0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:41.631374 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f2a374-e46a-4911-a02a-54641377c4b2 service cinder] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:41.631660 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f2a374-e46a-4911-a02a-54641377c4b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:41.631935 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f2a374-e46a-4911-a02a-54641377c4b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:41.641157 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f2a374-e46a-4911-a02a-54641377c4b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:41.642569 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f2a374-e46a-4911-a02a-54641377c4b2 service cinder] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:41.651827 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1398/2809] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 15:04:41 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:04:43.019259 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77643ec-66e7-4ffa-89bb-8b9d325a8456 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:43.019850 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77643ec-66e7-4ffa-89bb-8b9d325a8456 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:43.019952 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77643ec-66e7-4ffa-89bb-8b9d325a8456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:43.040080 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-b77643ec-66e7-4ffa-89bb-8b9d325a8456 None None] MFA Rules not processed for user `160bd3ee43244275a92578e69afe3f9e`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:04:43.041339 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-b77643ec-66e7-4ffa-89bb-8b9d325a8456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:43.048718 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1412/2810] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 15:04:43 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:04:51.647918 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=70,keystone:INSERT=2 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:53.034164 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=3 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:56.001852 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a98f2d5-0096-4b35-91dd-039c66eaba8a None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:56.002321 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a98f2d5-0096-4b35-91dd-039c66eaba8a None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:56.002443 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a98f2d5-0096-4b35-91dd-039c66eaba8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:56.031178 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-1a98f2d5-0096-4b35-91dd-039c66eaba8a None None] MFA Rules not processed for user `160bd3ee43244275a92578e69afe3f9e`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:04:56.032414 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-1a98f2d5-0096-4b35-91dd-039c66eaba8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:56.056607 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1399/2811] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 15:04:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:05:06.054838 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=15 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:05:07.557085 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77643ec-66e7-4ffa-89bb-8b9d325a8456 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:07.558451 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-b77643ec-66e7-4ffa-89bb-8b9d325a8456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:05:07.694838 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77643ec-66e7-4ffa-89bb-8b9d325a8456 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:07.699714 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d69aa75-699a-4533-bf7e-667eefbaf3b6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e7a0148db8462b8ba24bac6dd15298', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:07.700598 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d69aa75-699a-4533-bf7e-667eefbaf3b6 service placement] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:07.700876 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d69aa75-699a-4533-bf7e-667eefbaf3b6 service placement] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:07.701143 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d69aa75-699a-4533-bf7e-667eefbaf3b6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:07.702863 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-1d69aa75-699a-4533-bf7e-667eefbaf3b6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:05:07.714771 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d69aa75-699a-4533-bf7e-667eefbaf3b6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:07.716354 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d69aa75-699a-4533-bf7e-667eefbaf3b6 service placement] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:07.726695 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1413/2812] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 15:05:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:05:10.464158 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e88c27-3f02-438b-9ee5-1a43d660e92e None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:10.464656 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e88c27-3f02-438b-9ee5-1a43d660e92e None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:10.464753 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e88c27-3f02-438b-9ee5-1a43d660e92e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:10.495517 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-27e88c27-3f02-438b-9ee5-1a43d660e92e None None] MFA Rules not processed for user `afbbbf11f3234297ab1dd509f064480f`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:05:10.496774 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-27e88c27-3f02-438b-9ee5-1a43d660e92e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:05:10.559633 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1400/2813] 10.222.0.72 () {58 vars in 1009 bytes} [Mon Sep 19 15:05:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:05:10.605378 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d69aa75-699a-4533-bf7e-667eefbaf3b6 service placement] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:10.606789 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-1d69aa75-699a-4533-bf7e-667eefbaf3b6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:05:10.677352 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d69aa75-699a-4533-bf7e-667eefbaf3b6 service placement] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:10.683266 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e078bb8-4074-4917-b6d6-adbbb197582c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8504425c3a414608b030d0cf1af78af5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:10.684352 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e078bb8-4074-4917-b6d6-adbbb197582c service swift] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:10.684661 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e078bb8-4074-4917-b6d6-adbbb197582c service swift] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:10.684931 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e078bb8-4074-4917-b6d6-adbbb197582c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:10.694115 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e078bb8-4074-4917-b6d6-adbbb197582c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:10.695679 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e078bb8-4074-4917-b6d6-adbbb197582c service swift] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:10.704188 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1414/2814] 10.222.0.72 () {60 vars in 1384 bytes} [Mon Sep 19 15:05:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 15:05:20.553513 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=32 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:05:20.701122 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=95 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:05:26.200803 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e6754-f5fa-4827-8e6c-efe925a7fcc7 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:26.201267 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e6754-f5fa-4827-8e6c-efe925a7fcc7 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:26.201373 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e6754-f5fa-4827-8e6c-efe925a7fcc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:26.221893 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-f16e6754-f5fa-4827-8e6c-efe925a7fcc7 None None] MFA Rules not processed for user `afbbbf11f3234297ab1dd509f064480f`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:05:26.223743 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-f16e6754-f5fa-4827-8e6c-efe925a7fcc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:05:26.230775 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1401/2815] 10.222.0.72 () {58 vars in 967 bytes} [Mon Sep 19 15:05:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:05:26.242933 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e078bb8-4074-4917-b6d6-adbbb197582c service swift] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:26.253308 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e078bb8-4074-4917-b6d6-adbbb197582c service swift] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:26.258385 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4638a8f-016b-4312-85b9-2eae0d4764be service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8504425c3a414608b030d0cf1af78af5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:26.258967 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4638a8f-016b-4312-85b9-2eae0d4764be service swift] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:26.259242 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4638a8f-016b-4312-85b9-2eae0d4764be service swift] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:26.259507 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4638a8f-016b-4312-85b9-2eae0d4764be service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:26.267253 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4638a8f-016b-4312-85b9-2eae0d4764be service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:26.268852 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4638a8f-016b-4312-85b9-2eae0d4764be service swift] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:26.277358 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1415/2816] 10.222.0.72 () {60 vars in 1384 bytes} [Mon Sep 19 15:05:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 15:05:28.285115 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16e6754-f5fa-4827-8e6c-efe925a7fcc7 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:28.323306 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16e6754-f5fa-4827-8e6c-efe925a7fcc7 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:28.328792 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23816eb2-3e57-4735-903d-ba43920acea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:28.329531 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23816eb2-3e57-4735-903d-ba43920acea1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:28.329885 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23816eb2-3e57-4735-903d-ba43920acea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:28.330167 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23816eb2-3e57-4735-903d-ba43920acea1 admin admin] PATH_INFO: `/v3/users/160bd3ee43244275a92578e69afe3f9e` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:28.331340 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23816eb2-3e57-4735-903d-ba43920acea1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=160bd3ee43244275a92578e69afe3f9e)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:28.333939 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23816eb2-3e57-4735-903d-ba43920acea1 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:28.384082 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-23816eb2-3e57-4735-903d-ba43920acea1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '160bd3ee43244275a92578e69afe3f9e'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:28.397043 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-23816eb2-3e57-4735-903d-ba43920acea1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '160bd3ee43244275a92578e69afe3f9e'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:28.404265 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-23816eb2-3e57-4735-903d-ba43920acea1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '160bd3ee43244275a92578e69afe3f9e'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:28.405044 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-23816eb2-3e57-4735-903d-ba43920acea1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '160bd3ee43244275a92578e69afe3f9e'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:28.414017 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-23816eb2-3e57-4735-903d-ba43920acea1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '160bd3ee43244275a92578e69afe3f9e'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:28.420751 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1402/2817] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Sep 19 15:05:28 2022] DELETE /identity/v3/users/160bd3ee43244275a92578e69afe3f9e => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:05:28.606901 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4638a8f-016b-4312-85b9-2eae0d4764be service swift] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:28.620318 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4638a8f-016b-4312-85b9-2eae0d4764be service swift] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:28.690694 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7af164d-90ad-48e7-9423-209d579a6433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:28.691883 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af164d-90ad-48e7-9423-209d579a6433 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:28.692345 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af164d-90ad-48e7-9423-209d579a6433 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:28.692797 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af164d-90ad-48e7-9423-209d579a6433 admin admin] PATH_INFO: `/v3/projects/069fc00ee7e34e84a27e5189da6e556e` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:28.694143 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7af164d-90ad-48e7-9423-209d579a6433 admin admin] RBAC: Authorizing `identity:delete_project(project_id=069fc00ee7e34e84a27e5189da6e556e)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:28.697035 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7af164d-90ad-48e7-9423-209d579a6433 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:28.792271 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-e7af164d-90ad-48e7-9423-209d579a6433 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '069fc00ee7e34e84a27e5189da6e556e', 'request_id': 'req-e7af164d-90ad-48e7-9423-209d579a6433'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:28.813774 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-e7af164d-90ad-48e7-9423-209d579a6433 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '069fc00ee7e34e84a27e5189da6e556e', 'request_id': 'req-e7af164d-90ad-48e7-9423-209d579a6433'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:28.824174 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-e7af164d-90ad-48e7-9423-209d579a6433 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '069fc00ee7e34e84a27e5189da6e556e', 'request_id': 'req-e7af164d-90ad-48e7-9423-209d579a6433'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:28.855100 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-e7af164d-90ad-48e7-9423-209d579a6433 admin admin] The token cache is being invalidate because project 069fc00ee7e34e84a27e5189da6e556e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:05:28.855392 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-e7af164d-90ad-48e7-9423-209d579a6433 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:28.856030 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-e7af164d-90ad-48e7-9423-209d579a6433 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:28.857714 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1416/2818] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Sep 19 15:05:28 2022] DELETE /identity/v3/projects/069fc00ee7e34e84a27e5189da6e556e => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:05:31.724279 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47170740-dff7-4198-bf57-b3c6b6ea352c None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:31.724823 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47170740-dff7-4198-bf57-b3c6b6ea352c None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:31.724923 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47170740-dff7-4198-bf57-b3c6b6ea352c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:31.744858 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-47170740-dff7-4198-bf57-b3c6b6ea352c None None] MFA Rules not processed for user `4edcf03fc7d244608b7ff8ee15ebfc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:05:31.746063 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-47170740-dff7-4198-bf57-b3c6b6ea352c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:05:31.799648 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1403/2819] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 15:05:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:05:38.852630 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=62,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:05:41.792940 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=64,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:06:33.203859 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7af164d-90ad-48e7-9423-209d579a6433 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:33.205359 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-e7af164d-90ad-48e7-9423-209d579a6433 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:06:33.273140 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7af164d-90ad-48e7-9423-209d579a6433 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:33.277653 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423dba31-a03a-41d4-a2dc-0f361080514e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:33.278270 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423dba31-a03a-41d4-a2dc-0f361080514e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:33.278547 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423dba31-a03a-41d4-a2dc-0f361080514e admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:33.278832 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423dba31-a03a-41d4-a2dc-0f361080514e admin admin] PATH_INFO: `/v3/users/4edcf03fc7d244608b7ff8ee15ebfc9a` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:33.279906 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423dba31-a03a-41d4-a2dc-0f361080514e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4edcf03fc7d244608b7ff8ee15ebfc9a)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:33.281826 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423dba31-a03a-41d4-a2dc-0f361080514e admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:33.328703 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-423dba31-a03a-41d4-a2dc-0f361080514e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4edcf03fc7d244608b7ff8ee15ebfc9a'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:33.341161 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-423dba31-a03a-41d4-a2dc-0f361080514e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4edcf03fc7d244608b7ff8ee15ebfc9a'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:33.348241 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-423dba31-a03a-41d4-a2dc-0f361080514e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4edcf03fc7d244608b7ff8ee15ebfc9a'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:33.356247 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-423dba31-a03a-41d4-a2dc-0f361080514e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4edcf03fc7d244608b7ff8ee15ebfc9a'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:33.356904 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-423dba31-a03a-41d4-a2dc-0f361080514e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4edcf03fc7d244608b7ff8ee15ebfc9a'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:33.362765 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1417/2820] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Sep 19 15:06:33 2022] DELETE /identity/v3/users/4edcf03fc7d244608b7ff8ee15ebfc9a => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:06:33.537101 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47170740-dff7-4198-bf57-b3c6b6ea352c None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:33.550164 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47170740-dff7-4198-bf57-b3c6b6ea352c None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:33.607847 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b75355b-1b01-499e-8cbf-7fe186c72844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:33.608521 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b75355b-1b01-499e-8cbf-7fe186c72844 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:33.608795 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b75355b-1b01-499e-8cbf-7fe186c72844 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:33.609063 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b75355b-1b01-499e-8cbf-7fe186c72844 admin admin] PATH_INFO: `/v3/projects/a0430aa29dc34cb5af0554167c3bbacc` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:33.610168 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b75355b-1b01-499e-8cbf-7fe186c72844 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0430aa29dc34cb5af0554167c3bbacc)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:33.612046 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b75355b-1b01-499e-8cbf-7fe186c72844 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:33.657692 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-0b75355b-1b01-499e-8cbf-7fe186c72844 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0430aa29dc34cb5af0554167c3bbacc', 'request_id': 'req-0b75355b-1b01-499e-8cbf-7fe186c72844'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:33.664899 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-0b75355b-1b01-499e-8cbf-7fe186c72844 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0430aa29dc34cb5af0554167c3bbacc', 'request_id': 'req-0b75355b-1b01-499e-8cbf-7fe186c72844'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:33.671074 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-0b75355b-1b01-499e-8cbf-7fe186c72844 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0430aa29dc34cb5af0554167c3bbacc', 'request_id': 'req-0b75355b-1b01-499e-8cbf-7fe186c72844'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:33.682935 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-0b75355b-1b01-499e-8cbf-7fe186c72844 admin admin] The token cache is being invalidate because project a0430aa29dc34cb5af0554167c3bbacc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:06:33.683401 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-0b75355b-1b01-499e-8cbf-7fe186c72844 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:33.684038 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-0b75355b-1b01-499e-8cbf-7fe186c72844 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:33.685614 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1404/2821] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Sep 19 15:06:33 2022] DELETE /identity/v3/projects/a0430aa29dc34cb5af0554167c3bbacc => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:06:33.690544 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e03c5b-4843-405a-b8de-40d44d98464b None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:33.690827 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e03c5b-4843-405a-b8de-40d44d98464b None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:33.691094 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e03c5b-4843-405a-b8de-40d44d98464b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:33.749791 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-73e03c5b-4843-405a-b8de-40d44d98464b None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:06:33.750925 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-73e03c5b-4843-405a-b8de-40d44d98464b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:06:33.794272 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:06:33.812974 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1418/2822] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 15:06:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:06:33.821253 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e45ad-62dd-45be-9b6f-9445b7a0dedf None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:33.821566 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e45ad-62dd-45be-9b6f-9445b7a0dedf None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:33.821845 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e45ad-62dd-45be-9b6f-9445b7a0dedf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:33.841566 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-ba9e45ad-62dd-45be-9b6f-9445b7a0dedf None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:06:33.842770 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-ba9e45ad-62dd-45be-9b6f-9445b7a0dedf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:06:33.850841 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1405/2823] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 15:06:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 15:06:33.854946 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e03c5b-4843-405a-b8de-40d44d98464b None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:33.865317 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e03c5b-4843-405a-b8de-40d44d98464b None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:33.869920 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38947067-d5c2-4817-8f1a-0d1188478bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:33.870509 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38947067-d5c2-4817-8f1a-0d1188478bd2 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:33.870785 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38947067-d5c2-4817-8f1a-0d1188478bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:33.871054 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38947067-d5c2-4817-8f1a-0d1188478bd2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:33.871688 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38947067-d5c2-4817-8f1a-0d1188478bd2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:06:33.871985 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38947067-d5c2-4817-8f1a-0d1188478bd2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:33.873676 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38947067-d5c2-4817-8f1a-0d1188478bd2 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:33.885810 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1419/2824] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Sep 19 15:06:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:06:33.889990 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9e45ad-62dd-45be-9b6f-9445b7a0dedf None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:33.899385 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9e45ad-62dd-45be-9b6f-9445b7a0dedf None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:33.904097 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8770f82a-2084-4bcb-ba3d-4a3862fdf26f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:33.904729 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8770f82a-2084-4bcb-ba3d-4a3862fdf26f admin admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:33.905011 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8770f82a-2084-4bcb-ba3d-4a3862fdf26f admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:33.905285 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8770f82a-2084-4bcb-ba3d-4a3862fdf26f admin admin] PATH_INFO: `/v3/projects` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:33.905911 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8770f82a-2084-4bcb-ba3d-4a3862fdf26f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:33.907813 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8770f82a-2084-4bcb-ba3d-4a3862fdf26f admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:33.936166 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1406/2825] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Sep 19 15:06:33 2022] POST /identity/v3/projects => generated 403 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:06:33.940359 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38947067-d5c2-4817-8f1a-0d1188478bd2 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:33.950279 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38947067-d5c2-4817-8f1a-0d1188478bd2 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:34.005943 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a805dda-edb9-42aa-b2a8-a807f8e8dab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:34.006464 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a805dda-edb9-42aa-b2a8-a807f8e8dab2 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:34.006740 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a805dda-edb9-42aa-b2a8-a807f8e8dab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:34.007009 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a805dda-edb9-42aa-b2a8-a807f8e8dab2 admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:34.007633 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a805dda-edb9-42aa-b2a8-a807f8e8dab2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:34.009549 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a805dda-edb9-42aa-b2a8-a807f8e8dab2 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:34.030417 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1420/2826] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Sep 19 15:06:33 2022] POST /identity/v3/users => generated 302 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 15:06:34.034494 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8770f82a-2084-4bcb-ba3d-4a3862fdf26f admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:34.045486 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8770f82a-2084-4bcb-ba3d-4a3862fdf26f admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:34.050009 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e5b808-5ea0-4073-aff0-324347f49915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:34.050587 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e5b808-5ea0-4073-aff0-324347f49915 admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:34.050863 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e5b808-5ea0-4073-aff0-324347f49915 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:34.051132 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e5b808-5ea0-4073-aff0-324347f49915 admin admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:34.051763 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e5b808-5ea0-4073-aff0-324347f49915 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:34.054154 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e5b808-5ea0-4073-aff0-324347f49915 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:34.063850 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1407/2827] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 15:06:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 15:06:34.067580 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a805dda-edb9-42aa-b2a8-a807f8e8dab2 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:34.077768 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a805dda-edb9-42aa-b2a8-a807f8e8dab2 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:34.082377 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de433050-c45f-4dff-a60c-5bdc60112dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:34.082964 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de433050-c45f-4dff-a60c-5bdc60112dbf admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:34.083242 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de433050-c45f-4dff-a60c-5bdc60112dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:34.083592 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de433050-c45f-4dff-a60c-5bdc60112dbf admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:34.084379 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de433050-c45f-4dff-a60c-5bdc60112dbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:34.085990 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de433050-c45f-4dff-a60c-5bdc60112dbf admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:34.096399 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1421/2828] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 15:06:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:06:34.101326 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e5b808-5ea0-4073-aff0-324347f49915 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:34.111324 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e5b808-5ea0-4073-aff0-324347f49915 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:34.116769 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be120f6-a9ed-423a-b251-b6ad4e51959f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:34.117420 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be120f6-a9ed-423a-b251-b6ad4e51959f admin admin] REQUEST_METHOD: `PUT` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:34.117705 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be120f6-a9ed-423a-b251-b6ad4e51959f admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:34.117986 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be120f6-a9ed-423a-b251-b6ad4e51959f admin admin] PATH_INFO: `/v3/projects/6273ede63e9b4dcfaca35ef88dd8013a/users/fdcabce056b74acda64f69ea18535525/roles/efa0e5b3413748dc828a89b12d67df79` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:34.132643 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be120f6-a9ed-423a-b251-b6ad4e51959f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6273ede63e9b4dcfaca35ef88dd8013a, user_id=fdcabce056b74acda64f69ea18535525, role_id=efa0e5b3413748dc828a89b12d67df79)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:34.135307 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be120f6-a9ed-423a-b251-b6ad4e51959f admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:34.148258 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1408/2829] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 15:06:34 2022] PUT /identity/v3/projects/6273ede63e9b4dcfaca35ef88dd8013a/users/fdcabce056b74acda64f69ea18535525/roles/efa0e5b3413748dc828a89b12d67df79 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:06:34.153252 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eb9d02-7e96-40a7-a31a-1ab4bfeafc8c None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:34.153536 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eb9d02-7e96-40a7-a31a-1ab4bfeafc8c None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:34.153807 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eb9d02-7e96-40a7-a31a-1ab4bfeafc8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:34.173298 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-97eb9d02-7e96-40a7-a31a-1ab4bfeafc8c None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:06:34.174515 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-97eb9d02-7e96-40a7-a31a-1ab4bfeafc8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:06:34.242700 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1422/2830] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 15:06:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:06:34.252296 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be120f6-a9ed-423a-b251-b6ad4e51959f admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:34.254012 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-5be120f6-a9ed-423a-b251-b6ad4e51959f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:06:34.288729 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:06:34.339006 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be120f6-a9ed-423a-b251-b6ad4e51959f admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:34.345040 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59305a77-2120-4b78-ba2d-48540cceb204 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c2b78646374cb79ded4b7b59ba49c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:34.345661 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59305a77-2120-4b78-ba2d-48540cceb204 service neutron] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:34.345941 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59305a77-2120-4b78-ba2d-48540cceb204 service neutron] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:34.346212 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59305a77-2120-4b78-ba2d-48540cceb204 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:34.357869 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59305a77-2120-4b78-ba2d-48540cceb204 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:34.359284 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59305a77-2120-4b78-ba2d-48540cceb204 service neutron] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:34.368812 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1409/2831] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 15:06:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:06:34.996083 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad50e1f6-9447-4573-82eb-6abd9211ab5d None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:34.996491 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad50e1f6-9447-4573-82eb-6abd9211ab5d None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:34.996843 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad50e1f6-9447-4573-82eb-6abd9211ab5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:35.028412 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-ad50e1f6-9447-4573-82eb-6abd9211ab5d None None] MFA Rules not processed for user `fdcabce056b74acda64f69ea18535525`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:06:35.029630 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-ad50e1f6-9447-4573-82eb-6abd9211ab5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:06:35.078601 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:06:35.102179 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1423/2832] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 15:06:34 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 15:06:35.106621 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59305a77-2120-4b78-ba2d-48540cceb204 service neutron] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:35.117327 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59305a77-2120-4b78-ba2d-48540cceb204 service neutron] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:35.121796 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347e3771-7588-4912-a1c2-229544880c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:35.122387 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e3771-7588-4912-a1c2-229544880c28 admin admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:35.122663 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e3771-7588-4912-a1c2-229544880c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:35.122935 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e3771-7588-4912-a1c2-229544880c28 admin admin] PATH_INFO: `/v3/projects` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:35.123562 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347e3771-7588-4912-a1c2-229544880c28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:35.125640 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347e3771-7588-4912-a1c2-229544880c28 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:35.154190 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1410/2833] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Sep 19 15:06:35 2022] POST /identity/v3/projects => generated 401 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:06:35.158026 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad50e1f6-9447-4573-82eb-6abd9211ab5d None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:35.169139 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad50e1f6-9447-4573-82eb-6abd9211ab5d None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:35.227774 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c2e1bf-9d31-4792-a9ed-3caca75c8e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:35.228409 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c2e1bf-9d31-4792-a9ed-3caca75c8e13 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:35.228692 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c2e1bf-9d31-4792-a9ed-3caca75c8e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:35.228968 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c2e1bf-9d31-4792-a9ed-3caca75c8e13 admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:35.229619 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c2e1bf-9d31-4792-a9ed-3caca75c8e13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:35.231530 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c2e1bf-9d31-4792-a9ed-3caca75c8e13 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:35.255034 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1424/2834] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Sep 19 15:06:35 2022] POST /identity/v3/users => generated 307 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:06:35.259458 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347e3771-7588-4912-a1c2-229544880c28 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:35.270333 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347e3771-7588-4912-a1c2-229544880c28 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:35.275532 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb0a2a3-b74f-4891-a2c8-88167b2aa006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:35.276148 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb0a2a3-b74f-4891-a2c8-88167b2aa006 admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:35.276462 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb0a2a3-b74f-4891-a2c8-88167b2aa006 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:35.276742 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb0a2a3-b74f-4891-a2c8-88167b2aa006 admin admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:35.277530 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb0a2a3-b74f-4891-a2c8-88167b2aa006 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:35.279138 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb0a2a3-b74f-4891-a2c8-88167b2aa006 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:35.290072 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1411/2835] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 15:06:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:06:35.294088 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c2e1bf-9d31-4792-a9ed-3caca75c8e13 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:35.305626 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c2e1bf-9d31-4792-a9ed-3caca75c8e13 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:35.310579 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1158b160-1049-4da9-8379-9fb09379b5ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:35.311226 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1158b160-1049-4da9-8379-9fb09379b5ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:35.311508 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1158b160-1049-4da9-8379-9fb09379b5ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:35.311785 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1158b160-1049-4da9-8379-9fb09379b5ec admin admin] PATH_INFO: `/v3/projects/56aeb036b12540c5a6346038d9298ee6/users/b486c774c3d8469a9e1ccc1b3bb6fa3c/roles/ddb643577b2e4e478100ec370decfaeb` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:35.327293 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1158b160-1049-4da9-8379-9fb09379b5ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=56aeb036b12540c5a6346038d9298ee6, user_id=b486c774c3d8469a9e1ccc1b3bb6fa3c, role_id=ddb643577b2e4e478100ec370decfaeb)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:35.330021 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1158b160-1049-4da9-8379-9fb09379b5ec admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:35.342755 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1425/2836] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 15:06:35 2022] PUT /identity/v3/projects/56aeb036b12540c5a6346038d9298ee6/users/b486c774c3d8469a9e1ccc1b3bb6fa3c/roles/ddb643577b2e4e478100ec370decfaeb => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:06:35.346863 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb0a2a3-b74f-4891-a2c8-88167b2aa006 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:35.357324 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb0a2a3-b74f-4891-a2c8-88167b2aa006 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:35.416671 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed3cbb8-00be-47f8-b866-daca391d2575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:35.417176 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed3cbb8-00be-47f8-b866-daca391d2575 admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:35.417457 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed3cbb8-00be-47f8-b866-daca391d2575 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:35.417724 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed3cbb8-00be-47f8-b866-daca391d2575 admin admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:35.418357 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed3cbb8-00be-47f8-b866-daca391d2575 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:35.419931 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed3cbb8-00be-47f8-b866-daca391d2575 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:35.430365 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1412/2837] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 15:06:35 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:06:35.434523 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1158b160-1049-4da9-8379-9fb09379b5ec admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:35.445070 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1158b160-1049-4da9-8379-9fb09379b5ec admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:35.449672 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45897cbd-03b7-48eb-ab2c-3d59d499f46b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:35.450315 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45897cbd-03b7-48eb-ab2c-3d59d499f46b admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:35.450595 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45897cbd-03b7-48eb-ab2c-3d59d499f46b admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:35.450866 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45897cbd-03b7-48eb-ab2c-3d59d499f46b admin admin] PATH_INFO: `/v3/projects/56aeb036b12540c5a6346038d9298ee6/users/b486c774c3d8469a9e1ccc1b3bb6fa3c/roles/ddb643577b2e4e478100ec370decfaeb` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:35.453067 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45897cbd-03b7-48eb-ab2c-3d59d499f46b admin admin] RBAC: Authorizing `identity:create_grant(project_id=56aeb036b12540c5a6346038d9298ee6, user_id=b486c774c3d8469a9e1ccc1b3bb6fa3c, role_id=ddb643577b2e4e478100ec370decfaeb)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:35.455682 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45897cbd-03b7-48eb-ab2c-3d59d499f46b admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:35.465801 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1426/2838] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 15:06:35 2022] PUT /identity/v3/projects/56aeb036b12540c5a6346038d9298ee6/users/b486c774c3d8469a9e1ccc1b3bb6fa3c/roles/ddb643577b2e4e478100ec370decfaeb => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:06:36.088713 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd994435-1be1-4d39-97b7-183ecbea4370 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:36.088997 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd994435-1be1-4d39-97b7-183ecbea4370 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:36.089297 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd994435-1be1-4d39-97b7-183ecbea4370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:36.119362 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-fd994435-1be1-4d39-97b7-183ecbea4370 None None] MFA Rules not processed for user `b486c774c3d8469a9e1ccc1b3bb6fa3c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:06:36.120621 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-fd994435-1be1-4d39-97b7-183ecbea4370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:06:36.189146 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:06:36.196304 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1413/2839] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 15:06:36 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:06:37.221551 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45897cbd-03b7-48eb-ab2c-3d59d499f46b admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:37.283811 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45897cbd-03b7-48eb-ab2c-3d59d499f46b admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:37.288535 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d598a1-bfc0-497e-bc26-96a28b0fb7c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:37.289150 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d598a1-bfc0-497e-bc26-96a28b0fb7c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:37.289429 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d598a1-bfc0-497e-bc26-96a28b0fb7c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:37.289702 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d598a1-bfc0-497e-bc26-96a28b0fb7c7 admin admin] PATH_INFO: `/v3/users/fdcabce056b74acda64f69ea18535525` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:37.290805 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d598a1-bfc0-497e-bc26-96a28b0fb7c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdcabce056b74acda64f69ea18535525)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:37.292742 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d598a1-bfc0-497e-bc26-96a28b0fb7c7 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:37.333615 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:06:37.340415 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-82d598a1-bfc0-497e-bc26-96a28b0fb7c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdcabce056b74acda64f69ea18535525'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:37.352797 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-82d598a1-bfc0-497e-bc26-96a28b0fb7c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdcabce056b74acda64f69ea18535525'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:37.359652 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-82d598a1-bfc0-497e-bc26-96a28b0fb7c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdcabce056b74acda64f69ea18535525'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:37.367619 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-82d598a1-bfc0-497e-bc26-96a28b0fb7c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdcabce056b74acda64f69ea18535525'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:37.368312 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-82d598a1-bfc0-497e-bc26-96a28b0fb7c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdcabce056b74acda64f69ea18535525'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:37.374215 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1427/2840] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Sep 19 15:06:37 2022] DELETE /identity/v3/users/fdcabce056b74acda64f69ea18535525 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:06:37.545147 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd994435-1be1-4d39-97b7-183ecbea4370 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:37.556441 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd994435-1be1-4d39-97b7-183ecbea4370 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:37.613295 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923fbe41-7c8c-4170-abe7-127193c46466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:37.613860 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923fbe41-7c8c-4170-abe7-127193c46466 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:37.614139 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923fbe41-7c8c-4170-abe7-127193c46466 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:37.614416 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923fbe41-7c8c-4170-abe7-127193c46466 admin admin] PATH_INFO: `/v3/projects/6273ede63e9b4dcfaca35ef88dd8013a` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:37.616099 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923fbe41-7c8c-4170-abe7-127193c46466 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6273ede63e9b4dcfaca35ef88dd8013a)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:37.618021 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923fbe41-7c8c-4170-abe7-127193c46466 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:37.675949 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-923fbe41-7c8c-4170-abe7-127193c46466 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6273ede63e9b4dcfaca35ef88dd8013a', 'request_id': 'req-923fbe41-7c8c-4170-abe7-127193c46466'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:37.686942 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-923fbe41-7c8c-4170-abe7-127193c46466 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6273ede63e9b4dcfaca35ef88dd8013a', 'request_id': 'req-923fbe41-7c8c-4170-abe7-127193c46466'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:37.694054 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-923fbe41-7c8c-4170-abe7-127193c46466 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6273ede63e9b4dcfaca35ef88dd8013a', 'request_id': 'req-923fbe41-7c8c-4170-abe7-127193c46466'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:37.704630 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-923fbe41-7c8c-4170-abe7-127193c46466 admin admin] The token cache is being invalidate because project 6273ede63e9b4dcfaca35ef88dd8013a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:06:37.704918 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-923fbe41-7c8c-4170-abe7-127193c46466 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:37.705620 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-923fbe41-7c8c-4170-abe7-127193c46466 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:37.707262 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1414/2841] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Sep 19 15:06:37 2022] DELETE /identity/v3/projects/6273ede63e9b4dcfaca35ef88dd8013a => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:06:37.711351 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d598a1-bfc0-497e-bc26-96a28b0fb7c7 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:37.712944 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-82d598a1-bfc0-497e-bc26-96a28b0fb7c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:06:37.726470 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d598a1-bfc0-497e-bc26-96a28b0fb7c7 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:37.783163 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397852b7-1c32-47ec-910f-3cdbedf83ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:37.783788 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397852b7-1c32-47ec-910f-3cdbedf83ec4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:37.784064 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397852b7-1c32-47ec-910f-3cdbedf83ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:37.784351 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397852b7-1c32-47ec-910f-3cdbedf83ec4 admin admin] PATH_INFO: `/v3/users/b486c774c3d8469a9e1ccc1b3bb6fa3c` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:37.785470 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397852b7-1c32-47ec-910f-3cdbedf83ec4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b486c774c3d8469a9e1ccc1b3bb6fa3c)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:37.787474 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397852b7-1c32-47ec-910f-3cdbedf83ec4 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:37.834150 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-397852b7-1c32-47ec-910f-3cdbedf83ec4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b486c774c3d8469a9e1ccc1b3bb6fa3c'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:37.846949 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-397852b7-1c32-47ec-910f-3cdbedf83ec4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b486c774c3d8469a9e1ccc1b3bb6fa3c'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:37.853980 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-397852b7-1c32-47ec-910f-3cdbedf83ec4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b486c774c3d8469a9e1ccc1b3bb6fa3c'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:37.861951 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-397852b7-1c32-47ec-910f-3cdbedf83ec4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b486c774c3d8469a9e1ccc1b3bb6fa3c'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:37.862571 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-397852b7-1c32-47ec-910f-3cdbedf83ec4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b486c774c3d8469a9e1ccc1b3bb6fa3c'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:37.868560 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1428/2842] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Sep 19 15:06:37 2022] DELETE /identity/v3/users/b486c774c3d8469a9e1ccc1b3bb6fa3c => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:06:38.049446 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923fbe41-7c8c-4170-abe7-127193c46466 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:38.050990 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-923fbe41-7c8c-4170-abe7-127193c46466 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:06:38.064960 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923fbe41-7c8c-4170-abe7-127193c46466 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:38.123693 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0be8fb-834c-434e-9972-d16c8aec28da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:38.124259 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0be8fb-834c-434e-9972-d16c8aec28da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:38.124572 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0be8fb-834c-434e-9972-d16c8aec28da admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:38.124849 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0be8fb-834c-434e-9972-d16c8aec28da admin admin] PATH_INFO: `/v3/projects/56aeb036b12540c5a6346038d9298ee6` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:38.125968 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0be8fb-834c-434e-9972-d16c8aec28da admin admin] RBAC: Authorizing `identity:delete_project(project_id=56aeb036b12540c5a6346038d9298ee6)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:38.127882 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0be8fb-834c-434e-9972-d16c8aec28da admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:38.161182 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:06:38.176650 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-de0be8fb-834c-434e-9972-d16c8aec28da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56aeb036b12540c5a6346038d9298ee6', 'request_id': 'req-de0be8fb-834c-434e-9972-d16c8aec28da'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:38.184730 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-de0be8fb-834c-434e-9972-d16c8aec28da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56aeb036b12540c5a6346038d9298ee6', 'request_id': 'req-de0be8fb-834c-434e-9972-d16c8aec28da'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:38.190814 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-de0be8fb-834c-434e-9972-d16c8aec28da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56aeb036b12540c5a6346038d9298ee6', 'request_id': 'req-de0be8fb-834c-434e-9972-d16c8aec28da'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:38.201952 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-de0be8fb-834c-434e-9972-d16c8aec28da admin admin] The token cache is being invalidate because project 56aeb036b12540c5a6346038d9298ee6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:06:38.202232 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-de0be8fb-834c-434e-9972-d16c8aec28da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:38.202858 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-de0be8fb-834c-434e-9972-d16c8aec28da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:38.204313 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1415/2843] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Sep 19 15:06:38 2022] DELETE /identity/v3/projects/56aeb036b12540c5a6346038d9298ee6 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:06:38.209283 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f59983-9a5b-48b9-aeff-55662f9d83a9 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:38.209568 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f59983-9a5b-48b9-aeff-55662f9d83a9 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:38.209835 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f59983-9a5b-48b9-aeff-55662f9d83a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:38.229066 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-04f59983-9a5b-48b9-aeff-55662f9d83a9 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:06:38.230253 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-04f59983-9a5b-48b9-aeff-55662f9d83a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:06:38.260697 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:06:38.290211 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1429/2844] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 15:06:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:06:38.297834 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cec03e-37e8-46fe-8602-a7bed77dafff None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:38.298145 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cec03e-37e8-46fe-8602-a7bed77dafff None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:38.298420 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cec03e-37e8-46fe-8602-a7bed77dafff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:38.319281 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-87cec03e-37e8-46fe-8602-a7bed77dafff None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:06:38.320526 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-87cec03e-37e8-46fe-8602-a7bed77dafff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:06:38.328725 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1416/2845] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 15:06:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:06:38.332894 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f59983-9a5b-48b9-aeff-55662f9d83a9 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:38.342688 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f59983-9a5b-48b9-aeff-55662f9d83a9 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:38.347234 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3accd247-5426-44a1-989a-accbc297ee2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:38.347829 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3accd247-5426-44a1-989a-accbc297ee2d admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:38.348111 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3accd247-5426-44a1-989a-accbc297ee2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:38.348422 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3accd247-5426-44a1-989a-accbc297ee2d admin admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:38.349260 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3accd247-5426-44a1-989a-accbc297ee2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:06:38.349656 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3accd247-5426-44a1-989a-accbc297ee2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:38.351253 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3accd247-5426-44a1-989a-accbc297ee2d admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:38.362558 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1430/2846] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Sep 19 15:06:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:06:38.367438 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cec03e-37e8-46fe-8602-a7bed77dafff None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:38.376693 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cec03e-37e8-46fe-8602-a7bed77dafff None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:38.382032 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adff1e0-ff9f-40eb-b121-1ba8bd99fe8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:38.382617 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adff1e0-ff9f-40eb-b121-1ba8bd99fe8d admin admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:38.382894 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adff1e0-ff9f-40eb-b121-1ba8bd99fe8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:38.383163 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adff1e0-ff9f-40eb-b121-1ba8bd99fe8d admin admin] PATH_INFO: `/v3/projects` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:38.383787 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adff1e0-ff9f-40eb-b121-1ba8bd99fe8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:38.385683 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adff1e0-ff9f-40eb-b121-1ba8bd99fe8d admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:38.413408 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1417/2847] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Sep 19 15:06:38 2022] POST /identity/v3/projects => generated 381 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:06:38.417630 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3accd247-5426-44a1-989a-accbc297ee2d admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:38.428014 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3accd247-5426-44a1-989a-accbc297ee2d admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:38.483141 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5ea2b2-a8af-436a-a5e6-e1cf04fde102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:38.483766 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5ea2b2-a8af-436a-a5e6-e1cf04fde102 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:38.484046 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5ea2b2-a8af-436a-a5e6-e1cf04fde102 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:38.484352 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5ea2b2-a8af-436a-a5e6-e1cf04fde102 admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:38.484983 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5ea2b2-a8af-436a-a5e6-e1cf04fde102 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:38.486922 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5ea2b2-a8af-436a-a5e6-e1cf04fde102 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:38.509219 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1431/2848] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Sep 19 15:06:38 2022] POST /identity/v3/users => generated 291 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:06:38.514329 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adff1e0-ff9f-40eb-b121-1ba8bd99fe8d admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:38.525655 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adff1e0-ff9f-40eb-b121-1ba8bd99fe8d admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:38.530239 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308ce891-b1d0-4eda-9557-e96444b78f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:38.530829 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ce891-b1d0-4eda-9557-e96444b78f4f admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:38.531106 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ce891-b1d0-4eda-9557-e96444b78f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:38.531373 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ce891-b1d0-4eda-9557-e96444b78f4f admin admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:38.532026 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308ce891-b1d0-4eda-9557-e96444b78f4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:38.533648 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308ce891-b1d0-4eda-9557-e96444b78f4f admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:38.544512 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1418/2849] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 15:06:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:06:38.548426 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5ea2b2-a8af-436a-a5e6-e1cf04fde102 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:38.559039 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5ea2b2-a8af-436a-a5e6-e1cf04fde102 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:38.564099 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab67043-4cd2-46de-92dc-15de82552589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:38.564882 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab67043-4cd2-46de-92dc-15de82552589 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:38.565310 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab67043-4cd2-46de-92dc-15de82552589 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:38.565561 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab67043-4cd2-46de-92dc-15de82552589 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:38.566194 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab67043-4cd2-46de-92dc-15de82552589 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:38.567957 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab67043-4cd2-46de-92dc-15de82552589 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:38.580650 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1432/2850] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 15:06:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:06:38.585040 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308ce891-b1d0-4eda-9557-e96444b78f4f admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:38.595675 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308ce891-b1d0-4eda-9557-e96444b78f4f admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:38.601020 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77273eb6-59bf-4380-b57c-b07516957e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:38.601656 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77273eb6-59bf-4380-b57c-b07516957e01 admin admin] REQUEST_METHOD: `PUT` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:38.601935 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77273eb6-59bf-4380-b57c-b07516957e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:38.602317 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77273eb6-59bf-4380-b57c-b07516957e01 admin admin] PATH_INFO: `/v3/projects/e6735f78c1c34e23afae59a643337a8e/users/90bb7dc8679444be863fd3ff314fb8d7/roles/efa0e5b3413748dc828a89b12d67df79` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:38.617776 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77273eb6-59bf-4380-b57c-b07516957e01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6735f78c1c34e23afae59a643337a8e, user_id=90bb7dc8679444be863fd3ff314fb8d7, role_id=efa0e5b3413748dc828a89b12d67df79)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:38.620415 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77273eb6-59bf-4380-b57c-b07516957e01 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:38.633784 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1419/2851] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 15:06:38 2022] PUT /identity/v3/projects/e6735f78c1c34e23afae59a643337a8e/users/90bb7dc8679444be863fd3ff314fb8d7/roles/efa0e5b3413748dc828a89b12d67df79 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:06:38.644952 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc05f8-0a9b-4e42-b3af-3369ca2fc78a None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:38.645241 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc05f8-0a9b-4e42-b3af-3369ca2fc78a None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:38.645520 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc05f8-0a9b-4e42-b3af-3369ca2fc78a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:38.673279 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-5fbc05f8-0a9b-4e42-b3af-3369ca2fc78a None None] MFA Rules not processed for user `90bb7dc8679444be863fd3ff314fb8d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:06:38.674487 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-5fbc05f8-0a9b-4e42-b3af-3369ca2fc78a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:06:38.738877 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1433/2852] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 15:06:38 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 15:06:38.744019 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77273eb6-59bf-4380-b57c-b07516957e01 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:38.804354 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77273eb6-59bf-4380-b57c-b07516957e01 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:38.808941 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e1727a-6c85-4eaf-9285-5bd8f0ddf979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:38.809531 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e1727a-6c85-4eaf-9285-5bd8f0ddf979 admin admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:38.809808 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e1727a-6c85-4eaf-9285-5bd8f0ddf979 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:38.810075 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e1727a-6c85-4eaf-9285-5bd8f0ddf979 admin admin] PATH_INFO: `/v3/projects` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:38.810695 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e1727a-6c85-4eaf-9285-5bd8f0ddf979 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:38.812591 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e1727a-6c85-4eaf-9285-5bd8f0ddf979 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:38.840068 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1420/2853] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Sep 19 15:06:38 2022] POST /identity/v3/projects => generated 379 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:06:38.844048 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbc05f8-0a9b-4e42-b3af-3369ca2fc78a None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:38.855428 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbc05f8-0a9b-4e42-b3af-3369ca2fc78a None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:38.883434 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:06:38.914989 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72c85e8-24a4-4fc0-b2e4-395128d15618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:38.915605 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72c85e8-24a4-4fc0-b2e4-395128d15618 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:38.915890 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72c85e8-24a4-4fc0-b2e4-395128d15618 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:38.916164 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72c85e8-24a4-4fc0-b2e4-395128d15618 admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:38.916836 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72c85e8-24a4-4fc0-b2e4-395128d15618 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:38.918797 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72c85e8-24a4-4fc0-b2e4-395128d15618 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:38.939204 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1434/2854] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Sep 19 15:06:38 2022] POST /identity/v3/users => generated 296 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:06:38.943364 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e1727a-6c85-4eaf-9285-5bd8f0ddf979 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:38.954094 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e1727a-6c85-4eaf-9285-5bd8f0ddf979 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:38.959501 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8646da0-468d-4c24-90cb-a0f366d850d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:38.960091 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8646da0-468d-4c24-90cb-a0f366d850d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:38.960409 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8646da0-468d-4c24-90cb-a0f366d850d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:38.960686 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8646da0-468d-4c24-90cb-a0f366d850d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:38.961326 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8646da0-468d-4c24-90cb-a0f366d850d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:38.962902 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8646da0-468d-4c24-90cb-a0f366d850d1 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:38.973383 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1421/2855] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 15:06:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:06:38.978238 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72c85e8-24a4-4fc0-b2e4-395128d15618 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:38.988233 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72c85e8-24a4-4fc0-b2e4-395128d15618 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:38.993117 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee52561a-5653-4768-a78f-99c5167e58c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:38.993764 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee52561a-5653-4768-a78f-99c5167e58c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:38.994046 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee52561a-5653-4768-a78f-99c5167e58c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:38.994321 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee52561a-5653-4768-a78f-99c5167e58c5 admin admin] PATH_INFO: `/v3/projects/c1299531fe3546659ca3a802e1e1d361/users/351c3312b0ab4ac59ad8837165c75e87/roles/ddb643577b2e4e478100ec370decfaeb` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:39.008746 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee52561a-5653-4768-a78f-99c5167e58c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1299531fe3546659ca3a802e1e1d361, user_id=351c3312b0ab4ac59ad8837165c75e87, role_id=ddb643577b2e4e478100ec370decfaeb)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:39.011679 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee52561a-5653-4768-a78f-99c5167e58c5 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:39.024944 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1435/2856] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 15:06:38 2022] PUT /identity/v3/projects/c1299531fe3546659ca3a802e1e1d361/users/351c3312b0ab4ac59ad8837165c75e87/roles/ddb643577b2e4e478100ec370decfaeb => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:06:39.028802 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8646da0-468d-4c24-90cb-a0f366d850d1 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:39.039174 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8646da0-468d-4c24-90cb-a0f366d850d1 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:39.065275 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:06:39.097378 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff2aa98-4e6a-4aee-858b-5fd71e54e899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:39.097982 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff2aa98-4e6a-4aee-858b-5fd71e54e899 admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:39.098260 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff2aa98-4e6a-4aee-858b-5fd71e54e899 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:39.098529 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff2aa98-4e6a-4aee-858b-5fd71e54e899 admin admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:39.099755 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff2aa98-4e6a-4aee-858b-5fd71e54e899 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:39.101361 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff2aa98-4e6a-4aee-858b-5fd71e54e899 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:39.111052 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1422/2857] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 15:06:39 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:06:39.115545 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee52561a-5653-4768-a78f-99c5167e58c5 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:39.125951 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee52561a-5653-4768-a78f-99c5167e58c5 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:39.131214 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86930b9c-59a6-4238-9a86-a60853e72df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:39.131857 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86930b9c-59a6-4238-9a86-a60853e72df5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:39.132138 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86930b9c-59a6-4238-9a86-a60853e72df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:39.132448 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86930b9c-59a6-4238-9a86-a60853e72df5 admin admin] PATH_INFO: `/v3/projects/c1299531fe3546659ca3a802e1e1d361/users/351c3312b0ab4ac59ad8837165c75e87/roles/ddb643577b2e4e478100ec370decfaeb` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:39.134367 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86930b9c-59a6-4238-9a86-a60853e72df5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1299531fe3546659ca3a802e1e1d361, user_id=351c3312b0ab4ac59ad8837165c75e87, role_id=ddb643577b2e4e478100ec370decfaeb)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:39.137069 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86930b9c-59a6-4238-9a86-a60853e72df5 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:39.147841 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1436/2858] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 15:06:39 2022] PUT /identity/v3/projects/c1299531fe3546659ca3a802e1e1d361/users/351c3312b0ab4ac59ad8837165c75e87/roles/ddb643577b2e4e478100ec370decfaeb => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:06:39.158067 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1a959d-a6c8-4e1b-b710-03ac83fbc754 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:39.158357 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1a959d-a6c8-4e1b-b710-03ac83fbc754 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:39.158662 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1a959d-a6c8-4e1b-b710-03ac83fbc754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:39.186350 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-de1a959d-a6c8-4e1b-b710-03ac83fbc754 None None] MFA Rules not processed for user `351c3312b0ab4ac59ad8837165c75e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:06:39.187485 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-de1a959d-a6c8-4e1b-b710-03ac83fbc754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:06:39.254327 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1423/2859] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 15:06:39 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:06:39.266279 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86930b9c-59a6-4238-9a86-a60853e72df5 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:39.267992 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-86930b9c-59a6-4238-9a86-a60853e72df5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:06:39.348118 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86930b9c-59a6-4238-9a86-a60853e72df5 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:39.352023 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78cf9df-4eed-46b6-9c05-b7085a5cc976 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139dc7a4f1dc48fe8faea848bd1ac0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:39.352649 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78cf9df-4eed-46b6-9c05-b7085a5cc976 service cinder] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:39.352929 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78cf9df-4eed-46b6-9c05-b7085a5cc976 service cinder] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:39.353200 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78cf9df-4eed-46b6-9c05-b7085a5cc976 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:39.362099 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78cf9df-4eed-46b6-9c05-b7085a5cc976 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:39.363519 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78cf9df-4eed-46b6-9c05-b7085a5cc976 service cinder] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:39.372937 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1437/2860] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 15:06:39 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:06:39.450903 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1a959d-a6c8-4e1b-b710-03ac83fbc754 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:39.461666 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1a959d-a6c8-4e1b-b710-03ac83fbc754 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:39.465331 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df717191-2717-4ab3-816d-003a017379b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139dc7a4f1dc48fe8faea848bd1ac0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:39.465924 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df717191-2717-4ab3-816d-003a017379b1 service cinder] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:39.466205 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df717191-2717-4ab3-816d-003a017379b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:39.466477 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df717191-2717-4ab3-816d-003a017379b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:39.523681 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df717191-2717-4ab3-816d-003a017379b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:39.525302 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df717191-2717-4ab3-816d-003a017379b1 service cinder] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:39.534264 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1424/2861] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 15:06:39 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:06:46.307623 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78cf9df-4eed-46b6-9c05-b7085a5cc976 service cinder] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:46.370401 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78cf9df-4eed-46b6-9c05-b7085a5cc976 service cinder] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:46.375014 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bba61c9-20d1-4bfd-b1be-54cd18aca1d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:46.375639 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bba61c9-20d1-4bfd-b1be-54cd18aca1d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:46.375923 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bba61c9-20d1-4bfd-b1be-54cd18aca1d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:46.376200 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bba61c9-20d1-4bfd-b1be-54cd18aca1d9 admin admin] PATH_INFO: `/v3/users/90bb7dc8679444be863fd3ff314fb8d7` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:46.377351 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bba61c9-20d1-4bfd-b1be-54cd18aca1d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90bb7dc8679444be863fd3ff314fb8d7)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:46.379256 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bba61c9-20d1-4bfd-b1be-54cd18aca1d9 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:46.384770 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:06:46.426566 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-3bba61c9-20d1-4bfd-b1be-54cd18aca1d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90bb7dc8679444be863fd3ff314fb8d7'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:46.438923 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-3bba61c9-20d1-4bfd-b1be-54cd18aca1d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90bb7dc8679444be863fd3ff314fb8d7'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:46.445987 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-3bba61c9-20d1-4bfd-b1be-54cd18aca1d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90bb7dc8679444be863fd3ff314fb8d7'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:46.453112 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-3bba61c9-20d1-4bfd-b1be-54cd18aca1d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90bb7dc8679444be863fd3ff314fb8d7'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:46.453734 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-3bba61c9-20d1-4bfd-b1be-54cd18aca1d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90bb7dc8679444be863fd3ff314fb8d7'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:46.459495 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1438/2862] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Sep 19 15:06:46 2022] DELETE /identity/v3/users/90bb7dc8679444be863fd3ff314fb8d7 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:06:46.464735 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ffc303-0426-448d-9a7c-41c0f6765e67 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:46.465257 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ffc303-0426-448d-9a7c-41c0f6765e67 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:46.465369 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ffc303-0426-448d-9a7c-41c0f6765e67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:46.484804 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-01ffc303-0426-448d-9a7c-41c0f6765e67 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:06:46.485996 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-01ffc303-0426-448d-9a7c-41c0f6765e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:06:46.528436 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:06:46.544856 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1425/2863] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 15:06:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:06:46.554679 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bba61c9-20d1-4bfd-b1be-54cd18aca1d9 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:46.556065 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-3bba61c9-20d1-4bfd-b1be-54cd18aca1d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:06:46.612630 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bba61c9-20d1-4bfd-b1be-54cd18aca1d9 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:46.616509 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0287dc7-e654-417d-b8e4-6e04706f40a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c2b78646374cb79ded4b7b59ba49c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:46.617117 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0287dc7-e654-417d-b8e4-6e04706f40a9 service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:46.617395 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0287dc7-e654-417d-b8e4-6e04706f40a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:46.617668 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0287dc7-e654-417d-b8e4-6e04706f40a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:46.626567 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0287dc7-e654-417d-b8e4-6e04706f40a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:46.627971 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0287dc7-e654-417d-b8e4-6e04706f40a9 service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:46.637826 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1439/2864] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 15:06:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:06:46.903953 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ffc303-0426-448d-9a7c-41c0f6765e67 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:46.905470 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-01ffc303-0426-448d-9a7c-41c0f6765e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:06:46.918105 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ffc303-0426-448d-9a7c-41c0f6765e67 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:46.923326 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295ea6db-af47-4a33-b6a8-1d9a652f2cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:46.923966 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ea6db-af47-4a33-b6a8-1d9a652f2cc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:46.924251 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ea6db-af47-4a33-b6a8-1d9a652f2cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:46.924565 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ea6db-af47-4a33-b6a8-1d9a652f2cc5 admin admin] PATH_INFO: `/v3/projects/e6735f78c1c34e23afae59a643337a8e` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:46.925684 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295ea6db-af47-4a33-b6a8-1d9a652f2cc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6735f78c1c34e23afae59a643337a8e)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:46.927620 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295ea6db-af47-4a33-b6a8-1d9a652f2cc5 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:46.976638 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-295ea6db-af47-4a33-b6a8-1d9a652f2cc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6735f78c1c34e23afae59a643337a8e', 'request_id': 'req-295ea6db-af47-4a33-b6a8-1d9a652f2cc5'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:46.984259 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-295ea6db-af47-4a33-b6a8-1d9a652f2cc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6735f78c1c34e23afae59a643337a8e', 'request_id': 'req-295ea6db-af47-4a33-b6a8-1d9a652f2cc5'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:46.990880 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-295ea6db-af47-4a33-b6a8-1d9a652f2cc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6735f78c1c34e23afae59a643337a8e', 'request_id': 'req-295ea6db-af47-4a33-b6a8-1d9a652f2cc5'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:47.002060 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-295ea6db-af47-4a33-b6a8-1d9a652f2cc5 admin admin] The token cache is being invalidate because project e6735f78c1c34e23afae59a643337a8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:06:47.002347 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-295ea6db-af47-4a33-b6a8-1d9a652f2cc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:47.002988 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-295ea6db-af47-4a33-b6a8-1d9a652f2cc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:47.004505 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1426/2865] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Sep 19 15:06:46 2022] DELETE /identity/v3/projects/e6735f78c1c34e23afae59a643337a8e => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:06:47.009111 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0287dc7-e654-417d-b8e4-6e04706f40a9 service neutron] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:47.018626 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0287dc7-e654-417d-b8e4-6e04706f40a9 service neutron] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:47.077048 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bec8bdc-b46a-47fe-b923-ec6db55b25c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:47.077669 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bec8bdc-b46a-47fe-b923-ec6db55b25c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:47.077944 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bec8bdc-b46a-47fe-b923-ec6db55b25c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:47.078213 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bec8bdc-b46a-47fe-b923-ec6db55b25c3 admin admin] PATH_INFO: `/v3/users/351c3312b0ab4ac59ad8837165c75e87` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:47.079313 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bec8bdc-b46a-47fe-b923-ec6db55b25c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=351c3312b0ab4ac59ad8837165c75e87)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:47.081242 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bec8bdc-b46a-47fe-b923-ec6db55b25c3 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:47.113794 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:06:47.129340 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-4bec8bdc-b46a-47fe-b923-ec6db55b25c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '351c3312b0ab4ac59ad8837165c75e87'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:47.141852 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-4bec8bdc-b46a-47fe-b923-ec6db55b25c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '351c3312b0ab4ac59ad8837165c75e87'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:47.148835 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-4bec8bdc-b46a-47fe-b923-ec6db55b25c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '351c3312b0ab4ac59ad8837165c75e87'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:47.156281 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-4bec8bdc-b46a-47fe-b923-ec6db55b25c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '351c3312b0ab4ac59ad8837165c75e87'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:47.156988 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-4bec8bdc-b46a-47fe-b923-ec6db55b25c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '351c3312b0ab4ac59ad8837165c75e87'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:47.162730 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1440/2866] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Sep 19 15:06:47 2022] DELETE /identity/v3/users/351c3312b0ab4ac59ad8837165c75e87 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:06:47.427817 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295ea6db-af47-4a33-b6a8-1d9a652f2cc5 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:47.429869 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-295ea6db-af47-4a33-b6a8-1d9a652f2cc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:06:47.442934 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295ea6db-af47-4a33-b6a8-1d9a652f2cc5 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:47.507242 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e562f9-e89b-4be4-a55c-d29af2393bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:47.507882 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e562f9-e89b-4be4-a55c-d29af2393bd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:47.508077 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e562f9-e89b-4be4-a55c-d29af2393bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:47.508385 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e562f9-e89b-4be4-a55c-d29af2393bd9 admin admin] PATH_INFO: `/v3/projects/c1299531fe3546659ca3a802e1e1d361` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:47.509539 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e562f9-e89b-4be4-a55c-d29af2393bd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1299531fe3546659ca3a802e1e1d361)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:47.511440 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e562f9-e89b-4be4-a55c-d29af2393bd9 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:47.557477 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-63e562f9-e89b-4be4-a55c-d29af2393bd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1299531fe3546659ca3a802e1e1d361', 'request_id': 'req-63e562f9-e89b-4be4-a55c-d29af2393bd9'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:47.564490 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-63e562f9-e89b-4be4-a55c-d29af2393bd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1299531fe3546659ca3a802e1e1d361', 'request_id': 'req-63e562f9-e89b-4be4-a55c-d29af2393bd9'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:47.570556 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-63e562f9-e89b-4be4-a55c-d29af2393bd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1299531fe3546659ca3a802e1e1d361', 'request_id': 'req-63e562f9-e89b-4be4-a55c-d29af2393bd9'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:47.581253 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-63e562f9-e89b-4be4-a55c-d29af2393bd9 admin admin] The token cache is being invalidate because project c1299531fe3546659ca3a802e1e1d361 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:06:47.581545 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-63e562f9-e89b-4be4-a55c-d29af2393bd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:47.582188 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-63e562f9-e89b-4be4-a55c-d29af2393bd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:47.583904 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1427/2867] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Sep 19 15:06:47 2022] DELETE /identity/v3/projects/c1299531fe3546659ca3a802e1e1d361 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:06:47.588765 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e166e0ee-5a5a-4725-b2ed-b57ecb3239e5 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:47.589246 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e166e0ee-5a5a-4725-b2ed-b57ecb3239e5 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:47.589461 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e166e0ee-5a5a-4725-b2ed-b57ecb3239e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:47.609192 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-e166e0ee-5a5a-4725-b2ed-b57ecb3239e5 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:06:47.610385 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-e166e0ee-5a5a-4725-b2ed-b57ecb3239e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:06:47.668514 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1441/2868] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 15:06:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:06:47.676192 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b75f0f-bac5-4449-b0ee-bbc8933feb04 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:47.676518 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b75f0f-bac5-4449-b0ee-bbc8933feb04 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:47.676803 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b75f0f-bac5-4449-b0ee-bbc8933feb04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:47.686807 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:06:47.701238 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-67b75f0f-bac5-4449-b0ee-bbc8933feb04 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:06:47.702704 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-67b75f0f-bac5-4449-b0ee-bbc8933feb04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:06:47.711101 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1428/2869] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 15:06:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:06:47.715265 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e166e0ee-5a5a-4725-b2ed-b57ecb3239e5 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:47.724801 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e166e0ee-5a5a-4725-b2ed-b57ecb3239e5 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:47.730001 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2467d4e6-5c63-4ef5-a529-5e075206b9c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:47.730589 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2467d4e6-5c63-4ef5-a529-5e075206b9c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:47.730868 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2467d4e6-5c63-4ef5-a529-5e075206b9c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:47.731139 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2467d4e6-5c63-4ef5-a529-5e075206b9c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:47.731784 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2467d4e6-5c63-4ef5-a529-5e075206b9c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:06:47.732089 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2467d4e6-5c63-4ef5-a529-5e075206b9c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:47.733712 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2467d4e6-5c63-4ef5-a529-5e075206b9c1 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:47.745495 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1442/2870] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Sep 19 15:06:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:06:47.749663 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b75f0f-bac5-4449-b0ee-bbc8933feb04 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:47.759131 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b75f0f-bac5-4449-b0ee-bbc8933feb04 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:47.763860 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3c99eb-b12d-480f-8e5f-068fc271d0f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:47.764487 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3c99eb-b12d-480f-8e5f-068fc271d0f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:47.764769 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3c99eb-b12d-480f-8e5f-068fc271d0f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:47.765043 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3c99eb-b12d-480f-8e5f-068fc271d0f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:47.765678 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3c99eb-b12d-480f-8e5f-068fc271d0f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:47.767565 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3c99eb-b12d-480f-8e5f-068fc271d0f3 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:47.801187 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1429/2871] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Sep 19 15:06:47 2022] POST /identity/v3/projects => generated 375 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 15:06:47.805560 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2467d4e6-5c63-4ef5-a529-5e075206b9c1 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:47.815420 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2467d4e6-5c63-4ef5-a529-5e075206b9c1 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:47.870951 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dc1060-fcb8-41e5-b454-43a64fc1341a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:47.871554 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dc1060-fcb8-41e5-b454-43a64fc1341a admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:47.871852 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dc1060-fcb8-41e5-b454-43a64fc1341a admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:47.872115 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dc1060-fcb8-41e5-b454-43a64fc1341a admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:47.872775 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dc1060-fcb8-41e5-b454-43a64fc1341a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:47.874679 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dc1060-fcb8-41e5-b454-43a64fc1341a admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:47.898531 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1443/2872] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Sep 19 15:06:47 2022] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:06:47.902720 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3c99eb-b12d-480f-8e5f-068fc271d0f3 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:47.913997 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3c99eb-b12d-480f-8e5f-068fc271d0f3 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:47.918770 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251f9457-0323-47bb-8029-2d76bd148a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:47.919366 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251f9457-0323-47bb-8029-2d76bd148a2d admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:47.919665 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251f9457-0323-47bb-8029-2d76bd148a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:47.919923 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251f9457-0323-47bb-8029-2d76bd148a2d admin admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:47.920614 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251f9457-0323-47bb-8029-2d76bd148a2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:47.922203 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251f9457-0323-47bb-8029-2d76bd148a2d admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:47.933594 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1430/2873] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 15:06:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:06:47.938406 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dc1060-fcb8-41e5-b454-43a64fc1341a admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:47.949630 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dc1060-fcb8-41e5-b454-43a64fc1341a admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:47.954598 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6094e68e-ff15-4e0b-85dc-34fe1956b493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:47.955190 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6094e68e-ff15-4e0b-85dc-34fe1956b493 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:47.955471 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6094e68e-ff15-4e0b-85dc-34fe1956b493 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:47.955744 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6094e68e-ff15-4e0b-85dc-34fe1956b493 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:47.956405 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6094e68e-ff15-4e0b-85dc-34fe1956b493 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:47.957985 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6094e68e-ff15-4e0b-85dc-34fe1956b493 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:47.969435 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1444/2874] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 15:06:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:06:47.973617 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251f9457-0323-47bb-8029-2d76bd148a2d admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:47.984404 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251f9457-0323-47bb-8029-2d76bd148a2d admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:47.989006 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c97224-fa91-4e10-9181-e3400fdd97f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:47.989678 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c97224-fa91-4e10-9181-e3400fdd97f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:47.989960 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c97224-fa91-4e10-9181-e3400fdd97f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:47.990234 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c97224-fa91-4e10-9181-e3400fdd97f2 admin admin] PATH_INFO: `/v3/projects/6d71dc62d42d4bec97be9a1da21b20cc/users/a0cd79d23afa4e1ebfd0f175953fb86d/roles/efa0e5b3413748dc828a89b12d67df79` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:48.004836 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c97224-fa91-4e10-9181-e3400fdd97f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d71dc62d42d4bec97be9a1da21b20cc, user_id=a0cd79d23afa4e1ebfd0f175953fb86d, role_id=efa0e5b3413748dc828a89b12d67df79)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:48.007673 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c97224-fa91-4e10-9181-e3400fdd97f2 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:48.021193 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1431/2875] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 15:06:47 2022] PUT /identity/v3/projects/6d71dc62d42d4bec97be9a1da21b20cc/users/a0cd79d23afa4e1ebfd0f175953fb86d/roles/efa0e5b3413748dc828a89b12d67df79 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:06:48.083973 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef182ed-f2ad-460d-8d94-d8c9553834ee None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:48.084261 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef182ed-f2ad-460d-8d94-d8c9553834ee None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:48.084587 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef182ed-f2ad-460d-8d94-d8c9553834ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:48.110493 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:06:48.114034 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-2ef182ed-f2ad-460d-8d94-d8c9553834ee None None] MFA Rules not processed for user `a0cd79d23afa4e1ebfd0f175953fb86d`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:06:48.115633 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-2ef182ed-f2ad-460d-8d94-d8c9553834ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:06:48.180864 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1445/2876] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 15:06:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:06:48.192164 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c97224-fa91-4e10-9181-e3400fdd97f2 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:48.193888 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-22c97224-fa91-4e10-9181-e3400fdd97f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:06:48.252836 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c97224-fa91-4e10-9181-e3400fdd97f2 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:48.257099 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbb2773-5df8-48fb-9858-dbc6070d2014 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d6d4ecf8f4849939d6510a6228b29dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:48.257717 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbb2773-5df8-48fb-9858-dbc6070d2014 service glance] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:48.257995 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbb2773-5df8-48fb-9858-dbc6070d2014 service glance] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:48.258266 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbb2773-5df8-48fb-9858-dbc6070d2014 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:48.266573 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbb2773-5df8-48fb-9858-dbc6070d2014 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:48.267999 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbb2773-5df8-48fb-9858-dbc6070d2014 service glance] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:48.277599 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1432/2877] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 15:06:48 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:06:58.177650 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=26 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:06:58.273443 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=52,keystone:INSERT=2 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:07:02.731878 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef182ed-f2ad-460d-8d94-d8c9553834ee None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:07:02.793041 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef182ed-f2ad-460d-8d94-d8c9553834ee None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:07:02.797436 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669ab136-fa42-48cc-9871-97ad3e667ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:07:02.798047 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669ab136-fa42-48cc-9871-97ad3e667ac6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:07:02.798320 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669ab136-fa42-48cc-9871-97ad3e667ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:07:02.798587 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669ab136-fa42-48cc-9871-97ad3e667ac6 admin admin] PATH_INFO: `/v3/users/a0cd79d23afa4e1ebfd0f175953fb86d` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:07:02.799668 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669ab136-fa42-48cc-9871-97ad3e667ac6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0cd79d23afa4e1ebfd0f175953fb86d)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:07:02.801589 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669ab136-fa42-48cc-9871-97ad3e667ac6 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:07:02.853420 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-669ab136-fa42-48cc-9871-97ad3e667ac6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0cd79d23afa4e1ebfd0f175953fb86d'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:07:02.865869 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-669ab136-fa42-48cc-9871-97ad3e667ac6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0cd79d23afa4e1ebfd0f175953fb86d'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:07:02.873154 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-669ab136-fa42-48cc-9871-97ad3e667ac6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0cd79d23afa4e1ebfd0f175953fb86d'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:07:02.880872 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-669ab136-fa42-48cc-9871-97ad3e667ac6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0cd79d23afa4e1ebfd0f175953fb86d'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:07:02.881493 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-669ab136-fa42-48cc-9871-97ad3e667ac6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0cd79d23afa4e1ebfd0f175953fb86d'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:07:02.887540 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1446/2878] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Sep 19 15:07:02 2022] DELETE /identity/v3/users/a0cd79d23afa4e1ebfd0f175953fb86d => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:07:02.892097 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e219cb-3e69-433d-870a-f968674b7881 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:07:02.892614 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e219cb-3e69-433d-870a-f968674b7881 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:07:02.892721 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e219cb-3e69-433d-870a-f968674b7881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:07:02.912404 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-44e219cb-3e69-433d-870a-f968674b7881 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:07:02.913610 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-44e219cb-3e69-433d-870a-f968674b7881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:07:02.972733 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1433/2879] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 15:07:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:07:02.983312 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669ab136-fa42-48cc-9871-97ad3e667ac6 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:07:02.984725 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-669ab136-fa42-48cc-9871-97ad3e667ac6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:07:03.040898 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669ab136-fa42-48cc-9871-97ad3e667ac6 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:07:03.044488 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c25956-1bea-4d41-91d6-9115412ec613 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c2b78646374cb79ded4b7b59ba49c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:07:03.045080 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c25956-1bea-4d41-91d6-9115412ec613 service neutron] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:07:03.045385 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c25956-1bea-4d41-91d6-9115412ec613 service neutron] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:07:03.045626 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c25956-1bea-4d41-91d6-9115412ec613 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:07:03.054378 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c25956-1bea-4d41-91d6-9115412ec613 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:07:03.055816 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c25956-1bea-4d41-91d6-9115412ec613 service neutron] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:07:03.065412 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1447/2880] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 15:07:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:07:03.329925 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e219cb-3e69-433d-870a-f968674b7881 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:07:03.331351 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-44e219cb-3e69-433d-870a-f968674b7881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:07:03.345384 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e219cb-3e69-433d-870a-f968674b7881 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:07:03.350122 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8955c11d-f132-4530-bda4-01a1d9bcb289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:07:03.350880 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8955c11d-f132-4530-bda4-01a1d9bcb289 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:07:03.351167 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8955c11d-f132-4530-bda4-01a1d9bcb289 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:07:03.351449 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8955c11d-f132-4530-bda4-01a1d9bcb289 admin admin] PATH_INFO: `/v3/projects/6d71dc62d42d4bec97be9a1da21b20cc` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:07:03.352612 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8955c11d-f132-4530-bda4-01a1d9bcb289 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d71dc62d42d4bec97be9a1da21b20cc)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:07:03.354648 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8955c11d-f132-4530-bda4-01a1d9bcb289 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:07:03.402135 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-8955c11d-f132-4530-bda4-01a1d9bcb289 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d71dc62d42d4bec97be9a1da21b20cc', 'request_id': 'req-8955c11d-f132-4530-bda4-01a1d9bcb289'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:07:03.409417 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-8955c11d-f132-4530-bda4-01a1d9bcb289 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d71dc62d42d4bec97be9a1da21b20cc', 'request_id': 'req-8955c11d-f132-4530-bda4-01a1d9bcb289'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:07:03.415732 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-8955c11d-f132-4530-bda4-01a1d9bcb289 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d71dc62d42d4bec97be9a1da21b20cc', 'request_id': 'req-8955c11d-f132-4530-bda4-01a1d9bcb289'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:07:03.426001 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-8955c11d-f132-4530-bda4-01a1d9bcb289 admin admin] The token cache is being invalidate because project 6d71dc62d42d4bec97be9a1da21b20cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:07:03.426288 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-8955c11d-f132-4530-bda4-01a1d9bcb289 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:07:03.426922 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-8955c11d-f132-4530-bda4-01a1d9bcb289 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:07:03.428415 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1434/2881] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Sep 19 15:07:03 2022] DELETE /identity/v3/projects/6d71dc62d42d4bec97be9a1da21b20cc => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:07:03.433838 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451ffd8d-944a-48ed-bad1-5c9cdc711434 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:07:03.434124 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451ffd8d-944a-48ed-bad1-5c9cdc711434 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:07:03.434418 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451ffd8d-944a-48ed-bad1-5c9cdc711434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:07:03.454682 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-451ffd8d-944a-48ed-bad1-5c9cdc711434 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:07:03.455885 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-451ffd8d-944a-48ed-bad1-5c9cdc711434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:07:03.472509 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:07:03.515806 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1448/2882] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 15:07:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:07:03.523160 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5333fa-8fd8-4108-b198-a585c86ca532 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:07:03.523467 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5333fa-8fd8-4108-b198-a585c86ca532 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:07:03.523736 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5333fa-8fd8-4108-b198-a585c86ca532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:07:03.542917 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-ec5333fa-8fd8-4108-b198-a585c86ca532 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:07:03.544095 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-ec5333fa-8fd8-4108-b198-a585c86ca532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:07:03.551822 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1435/2883] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 15:07:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:07:03.556380 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451ffd8d-944a-48ed-bad1-5c9cdc711434 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:07:03.566040 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451ffd8d-944a-48ed-bad1-5c9cdc711434 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:07:03.570628 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70de7562-bd1f-4cb6-bdee-06f89bbde3c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:07:03.571215 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70de7562-bd1f-4cb6-bdee-06f89bbde3c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:07:03.572125 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70de7562-bd1f-4cb6-bdee-06f89bbde3c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:07:03.572473 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70de7562-bd1f-4cb6-bdee-06f89bbde3c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:07:03.573111 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70de7562-bd1f-4cb6-bdee-06f89bbde3c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:07:03.573414 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70de7562-bd1f-4cb6-bdee-06f89bbde3c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:07:03.574994 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70de7562-bd1f-4cb6-bdee-06f89bbde3c5 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:07:03.586624 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1449/2884] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Sep 19 15:07:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:07:03.590947 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5333fa-8fd8-4108-b198-a585c86ca532 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:07:03.600089 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5333fa-8fd8-4108-b198-a585c86ca532 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:07:03.605043 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a27d722-1892-4d11-92c6-6e91aaebf611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:07:03.605634 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a27d722-1892-4d11-92c6-6e91aaebf611 admin admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:07:03.605913 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a27d722-1892-4d11-92c6-6e91aaebf611 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:07:03.606192 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a27d722-1892-4d11-92c6-6e91aaebf611 admin admin] PATH_INFO: `/v3/projects` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:07:03.606828 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a27d722-1892-4d11-92c6-6e91aaebf611 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:07:03.608753 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a27d722-1892-4d11-92c6-6e91aaebf611 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:07:03.645537 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1436/2885] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Sep 19 15:07:03 2022] POST /identity/v3/projects => generated 377 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:07:03.649854 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70de7562-bd1f-4cb6-bdee-06f89bbde3c5 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:07:03.662959 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70de7562-bd1f-4cb6-bdee-06f89bbde3c5 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:07:03.724499 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce057ff-9abf-4fcf-941f-c3df5d290618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:07:03.725095 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce057ff-9abf-4fcf-941f-c3df5d290618 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:07:03.725376 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce057ff-9abf-4fcf-941f-c3df5d290618 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:07:03.725649 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce057ff-9abf-4fcf-941f-c3df5d290618 admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:07:03.726276 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce057ff-9abf-4fcf-941f-c3df5d290618 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:07:03.728212 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce057ff-9abf-4fcf-941f-c3df5d290618 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:07:03.750905 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1450/2886] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Sep 19 15:07:03 2022] POST /identity/v3/users => generated 289 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:07:03.755414 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a27d722-1892-4d11-92c6-6e91aaebf611 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:07:03.766410 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a27d722-1892-4d11-92c6-6e91aaebf611 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:07:03.770954 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb49d58-9150-45b8-9525-655f2551d2a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:07:03.771545 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb49d58-9150-45b8-9525-655f2551d2a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:07:03.771833 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb49d58-9150-45b8-9525-655f2551d2a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:07:03.772102 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb49d58-9150-45b8-9525-655f2551d2a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:07:03.772780 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb49d58-9150-45b8-9525-655f2551d2a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:07:03.774384 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb49d58-9150-45b8-9525-655f2551d2a4 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:07:03.784525 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1437/2887] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 15:07:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 15:07:03.788311 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce057ff-9abf-4fcf-941f-c3df5d290618 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:07:03.799167 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce057ff-9abf-4fcf-941f-c3df5d290618 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:07:03.803756 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d08ddfa-f1a6-4380-92e6-6b0682c37059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:07:03.804361 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d08ddfa-f1a6-4380-92e6-6b0682c37059 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:07:03.804645 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d08ddfa-f1a6-4380-92e6-6b0682c37059 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:07:03.804917 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d08ddfa-f1a6-4380-92e6-6b0682c37059 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:07:03.805547 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d08ddfa-f1a6-4380-92e6-6b0682c37059 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:07:03.807785 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d08ddfa-f1a6-4380-92e6-6b0682c37059 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:07:03.818224 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1451/2888] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 15:07:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 15:07:03.822773 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb49d58-9150-45b8-9525-655f2551d2a4 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:07:03.832954 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb49d58-9150-45b8-9525-655f2551d2a4 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:07:03.837555 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9834eb9-e425-456b-bffc-fc90bc2dbb88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:07:03.838226 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9834eb9-e425-456b-bffc-fc90bc2dbb88 admin admin] REQUEST_METHOD: `PUT` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:07:03.838508 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9834eb9-e425-456b-bffc-fc90bc2dbb88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:07:03.838782 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9834eb9-e425-456b-bffc-fc90bc2dbb88 admin admin] PATH_INFO: `/v3/projects/158f9c7d199e475eb450a425139b9d3b/users/89b566eff7aa4d03b6139f6c6e0b60d5/roles/efa0e5b3413748dc828a89b12d67df79` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:07:03.854444 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9834eb9-e425-456b-bffc-fc90bc2dbb88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=158f9c7d199e475eb450a425139b9d3b, user_id=89b566eff7aa4d03b6139f6c6e0b60d5, role_id=efa0e5b3413748dc828a89b12d67df79)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:07:03.857432 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9834eb9-e425-456b-bffc-fc90bc2dbb88 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:07:03.871088 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1438/2889] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 15:07:03 2022] PUT /identity/v3/projects/158f9c7d199e475eb450a425139b9d3b/users/89b566eff7aa4d03b6139f6c6e0b60d5/roles/efa0e5b3413748dc828a89b12d67df79 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:07:03.882437 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3608b6-d4d7-4885-80bd-25c3f014a066 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:07:03.882718 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3608b6-d4d7-4885-80bd-25c3f014a066 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:07:03.882990 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3608b6-d4d7-4885-80bd-25c3f014a066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:07:03.910393 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-8c3608b6-d4d7-4885-80bd-25c3f014a066 None None] MFA Rules not processed for user `89b566eff7aa4d03b6139f6c6e0b60d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:07:03.911603 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-8c3608b6-d4d7-4885-80bd-25c3f014a066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:07:03.975971 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1452/2890] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 15:07:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:07:03.981139 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9834eb9-e425-456b-bffc-fc90bc2dbb88 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:07:03.995229 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:07:04.045949 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9834eb9-e425-456b-bffc-fc90bc2dbb88 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:07:04.051458 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0138672a-1bf5-485f-8ad8-71960650a773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:07:04.052064 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0138672a-1bf5-485f-8ad8-71960650a773 admin admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:07:04.052368 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0138672a-1bf5-485f-8ad8-71960650a773 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:07:04.052645 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0138672a-1bf5-485f-8ad8-71960650a773 admin admin] PATH_INFO: `/v3/projects` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:07:04.053262 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0138672a-1bf5-485f-8ad8-71960650a773 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:07:04.055140 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0138672a-1bf5-485f-8ad8-71960650a773 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:07:04.081562 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1439/2891] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Sep 19 15:07:03 2022] POST /identity/v3/projects => generated 375 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:07:04.086005 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3608b6-d4d7-4885-80bd-25c3f014a066 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:07:04.096928 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3608b6-d4d7-4885-80bd-25c3f014a066 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:07:04.109774 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:07:04.154159 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aafd8a-1c74-4752-8b2a-3430d3a92fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:07:04.154773 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aafd8a-1c74-4752-8b2a-3430d3a92fc7 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:07:04.155036 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aafd8a-1c74-4752-8b2a-3430d3a92fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:07:04.155309 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aafd8a-1c74-4752-8b2a-3430d3a92fc7 admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:07:04.155929 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aafd8a-1c74-4752-8b2a-3430d3a92fc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:07:04.157921 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aafd8a-1c74-4752-8b2a-3430d3a92fc7 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:07:04.179150 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1453/2892] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Sep 19 15:07:04 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 15:07:04.183238 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0138672a-1bf5-485f-8ad8-71960650a773 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:07:04.193653 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0138672a-1bf5-485f-8ad8-71960650a773 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:07:04.198517 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0811690-bd00-4ee5-b41e-70f4643da748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:07:04.199104 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0811690-bd00-4ee5-b41e-70f4643da748 admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:07:04.199384 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0811690-bd00-4ee5-b41e-70f4643da748 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:07:04.199657 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0811690-bd00-4ee5-b41e-70f4643da748 admin admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:07:04.200290 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0811690-bd00-4ee5-b41e-70f4643da748 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:07:04.202155 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0811690-bd00-4ee5-b41e-70f4643da748 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:07:04.213166 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1440/2893] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 15:07:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:07:04.216933 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aafd8a-1c74-4752-8b2a-3430d3a92fc7 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:07:04.226753 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aafd8a-1c74-4752-8b2a-3430d3a92fc7 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:07:04.232022 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3409c6-518d-40de-b05c-023a2c554aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:07:04.232639 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3409c6-518d-40de-b05c-023a2c554aeb admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:07:04.232917 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3409c6-518d-40de-b05c-023a2c554aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:07:04.233192 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3409c6-518d-40de-b05c-023a2c554aeb admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:07:04.233820 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3409c6-518d-40de-b05c-023a2c554aeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:07:04.235398 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3409c6-518d-40de-b05c-023a2c554aeb admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:07:04.245620 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1454/2894] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 15:07:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:07:04.249581 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0811690-bd00-4ee5-b41e-70f4643da748 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:07:04.259604 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0811690-bd00-4ee5-b41e-70f4643da748 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:07:04.264204 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d6032b-64aa-44a6-91cb-e94f4cfaae05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:07:04.264874 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6032b-64aa-44a6-91cb-e94f4cfaae05 admin admin] REQUEST_METHOD: `PUT` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:07:04.265156 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6032b-64aa-44a6-91cb-e94f4cfaae05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:07:04.265430 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6032b-64aa-44a6-91cb-e94f4cfaae05 admin admin] PATH_INFO: `/v3/projects/bbbe15d3b89f4e0e879fe5f1c0320930/users/bbb1c0ca3dc74adaba129458e92226e3/roles/efa0e5b3413748dc828a89b12d67df79` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:07:04.280151 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d6032b-64aa-44a6-91cb-e94f4cfaae05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbbe15d3b89f4e0e879fe5f1c0320930, user_id=bbb1c0ca3dc74adaba129458e92226e3, role_id=efa0e5b3413748dc828a89b12d67df79)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:07:04.282812 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d6032b-64aa-44a6-91cb-e94f4cfaae05 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:07:04.296249 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1441/2895] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 15:07:04 2022] PUT /identity/v3/projects/bbbe15d3b89f4e0e879fe5f1c0320930/users/bbb1c0ca3dc74adaba129458e92226e3/roles/efa0e5b3413748dc828a89b12d67df79 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:07:04.306224 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee5980d-638a-4579-b5c4-18260df0b521 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:07:04.306509 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee5980d-638a-4579-b5c4-18260df0b521 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:07:04.306784 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee5980d-638a-4579-b5c4-18260df0b521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:07:04.334517 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-1ee5980d-638a-4579-b5c4-18260df0b521 None None] MFA Rules not processed for user `bbb1c0ca3dc74adaba129458e92226e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:07:04.335813 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-1ee5980d-638a-4579-b5c4-18260df0b521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:07:04.400450 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1455/2896] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 15:07:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:07:04.404827 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d6032b-64aa-44a6-91cb-e94f4cfaae05 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:07:04.466175 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d6032b-64aa-44a6-91cb-e94f4cfaae05 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:07:04.470842 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d525abb-9f32-4d1f-bf64-1e238f882bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:07:04.471437 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d525abb-9f32-4d1f-bf64-1e238f882bfe admin admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:07:04.471714 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d525abb-9f32-4d1f-bf64-1e238f882bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:07:04.471983 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d525abb-9f32-4d1f-bf64-1e238f882bfe admin admin] PATH_INFO: `/v3/projects` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:07:04.472648 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d525abb-9f32-4d1f-bf64-1e238f882bfe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:07:04.474561 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d525abb-9f32-4d1f-bf64-1e238f882bfe admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:07:04.500649 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1442/2897] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Sep 19 15:07:04 2022] POST /identity/v3/projects => generated 375 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:07:04.504844 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee5980d-638a-4579-b5c4-18260df0b521 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:07:04.515960 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee5980d-638a-4579-b5c4-18260df0b521 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:07:04.572660 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12284de4-b55c-4381-b66e-fef4d33099c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:07:04.573176 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12284de4-b55c-4381-b66e-fef4d33099c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:07:04.573460 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12284de4-b55c-4381-b66e-fef4d33099c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:07:04.573730 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12284de4-b55c-4381-b66e-fef4d33099c4 admin admin] PATH_INFO: `/v3/users` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:07:04.574360 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12284de4-b55c-4381-b66e-fef4d33099c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:07:04.576259 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12284de4-b55c-4381-b66e-fef4d33099c4 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:07:04.598926 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1456/2898] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Sep 19 15:07:04 2022] POST /identity/v3/users => generated 294 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:07:04.602972 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d525abb-9f32-4d1f-bf64-1e238f882bfe admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:07:04.613262 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d525abb-9f32-4d1f-bf64-1e238f882bfe admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:07:04.617997 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508b88df-5e86-4093-b200-d019de951620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:07:04.618667 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b88df-5e86-4093-b200-d019de951620 admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:07:04.619084 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b88df-5e86-4093-b200-d019de951620 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:07:04.619361 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b88df-5e86-4093-b200-d019de951620 admin admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:07:04.619998 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508b88df-5e86-4093-b200-d019de951620 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:07:04.621611 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508b88df-5e86-4093-b200-d019de951620 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:07:04.631950 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1443/2899] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 15:07:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:07:04.636414 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12284de4-b55c-4381-b66e-fef4d33099c4 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:07:04.646445 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12284de4-b55c-4381-b66e-fef4d33099c4 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:07:04.651712 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c252654d-f014-45c9-a1e6-61a329d28641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:07:04.652377 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c252654d-f014-45c9-a1e6-61a329d28641 admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:07:04.652664 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c252654d-f014-45c9-a1e6-61a329d28641 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:07:04.652938 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c252654d-f014-45c9-a1e6-61a329d28641 admin admin] PATH_INFO: `/v3/projects/c89b5533048a46b78c4935bb01510409/users/3a5b9b5715324e4aa7177b0afa5932a4/roles/ddb643577b2e4e478100ec370decfaeb` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:07:04.664817 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:07:04.668048 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c252654d-f014-45c9-a1e6-61a329d28641 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c89b5533048a46b78c4935bb01510409, user_id=3a5b9b5715324e4aa7177b0afa5932a4, role_id=ddb643577b2e4e478100ec370decfaeb)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:07:04.671155 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c252654d-f014-45c9-a1e6-61a329d28641 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:07:04.685100 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1457/2900] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 15:07:04 2022] PUT /identity/v3/projects/c89b5533048a46b78c4935bb01510409/users/3a5b9b5715324e4aa7177b0afa5932a4/roles/ddb643577b2e4e478100ec370decfaeb => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:07:04.689096 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508b88df-5e86-4093-b200-d019de951620 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:07:04.699774 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508b88df-5e86-4093-b200-d019de951620 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:07:04.733436 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:07:04.759895 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27d7838-c9c9-4c0c-bb87-ee918a0de257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:07:04.760532 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27d7838-c9c9-4c0c-bb87-ee918a0de257 admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:07:04.760818 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27d7838-c9c9-4c0c-bb87-ee918a0de257 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:07:04.761093 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27d7838-c9c9-4c0c-bb87-ee918a0de257 admin admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:07:04.761726 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27d7838-c9c9-4c0c-bb87-ee918a0de257 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:07:04.763305 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27d7838-c9c9-4c0c-bb87-ee918a0de257 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:07:04.773137 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1444/2901] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 15:07:04 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:07:04.777790 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c252654d-f014-45c9-a1e6-61a329d28641 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:07:04.788249 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c252654d-f014-45c9-a1e6-61a329d28641 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:07:04.792902 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2c47b3-fc41-4f1d-9202-b24bece3e72c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:07:04.793570 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2c47b3-fc41-4f1d-9202-b24bece3e72c admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:07:04.793853 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2c47b3-fc41-4f1d-9202-b24bece3e72c admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:07:04.794127 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2c47b3-fc41-4f1d-9202-b24bece3e72c admin admin] PATH_INFO: `/v3/projects/c89b5533048a46b78c4935bb01510409/users/3a5b9b5715324e4aa7177b0afa5932a4/roles/ddb643577b2e4e478100ec370decfaeb` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:07:04.796035 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2c47b3-fc41-4f1d-9202-b24bece3e72c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c89b5533048a46b78c4935bb01510409, user_id=3a5b9b5715324e4aa7177b0afa5932a4, role_id=ddb643577b2e4e478100ec370decfaeb)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:07:04.798683 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2c47b3-fc41-4f1d-9202-b24bece3e72c admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:07:04.808767 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1458/2902] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 15:07:04 2022] PUT /identity/v3/projects/c89b5533048a46b78c4935bb01510409/users/3a5b9b5715324e4aa7177b0afa5932a4/roles/ddb643577b2e4e478100ec370decfaeb => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:07:04.818762 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b743f76e-ccff-43be-8e10-03e63e328c48 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:07:04.819079 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b743f76e-ccff-43be-8e10-03e63e328c48 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:07:04.819356 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b743f76e-ccff-43be-8e10-03e63e328c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:07:04.848627 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-b743f76e-ccff-43be-8e10-03e63e328c48 None None] MFA Rules not processed for user `3a5b9b5715324e4aa7177b0afa5932a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:07:04.849771 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-b743f76e-ccff-43be-8e10-03e63e328c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:07:04.917724 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1445/2903] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 15:07:04 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:07:04.928971 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2c47b3-fc41-4f1d-9202-b24bece3e72c admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:07:04.931209 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-0f2c47b3-fc41-4f1d-9202-b24bece3e72c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:07:04.988438 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2c47b3-fc41-4f1d-9202-b24bece3e72c admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:07:04.992084 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5aba28-f8b7-49ff-8c00-559ec8ea928f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139dc7a4f1dc48fe8faea848bd1ac0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:07:04.992717 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5aba28-f8b7-49ff-8c00-559ec8ea928f service cinder] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:07:04.993001 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5aba28-f8b7-49ff-8c00-559ec8ea928f service cinder] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:07:04.993801 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5aba28-f8b7-49ff-8c00-559ec8ea928f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:07:05.048881 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5aba28-f8b7-49ff-8c00-559ec8ea928f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:07:05.050303 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5aba28-f8b7-49ff-8c00-559ec8ea928f service cinder] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:07:05.059927 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1459/2904] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 15:07:04 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:07:06.554832 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b743f76e-ccff-43be-8e10-03e63e328c48 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:07:06.556378 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-b743f76e-ccff-43be-8e10-03e63e328c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:07:06.568140 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b743f76e-ccff-43be-8e10-03e63e328c48 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:07:06.571842 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6338b88f-da17-49e1-b0dc-e7f578a1d1d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139dc7a4f1dc48fe8faea848bd1ac0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:07:06.572469 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6338b88f-da17-49e1-b0dc-e7f578a1d1d1 service cinder] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:07:06.572751 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6338b88f-da17-49e1-b0dc-e7f578a1d1d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:07:06.573023 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6338b88f-da17-49e1-b0dc-e7f578a1d1d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:07:06.628954 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6338b88f-da17-49e1-b0dc-e7f578a1d1d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:07:06.630365 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6338b88f-da17-49e1-b0dc-e7f578a1d1d1 service cinder] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:07:06.639264 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1446/2905] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 15:07:06 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:07:07.163760 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5aba28-f8b7-49ff-8c00-559ec8ea928f service cinder] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:07:07.172612 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5aba28-f8b7-49ff-8c00-559ec8ea928f service cinder] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:07:07.176175 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95270351-5e20-4dec-9f6e-f6df30f14236 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139dc7a4f1dc48fe8faea848bd1ac0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:07:07.176793 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95270351-5e20-4dec-9f6e-f6df30f14236 service cinder] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:07:07.177072 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95270351-5e20-4dec-9f6e-f6df30f14236 service cinder] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:07:07.177343 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95270351-5e20-4dec-9f6e-f6df30f14236 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:07:07.187033 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95270351-5e20-4dec-9f6e-f6df30f14236 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:07:07.188476 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95270351-5e20-4dec-9f6e-f6df30f14236 service cinder] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:07:07.198362 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1460/2906] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 15:07:07 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:07:11.062097 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6338b88f-da17-49e1-b0dc-e7f578a1d1d1 service cinder] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:07:11.121011 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=100 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:07:11.127255 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6338b88f-da17-49e1-b0dc-e7f578a1d1d1 service cinder] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:07:11.131781 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a314d139-a2f5-43e8-8c29-e000479b36f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:07:11.132445 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a314d139-a2f5-43e8-8c29-e000479b36f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:07:11.132746 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a314d139-a2f5-43e8-8c29-e000479b36f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:07:11.133018 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a314d139-a2f5-43e8-8c29-e000479b36f1 admin admin] PATH_INFO: `/v3/users/89b566eff7aa4d03b6139f6c6e0b60d5` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:07:11.134128 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a314d139-a2f5-43e8-8c29-e000479b36f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89b566eff7aa4d03b6139f6c6e0b60d5)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:07:11.136240 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a314d139-a2f5-43e8-8c29-e000479b36f1 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:07:11.182035 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-a314d139-a2f5-43e8-8c29-e000479b36f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89b566eff7aa4d03b6139f6c6e0b60d5'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:07:11.193790 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-a314d139-a2f5-43e8-8c29-e000479b36f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89b566eff7aa4d03b6139f6c6e0b60d5'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:07:11.200643 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-a314d139-a2f5-43e8-8c29-e000479b36f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89b566eff7aa4d03b6139f6c6e0b60d5'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:07:11.201308 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-a314d139-a2f5-43e8-8c29-e000479b36f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89b566eff7aa4d03b6139f6c6e0b60d5'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:07:11.208836 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-a314d139-a2f5-43e8-8c29-e000479b36f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89b566eff7aa4d03b6139f6c6e0b60d5'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:07:11.215415 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1447/2907] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Sep 19 15:07:11 2022] DELETE /identity/v3/users/89b566eff7aa4d03b6139f6c6e0b60d5 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:07:11.219863 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dca1caa-040f-466a-b847-4cbdc32a8525 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:07:11.220322 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dca1caa-040f-466a-b847-4cbdc32a8525 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:07:11.220450 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dca1caa-040f-466a-b847-4cbdc32a8525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:07:11.239361 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-9dca1caa-040f-466a-b847-4cbdc32a8525 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:07:11.240585 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-9dca1caa-040f-466a-b847-4cbdc32a8525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:07:11.297295 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1461/2908] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 15:07:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:07:11.306833 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a314d139-a2f5-43e8-8c29-e000479b36f1 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:07:11.308223 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-a314d139-a2f5-43e8-8c29-e000479b36f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:07:11.365386 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a314d139-a2f5-43e8-8c29-e000479b36f1 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:07:11.369116 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cc5adc-73c3-4922-9725-8ec7b122ce37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c2b78646374cb79ded4b7b59ba49c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:07:11.369712 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cc5adc-73c3-4922-9725-8ec7b122ce37 service neutron] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:07:11.369994 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cc5adc-73c3-4922-9725-8ec7b122ce37 service neutron] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:07:11.370263 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cc5adc-73c3-4922-9725-8ec7b122ce37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:07:11.379197 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cc5adc-73c3-4922-9725-8ec7b122ce37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:07:11.380636 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cc5adc-73c3-4922-9725-8ec7b122ce37 service neutron] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:07:11.390410 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1448/2909] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 15:07:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:07:11.654050 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dca1caa-040f-466a-b847-4cbdc32a8525 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:07:11.655536 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-9dca1caa-040f-466a-b847-4cbdc32a8525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:07:11.670372 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dca1caa-040f-466a-b847-4cbdc32a8525 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:07:11.676269 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2d7485-b4a5-42a2-a444-35c17e464bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:07:11.676925 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d7485-b4a5-42a2-a444-35c17e464bd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:07:11.677191 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d7485-b4a5-42a2-a444-35c17e464bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:07:11.677544 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d7485-b4a5-42a2-a444-35c17e464bd5 admin admin] PATH_INFO: `/v3/projects/158f9c7d199e475eb450a425139b9d3b` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:07:11.678597 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2d7485-b4a5-42a2-a444-35c17e464bd5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=158f9c7d199e475eb450a425139b9d3b)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:07:11.680461 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2d7485-b4a5-42a2-a444-35c17e464bd5 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:07:11.698906 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:07:11.729820 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-3f2d7485-b4a5-42a2-a444-35c17e464bd5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '158f9c7d199e475eb450a425139b9d3b', 'request_id': 'req-3f2d7485-b4a5-42a2-a444-35c17e464bd5'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:07:11.737094 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-3f2d7485-b4a5-42a2-a444-35c17e464bd5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '158f9c7d199e475eb450a425139b9d3b', 'request_id': 'req-3f2d7485-b4a5-42a2-a444-35c17e464bd5'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:07:11.743277 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-3f2d7485-b4a5-42a2-a444-35c17e464bd5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '158f9c7d199e475eb450a425139b9d3b', 'request_id': 'req-3f2d7485-b4a5-42a2-a444-35c17e464bd5'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:07:11.757142 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-3f2d7485-b4a5-42a2-a444-35c17e464bd5 admin admin] The token cache is being invalidate because project 158f9c7d199e475eb450a425139b9d3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:07:11.757426 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-3f2d7485-b4a5-42a2-a444-35c17e464bd5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:07:11.758073 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-3f2d7485-b4a5-42a2-a444-35c17e464bd5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:07:11.759543 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1462/2910] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Sep 19 15:07:11 2022] DELETE /identity/v3/projects/158f9c7d199e475eb450a425139b9d3b => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:07:11.764496 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cc5adc-73c3-4922-9725-8ec7b122ce37 service neutron] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:07:11.774278 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cc5adc-73c3-4922-9725-8ec7b122ce37 service neutron] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:07:11.830979 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea20d360-a58a-42d1-a50c-05f3732780dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:07:11.831605 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea20d360-a58a-42d1-a50c-05f3732780dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:07:11.831888 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea20d360-a58a-42d1-a50c-05f3732780dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:07:11.832165 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea20d360-a58a-42d1-a50c-05f3732780dd admin admin] PATH_INFO: `/v3/users/bbb1c0ca3dc74adaba129458e92226e3` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:07:11.833312 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea20d360-a58a-42d1-a50c-05f3732780dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbb1c0ca3dc74adaba129458e92226e3)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:07:11.835224 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea20d360-a58a-42d1-a50c-05f3732780dd admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:07:11.855858 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:07:11.882418 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-ea20d360-a58a-42d1-a50c-05f3732780dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbb1c0ca3dc74adaba129458e92226e3'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:07:11.895398 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-ea20d360-a58a-42d1-a50c-05f3732780dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbb1c0ca3dc74adaba129458e92226e3'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:07:11.902460 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-ea20d360-a58a-42d1-a50c-05f3732780dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbb1c0ca3dc74adaba129458e92226e3'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:07:11.903153 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-ea20d360-a58a-42d1-a50c-05f3732780dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbb1c0ca3dc74adaba129458e92226e3'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:07:11.910661 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-ea20d360-a58a-42d1-a50c-05f3732780dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbb1c0ca3dc74adaba129458e92226e3'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:07:11.916813 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1449/2911] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Sep 19 15:07:11 2022] DELETE /identity/v3/users/bbb1c0ca3dc74adaba129458e92226e3 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:07:12.186601 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2d7485-b4a5-42a2-a444-35c17e464bd5 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:07:12.188142 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-3f2d7485-b4a5-42a2-a444-35c17e464bd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:07:12.203677 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2d7485-b4a5-42a2-a444-35c17e464bd5 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:07:12.266351 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63457cd1-af5e-42a9-8268-2e99863c63f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:07:12.267019 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63457cd1-af5e-42a9-8268-2e99863c63f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:07:12.267139 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63457cd1-af5e-42a9-8268-2e99863c63f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:07:12.267414 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63457cd1-af5e-42a9-8268-2e99863c63f8 admin admin] PATH_INFO: `/v3/projects/bbbe15d3b89f4e0e879fe5f1c0320930` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:07:12.268615 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63457cd1-af5e-42a9-8268-2e99863c63f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbbe15d3b89f4e0e879fe5f1c0320930)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:07:12.270740 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63457cd1-af5e-42a9-8268-2e99863c63f8 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:07:12.322544 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-63457cd1-af5e-42a9-8268-2e99863c63f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbbe15d3b89f4e0e879fe5f1c0320930', 'request_id': 'req-63457cd1-af5e-42a9-8268-2e99863c63f8'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:07:12.331120 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-63457cd1-af5e-42a9-8268-2e99863c63f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbbe15d3b89f4e0e879fe5f1c0320930', 'request_id': 'req-63457cd1-af5e-42a9-8268-2e99863c63f8'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:07:12.337710 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-63457cd1-af5e-42a9-8268-2e99863c63f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbbe15d3b89f4e0e879fe5f1c0320930', 'request_id': 'req-63457cd1-af5e-42a9-8268-2e99863c63f8'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:07:12.350070 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-63457cd1-af5e-42a9-8268-2e99863c63f8 admin admin] The token cache is being invalidate because project bbbe15d3b89f4e0e879fe5f1c0320930 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:07:12.350341 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-63457cd1-af5e-42a9-8268-2e99863c63f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:07:12.350999 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-63457cd1-af5e-42a9-8268-2e99863c63f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:07:12.352513 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1463/2912] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Sep 19 15:07:12 2022] DELETE /identity/v3/projects/bbbe15d3b89f4e0e879fe5f1c0320930 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:07:12.357389 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea20d360-a58a-42d1-a50c-05f3732780dd admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:07:12.358857 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-ea20d360-a58a-42d1-a50c-05f3732780dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:07:12.372573 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea20d360-a58a-42d1-a50c-05f3732780dd admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:07:12.428198 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99044f68-1632-471f-a38a-f1c54a770286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:07:12.428847 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99044f68-1632-471f-a38a-f1c54a770286 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:07:12.429127 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99044f68-1632-471f-a38a-f1c54a770286 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:07:12.429395 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99044f68-1632-471f-a38a-f1c54a770286 admin admin] PATH_INFO: `/v3/users/3a5b9b5715324e4aa7177b0afa5932a4` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:07:12.430492 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99044f68-1632-471f-a38a-f1c54a770286 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a5b9b5715324e4aa7177b0afa5932a4)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:07:12.432536 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99044f68-1632-471f-a38a-f1c54a770286 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:07:12.478009 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-99044f68-1632-471f-a38a-f1c54a770286 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a5b9b5715324e4aa7177b0afa5932a4'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:07:12.490349 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-99044f68-1632-471f-a38a-f1c54a770286 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a5b9b5715324e4aa7177b0afa5932a4'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:07:12.497245 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-99044f68-1632-471f-a38a-f1c54a770286 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a5b9b5715324e4aa7177b0afa5932a4'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:07:12.497900 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-99044f68-1632-471f-a38a-f1c54a770286 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a5b9b5715324e4aa7177b0afa5932a4'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:07:12.505184 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-99044f68-1632-471f-a38a-f1c54a770286 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a5b9b5715324e4aa7177b0afa5932a4'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:07:12.511394 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1450/2913] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Sep 19 15:07:12 2022] DELETE /identity/v3/users/3a5b9b5715324e4aa7177b0afa5932a4 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:07:12.781741 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63457cd1-af5e-42a9-8268-2e99863c63f8 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:07:12.783135 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-63457cd1-af5e-42a9-8268-2e99863c63f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:07:12.795973 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63457cd1-af5e-42a9-8268-2e99863c63f8 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:07:12.826888 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:07:12.858105 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9f193d-c315-45e6-870a-5a18f5bd9a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:07:12.858736 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f193d-c315-45e6-870a-5a18f5bd9a6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:07:12.859016 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f193d-c315-45e6-870a-5a18f5bd9a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:07:12.859286 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f193d-c315-45e6-870a-5a18f5bd9a6d admin admin] PATH_INFO: `/v3/projects/c89b5533048a46b78c4935bb01510409` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:07:12.860688 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9f193d-c315-45e6-870a-5a18f5bd9a6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c89b5533048a46b78c4935bb01510409)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:07:12.862576 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9f193d-c315-45e6-870a-5a18f5bd9a6d admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:07:12.910261 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-fa9f193d-c315-45e6-870a-5a18f5bd9a6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c89b5533048a46b78c4935bb01510409', 'request_id': 'req-fa9f193d-c315-45e6-870a-5a18f5bd9a6d'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:07:12.918156 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-fa9f193d-c315-45e6-870a-5a18f5bd9a6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c89b5533048a46b78c4935bb01510409', 'request_id': 'req-fa9f193d-c315-45e6-870a-5a18f5bd9a6d'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:07:12.923691 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-fa9f193d-c315-45e6-870a-5a18f5bd9a6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c89b5533048a46b78c4935bb01510409', 'request_id': 'req-fa9f193d-c315-45e6-870a-5a18f5bd9a6d'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:07:12.934568 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-fa9f193d-c315-45e6-870a-5a18f5bd9a6d admin admin] The token cache is being invalidate because project c89b5533048a46b78c4935bb01510409 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:07:12.934857 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-fa9f193d-c315-45e6-870a-5a18f5bd9a6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:07:12.935494 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-fa9f193d-c315-45e6-870a-5a18f5bd9a6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:07:12.937009 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1464/2914] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Sep 19 15:07:12 2022] DELETE /identity/v3/projects/c89b5533048a46b78c4935bb01510409 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:07:12.941995 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a70207-302d-4569-8f40-55c63d272e4f None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:07:12.942313 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a70207-302d-4569-8f40-55c63d272e4f None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:07:12.942592 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a70207-302d-4569-8f40-55c63d272e4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:07:12.963786 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-72a70207-302d-4569-8f40-55c63d272e4f None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:07:12.965025 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-72a70207-302d-4569-8f40-55c63d272e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:07:12.974432 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:07:13.025864 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1451/2915] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 15:07:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:07:13.033857 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73080f7-b81f-4f5e-9deb-f71bb0dd0592 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:07:13.034088 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73080f7-b81f-4f5e-9deb-f71bb0dd0592 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:07:13.034363 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73080f7-b81f-4f5e-9deb-f71bb0dd0592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:07:13.055369 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-a73080f7-b81f-4f5e-9deb-f71bb0dd0592 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:07:13.056592 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-a73080f7-b81f-4f5e-9deb-f71bb0dd0592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:07:13.064389 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1465/2916] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 15:07:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:07:13.068631 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a70207-302d-4569-8f40-55c63d272e4f None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:07:13.079083 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a70207-302d-4569-8f40-55c63d272e4f None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:07:13.083622 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c605ee1-d9e8-41e2-a4b3-acf441295ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:07:13.084209 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c605ee1-d9e8-41e2-a4b3-acf441295ccc admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:07:13.084517 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c605ee1-d9e8-41e2-a4b3-acf441295ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:07:13.084788 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c605ee1-d9e8-41e2-a4b3-acf441295ccc admin admin] PATH_INFO: `/v3/domains` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:07:13.085420 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c605ee1-d9e8-41e2-a4b3-acf441295ccc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:07:13.085719 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c605ee1-d9e8-41e2-a4b3-acf441295ccc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:07:13.087271 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c605ee1-d9e8-41e2-a4b3-acf441295ccc admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:07:13.099502 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1452/2917] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Sep 19 15:07:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:07:13.103991 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73080f7-b81f-4f5e-9deb-f71bb0dd0592 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:07:13.113240 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73080f7-b81f-4f5e-9deb-f71bb0dd0592 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:07:13.117765 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8ff1b8-adde-46b7-8db3-5a7c68eecff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:07:13.118355 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8ff1b8-adde-46b7-8db3-5a7c68eecff9 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:07:13.118634 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8ff1b8-adde-46b7-8db3-5a7c68eecff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:07:13.119398 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8ff1b8-adde-46b7-8db3-5a7c68eecff9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:07:13.120117 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8ff1b8-adde-46b7-8db3-5a7c68eecff9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:07:13.122053 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8ff1b8-adde-46b7-8db3-5a7c68eecff9 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:07:13.148695 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1466/2918] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Sep 19 15:07:13 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:07:13.153738 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c605ee1-d9e8-41e2-a4b3-acf441295ccc admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:07:13.163598 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c605ee1-d9e8-41e2-a4b3-acf441295ccc admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:07:13.219539 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf328798-e137-4d82-bc72-0501bd4592e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:07:13.220134 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf328798-e137-4d82-bc72-0501bd4592e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:07:13.220437 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf328798-e137-4d82-bc72-0501bd4592e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:07:13.220709 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf328798-e137-4d82-bc72-0501bd4592e3 admin admin] PATH_INFO: `/v3/users` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:07:13.221315 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf328798-e137-4d82-bc72-0501bd4592e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:07:13.223188 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf328798-e137-4d82-bc72-0501bd4592e3 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:07:13.245619 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1453/2919] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Sep 19 15:07:13 2022] POST /identity/v3/users => generated 287 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:07:13.249871 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8ff1b8-adde-46b7-8db3-5a7c68eecff9 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:07:13.261156 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8ff1b8-adde-46b7-8db3-5a7c68eecff9 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:07:13.265789 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bd0371-9d39-4435-bb32-6c71a9346a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:07:13.266374 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bd0371-9d39-4435-bb32-6c71a9346a95 admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:07:13.266905 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bd0371-9d39-4435-bb32-6c71a9346a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:07:13.266905 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bd0371-9d39-4435-bb32-6c71a9346a95 admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:07:13.267526 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bd0371-9d39-4435-bb32-6c71a9346a95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:07:13.269140 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bd0371-9d39-4435-bb32-6c71a9346a95 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:07:13.280137 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1467/2920] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 15:07:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 15:07:13.284318 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf328798-e137-4d82-bc72-0501bd4592e3 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:07:13.295193 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf328798-e137-4d82-bc72-0501bd4592e3 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:07:13.300285 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff066cdd-03e4-4a01-86fe-f187f827a8d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:07:13.300939 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff066cdd-03e4-4a01-86fe-f187f827a8d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:07:13.301223 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff066cdd-03e4-4a01-86fe-f187f827a8d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:07:13.301527 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff066cdd-03e4-4a01-86fe-f187f827a8d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:07:13.302173 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff066cdd-03e4-4a01-86fe-f187f827a8d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:07:13.303851 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff066cdd-03e4-4a01-86fe-f187f827a8d4 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:07:13.314700 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1454/2921] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 15:07:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:07:13.318785 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bd0371-9d39-4435-bb32-6c71a9346a95 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:07:13.329274 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bd0371-9d39-4435-bb32-6c71a9346a95 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:07:13.333864 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eae3c5-75eb-4322-a31b-0d5244f34457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:07:13.334507 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eae3c5-75eb-4322-a31b-0d5244f34457 admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:07:13.334783 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eae3c5-75eb-4322-a31b-0d5244f34457 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:07:13.335054 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eae3c5-75eb-4322-a31b-0d5244f34457 admin admin] PATH_INFO: `/v3/projects/0acf0091b0c544c8aeed8febd04a8b8b/users/d995b552253243e1b50ae32b2e0fea61/roles/efa0e5b3413748dc828a89b12d67df79` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:07:13.349857 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96eae3c5-75eb-4322-a31b-0d5244f34457 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0acf0091b0c544c8aeed8febd04a8b8b, user_id=d995b552253243e1b50ae32b2e0fea61, role_id=efa0e5b3413748dc828a89b12d67df79)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:07:13.352508 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96eae3c5-75eb-4322-a31b-0d5244f34457 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:07:13.367042 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1468/2922] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 15:07:13 2022] PUT /identity/v3/projects/0acf0091b0c544c8aeed8febd04a8b8b/users/d995b552253243e1b50ae32b2e0fea61/roles/efa0e5b3413748dc828a89b12d67df79 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:07:13.377322 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aae9f9-aade-4751-ad54-77c83e074889 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:07:13.377829 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aae9f9-aade-4751-ad54-77c83e074889 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:07:13.377962 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aae9f9-aade-4751-ad54-77c83e074889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:07:13.405328 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-17aae9f9-aade-4751-ad54-77c83e074889 None None] MFA Rules not processed for user `d995b552253243e1b50ae32b2e0fea61`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:07:13.406522 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-17aae9f9-aade-4751-ad54-77c83e074889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:07:13.470898 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1455/2923] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 15:07:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:07:13.482136 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eae3c5-75eb-4322-a31b-0d5244f34457 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:07:13.483803 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-96eae3c5-75eb-4322-a31b-0d5244f34457 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:07:13.539892 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eae3c5-75eb-4322-a31b-0d5244f34457 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:07:13.543445 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05748c4-b4b0-4369-9ffb-33ab705c43fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139dc7a4f1dc48fe8faea848bd1ac0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:07:13.544038 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05748c4-b4b0-4369-9ffb-33ab705c43fd service cinder] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:07:13.544317 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05748c4-b4b0-4369-9ffb-33ab705c43fd service cinder] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:07:13.544619 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05748c4-b4b0-4369-9ffb-33ab705c43fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:07:13.552812 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05748c4-b4b0-4369-9ffb-33ab705c43fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:07:13.554231 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05748c4-b4b0-4369-9ffb-33ab705c43fd service cinder] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:07:13.563160 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1469/2924] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 15:07:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:07:23.468021 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=92,keystone:INSERT=3 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:07:23.558487 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aae9f9-aade-4751-ad54-77c83e074889 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:07:23.558920 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:07:23.621026 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aae9f9-aade-4751-ad54-77c83e074889 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:07:23.625626 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2541217-977d-4f56-9032-35e9250cd0e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:07:23.626254 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2541217-977d-4f56-9032-35e9250cd0e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:07:23.626538 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2541217-977d-4f56-9032-35e9250cd0e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:07:23.626810 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2541217-977d-4f56-9032-35e9250cd0e3 admin admin] PATH_INFO: `/v3/users/d995b552253243e1b50ae32b2e0fea61` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:07:23.627923 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2541217-977d-4f56-9032-35e9250cd0e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d995b552253243e1b50ae32b2e0fea61)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:07:23.629866 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2541217-977d-4f56-9032-35e9250cd0e3 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:07:23.675230 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-c2541217-977d-4f56-9032-35e9250cd0e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd995b552253243e1b50ae32b2e0fea61'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:07:23.688109 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-c2541217-977d-4f56-9032-35e9250cd0e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd995b552253243e1b50ae32b2e0fea61'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:07:23.694963 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-c2541217-977d-4f56-9032-35e9250cd0e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd995b552253243e1b50ae32b2e0fea61'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:07:23.695658 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-c2541217-977d-4f56-9032-35e9250cd0e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd995b552253243e1b50ae32b2e0fea61'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:07:23.704717 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-c2541217-977d-4f56-9032-35e9250cd0e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd995b552253243e1b50ae32b2e0fea61'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:07:23.710510 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1456/2925] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Sep 19 15:07:23 2022] DELETE /identity/v3/users/d995b552253243e1b50ae32b2e0fea61 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:07:23.715201 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb59ce-17ad-4c83-902b-cdfccd549c24 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:07:23.715496 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb59ce-17ad-4c83-902b-cdfccd549c24 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:07:23.715778 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb59ce-17ad-4c83-902b-cdfccd549c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:07:23.735530 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-bbbb59ce-17ad-4c83-902b-cdfccd549c24 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:07:23.736783 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-bbbb59ce-17ad-4c83-902b-cdfccd549c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:07:23.793881 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1470/2926] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 15:07:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:07:23.803351 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2541217-977d-4f56-9032-35e9250cd0e3 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:07:23.804775 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-c2541217-977d-4f56-9032-35e9250cd0e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:07:23.862585 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2541217-977d-4f56-9032-35e9250cd0e3 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:07:23.866219 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1564bfa6-e0b4-45c2-b50c-f359747762b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c2b78646374cb79ded4b7b59ba49c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:07:23.866824 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1564bfa6-e0b4-45c2-b50c-f359747762b5 service neutron] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:07:23.867112 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1564bfa6-e0b4-45c2-b50c-f359747762b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:07:23.867386 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1564bfa6-e0b4-45c2-b50c-f359747762b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:07:23.877235 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1564bfa6-e0b4-45c2-b50c-f359747762b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:07:23.878665 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1564bfa6-e0b4-45c2-b50c-f359747762b5 service neutron] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:07:23.889136 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1457/2927] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 15:07:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:07:24.151071 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbb59ce-17ad-4c83-902b-cdfccd549c24 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:07:24.152816 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-bbbb59ce-17ad-4c83-902b-cdfccd549c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:07:24.166788 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbb59ce-17ad-4c83-902b-cdfccd549c24 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:07:24.172046 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7386f91-b5e6-4c84-9475-8f64b5957d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:07:24.173492 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7386f91-b5e6-4c84-9475-8f64b5957d5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:07:24.173781 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7386f91-b5e6-4c84-9475-8f64b5957d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:07:24.174052 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7386f91-b5e6-4c84-9475-8f64b5957d5f admin admin] PATH_INFO: `/v3/projects/0acf0091b0c544c8aeed8febd04a8b8b` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:07:24.175279 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7386f91-b5e6-4c84-9475-8f64b5957d5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0acf0091b0c544c8aeed8febd04a8b8b)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:07:24.177105 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7386f91-b5e6-4c84-9475-8f64b5957d5f admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:07:24.225334 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-d7386f91-b5e6-4c84-9475-8f64b5957d5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0acf0091b0c544c8aeed8febd04a8b8b', 'request_id': 'req-d7386f91-b5e6-4c84-9475-8f64b5957d5f'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:07:24.233075 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-d7386f91-b5e6-4c84-9475-8f64b5957d5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0acf0091b0c544c8aeed8febd04a8b8b', 'request_id': 'req-d7386f91-b5e6-4c84-9475-8f64b5957d5f'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:07:24.238464 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-d7386f91-b5e6-4c84-9475-8f64b5957d5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0acf0091b0c544c8aeed8febd04a8b8b', 'request_id': 'req-d7386f91-b5e6-4c84-9475-8f64b5957d5f'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:07:24.250081 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-d7386f91-b5e6-4c84-9475-8f64b5957d5f admin admin] The token cache is being invalidate because project 0acf0091b0c544c8aeed8febd04a8b8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:07:24.250369 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-d7386f91-b5e6-4c84-9475-8f64b5957d5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:07:24.250993 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-d7386f91-b5e6-4c84-9475-8f64b5957d5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:07:24.252474 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1471/2928] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Sep 19 15:07:24 2022] DELETE /identity/v3/projects/0acf0091b0c544c8aeed8febd04a8b8b => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:07:24.257358 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbf0209-dafd-4bbb-b1e5-d94cbd7c9d33 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:07:24.257654 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbf0209-dafd-4bbb-b1e5-d94cbd7c9d33 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:07:24.257934 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbf0209-dafd-4bbb-b1e5-d94cbd7c9d33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:07:24.277568 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-5dbf0209-dafd-4bbb-b1e5-d94cbd7c9d33 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:07:24.278770 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-5dbf0209-dafd-4bbb-b1e5-d94cbd7c9d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:07:24.296069 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:07:24.345122 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1458/2929] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 15:07:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 15:07:24.353794 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c7061c-7862-4616-9e22-8630dffe1e35 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:07:24.354077 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c7061c-7862-4616-9e22-8630dffe1e35 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:07:24.355126 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c7061c-7862-4616-9e22-8630dffe1e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:07:24.374496 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-49c7061c-7862-4616-9e22-8630dffe1e35 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:07:24.375676 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-49c7061c-7862-4616-9e22-8630dffe1e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:07:24.383378 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1472/2930] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 15:07:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:07:24.387686 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbf0209-dafd-4bbb-b1e5-d94cbd7c9d33 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:07:24.397447 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbf0209-dafd-4bbb-b1e5-d94cbd7c9d33 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:07:24.402455 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a397355-5d4a-439a-ab26-3fef48a046a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:07:24.403045 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a397355-5d4a-439a-ab26-3fef48a046a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:07:24.403325 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a397355-5d4a-439a-ab26-3fef48a046a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:07:24.403600 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a397355-5d4a-439a-ab26-3fef48a046a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:07:24.404235 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a397355-5d4a-439a-ab26-3fef48a046a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:07:24.404580 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a397355-5d4a-439a-ab26-3fef48a046a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:07:24.406157 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a397355-5d4a-439a-ab26-3fef48a046a9 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:07:24.418162 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1459/2931] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Sep 19 15:07:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:07:24.422429 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c7061c-7862-4616-9e22-8630dffe1e35 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:07:24.431570 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c7061c-7862-4616-9e22-8630dffe1e35 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:07:24.436209 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40317350-4e6c-45ed-96a8-0619ae8b7ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:07:24.436827 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40317350-4e6c-45ed-96a8-0619ae8b7ba1 admin admin] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:07:24.437108 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40317350-4e6c-45ed-96a8-0619ae8b7ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:07:24.437380 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40317350-4e6c-45ed-96a8-0619ae8b7ba1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:07:24.438008 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40317350-4e6c-45ed-96a8-0619ae8b7ba1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:07:24.439887 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40317350-4e6c-45ed-96a8-0619ae8b7ba1 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:07:24.467035 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1473/2932] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Sep 19 15:07:24 2022] POST /identity/v3/projects => generated 397 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:07:24.471271 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a397355-5d4a-439a-ab26-3fef48a046a9 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:07:24.481771 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a397355-5d4a-439a-ab26-3fef48a046a9 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:07:24.536610 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac58a62-309e-4009-bdb9-0c0793d8586b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:07:24.537206 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac58a62-309e-4009-bdb9-0c0793d8586b admin admin] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:07:24.537488 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac58a62-309e-4009-bdb9-0c0793d8586b admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:07:24.537761 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac58a62-309e-4009-bdb9-0c0793d8586b admin admin] PATH_INFO: `/v3/users` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:07:24.538382 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac58a62-309e-4009-bdb9-0c0793d8586b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:07:24.540268 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac58a62-309e-4009-bdb9-0c0793d8586b admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:07:24.561735 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1460/2933] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Sep 19 15:07:24 2022] POST /identity/v3/users => generated 299 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 15:07:24.565840 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40317350-4e6c-45ed-96a8-0619ae8b7ba1 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:07:24.576703 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40317350-4e6c-45ed-96a8-0619ae8b7ba1 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:07:24.581365 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f247b5c-f968-4719-bd45-6939d4dd577a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:07:24.581948 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f247b5c-f968-4719-bd45-6939d4dd577a admin admin] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:07:24.582224 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f247b5c-f968-4719-bd45-6939d4dd577a admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:07:24.582493 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f247b5c-f968-4719-bd45-6939d4dd577a admin admin] PATH_INFO: `/v3/roles` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:07:24.583118 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f247b5c-f968-4719-bd45-6939d4dd577a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:07:24.584746 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f247b5c-f968-4719-bd45-6939d4dd577a admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:07:24.597290 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1474/2934] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 15:07:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:07:24.601251 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac58a62-309e-4009-bdb9-0c0793d8586b admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:07:24.612077 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac58a62-309e-4009-bdb9-0c0793d8586b admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:07:24.616796 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0c6b01-0583-40f3-90c0-3a5c1e62919c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:07:24.617386 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0c6b01-0583-40f3-90c0-3a5c1e62919c admin admin] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:07:24.617669 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0c6b01-0583-40f3-90c0-3a5c1e62919c admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:07:24.617945 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0c6b01-0583-40f3-90c0-3a5c1e62919c admin admin] PATH_INFO: `/v3/roles` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:07:24.618581 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0c6b01-0583-40f3-90c0-3a5c1e62919c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:07:24.620244 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0c6b01-0583-40f3-90c0-3a5c1e62919c admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:07:24.630774 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1461/2935] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Sep 19 15:07:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:07:24.634758 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f247b5c-f968-4719-bd45-6939d4dd577a admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:07:24.644581 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f247b5c-f968-4719-bd45-6939d4dd577a admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:07:24.656085 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4c807b-83cc-4c81-abff-2cf4dc567174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:07:24.657001 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4c807b-83cc-4c81-abff-2cf4dc567174 admin admin] REQUEST_METHOD: `PUT` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:07:24.657286 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4c807b-83cc-4c81-abff-2cf4dc567174 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:07:24.657563 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4c807b-83cc-4c81-abff-2cf4dc567174 admin admin] PATH_INFO: `/v3/projects/0d1fc967af744081a5ea2de359ec1242/users/d040b37f0d68451e931ed64e11fe78c9/roles/efa0e5b3413748dc828a89b12d67df79` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:07:24.673391 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4c807b-83cc-4c81-abff-2cf4dc567174 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d1fc967af744081a5ea2de359ec1242, user_id=d040b37f0d68451e931ed64e11fe78c9, role_id=efa0e5b3413748dc828a89b12d67df79)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:07:24.676056 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4c807b-83cc-4c81-abff-2cf4dc567174 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:07:24.689902 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1475/2936] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Sep 19 15:07:24 2022] PUT /identity/v3/projects/0d1fc967af744081a5ea2de359ec1242/users/d040b37f0d68451e931ed64e11fe78c9/roles/efa0e5b3413748dc828a89b12d67df79 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:07:24.700589 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387193ab-4e6c-4c48-8b6e-0e3898fd1bc4 None None] REQUEST_METHOD: `POST` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:07:24.700960 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387193ab-4e6c-4c48-8b6e-0e3898fd1bc4 None None] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:07:24.701532 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387193ab-4e6c-4c48-8b6e-0e3898fd1bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:07:24.731495 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.auth.core [None req-387193ab-4e6c-4c48-8b6e-0e3898fd1bc4 None None] MFA Rules not processed for user `d040b37f0d68451e931ed64e11fe78c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:07:24.732748 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-387193ab-4e6c-4c48-8b6e-0e3898fd1bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:07:24.798140 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1462/2937] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 15:07:24 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:07:24.809634 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4c807b-83cc-4c81-abff-2cf4dc567174 admin admin] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:07:24.811391 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-7d4c807b-83cc-4c81-abff-2cf4dc567174 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:07:24.833780 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:07:24.871161 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4c807b-83cc-4c81-abff-2cf4dc567174 admin admin] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:07:24.874851 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbf2789-1e1c-44b0-a3f8-de786a966cde service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139dc7a4f1dc48fe8faea848bd1ac0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:07:24.875451 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbf2789-1e1c-44b0-a3f8-de786a966cde service cinder] REQUEST_METHOD: `GET` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:07:24.875732 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbf2789-1e1c-44b0-a3f8-de786a966cde service cinder] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:07:24.876007 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbf2789-1e1c-44b0-a3f8-de786a966cde service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:07:24.884562 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbf2789-1e1c-44b0-a3f8-de786a966cde service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:07:24.886595 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbf2789-1e1c-44b0-a3f8-de786a966cde service cinder] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:07:24.895519 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1476/2938] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 15:07:24 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:07:29.887254 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387193ab-4e6c-4c48-8b6e-0e3898fd1bc4 None None] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:07:29.906211 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:07:29.951500 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387193ab-4e6c-4c48-8b6e-0e3898fd1bc4 None None] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:07:29.955984 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f23d6c-e870-48b9-85a6-290b9c3bf2b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:07:29.956648 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f23d6c-e870-48b9-85a6-290b9c3bf2b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:07:29.956956 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f23d6c-e870-48b9-85a6-290b9c3bf2b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:07:29.957229 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f23d6c-e870-48b9-85a6-290b9c3bf2b2 admin admin] PATH_INFO: `/v3/users/d040b37f0d68451e931ed64e11fe78c9` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:07:29.958340 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f23d6c-e870-48b9-85a6-290b9c3bf2b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d040b37f0d68451e931ed64e11fe78c9)` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:07:29.960247 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f23d6c-e870-48b9-85a6-290b9c3bf2b2 admin admin] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:07:30.007751 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-44f23d6c-e870-48b9-85a6-290b9c3bf2b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd040b37f0d68451e931ed64e11fe78c9'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:07:30.019437 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-44f23d6c-e870-48b9-85a6-290b9c3bf2b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd040b37f0d68451e931ed64e11fe78c9'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:07:30.026192 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-44f23d6c-e870-48b9-85a6-290b9c3bf2b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd040b37f0d68451e931ed64e11fe78c9'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:07:30.026862 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-44f23d6c-e870-48b9-85a6-290b9c3bf2b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd040b37f0d68451e931ed64e11fe78c9'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:07:30.034169 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.notifications [None req-44f23d6c-e870-48b9-85a6-290b9c3bf2b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd040b37f0d68451e931ed64e11fe78c9'} {{(pid=81452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:07:30.040235 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1463/2939] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Sep 19 15:07:29 2022] DELETE /identity/v3/users/d040b37f0d68451e931ed64e11fe78c9 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:07:30.045394 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98759e0c-889f-4c8a-9c1b-d59cfa7151a9 None None] REQUEST_METHOD: `POST` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:07:30.045875 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98759e0c-889f-4c8a-9c1b-d59cfa7151a9 None None] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:07:30.045982 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98759e0c-889f-4c8a-9c1b-d59cfa7151a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:07:30.065256 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.auth.core [None req-98759e0c-889f-4c8a-9c1b-d59cfa7151a9 None None] MFA Rules not processed for user `2f19d59289e4450ca5e67c69c2e3b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:07:30.066458 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-98759e0c-889f-4c8a-9c1b-d59cfa7151a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:07:30.125578 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1477/2940] 10.222.0.72 () {58 vars in 958 bytes} [Mon Sep 19 15:07:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:07:30.135381 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f23d6c-e870-48b9-85a6-290b9c3bf2b2 admin admin] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:07:30.136926 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-44f23d6c-e870-48b9-85a6-290b9c3bf2b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:07:30.193842 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f23d6c-e870-48b9-85a6-290b9c3bf2b2 admin admin] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:07:30.197553 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f64004-3d5d-4e03-9095-8d97dfea1d73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c2b78646374cb79ded4b7b59ba49c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:07:30.198217 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f64004-3d5d-4e03-9095-8d97dfea1d73 service neutron] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:07:30.198498 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f64004-3d5d-4e03-9095-8d97dfea1d73 service neutron] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:07:30.198772 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f64004-3d5d-4e03-9095-8d97dfea1d73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:07:30.208207 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f64004-3d5d-4e03-9095-8d97dfea1d73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:07:30.209659 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f64004-3d5d-4e03-9095-8d97dfea1d73 service neutron] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:07:30.219294 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1464/2941] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 15:07:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:07:30.491723 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98759e0c-889f-4c8a-9c1b-d59cfa7151a9 None None] Authenticating user token {{(pid=81451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:07:30.493234 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.fernet_utils [None req-98759e0c-889f-4c8a-9c1b-d59cfa7151a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:07:30.506162 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98759e0c-889f-4c8a-9c1b-d59cfa7151a9 None None] Validating token access rules against request {{(pid=81451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:07:30.511215 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c542848-36b6-41c1-984f-d1c2ce8e5b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f19d59289e4450ca5e67c69c2e3b80c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feee070208394133a3522f3d666241d3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:07:30.512660 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c542848-36b6-41c1-984f-d1c2ce8e5b40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:07:30.512660 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c542848-36b6-41c1-984f-d1c2ce8e5b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:07:30.512660 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c542848-36b6-41c1-984f-d1c2ce8e5b40 admin admin] PATH_INFO: `/v3/projects/0d1fc967af744081a5ea2de359ec1242` {{(pid=81451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:07:30.514179 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c542848-36b6-41c1-984f-d1c2ce8e5b40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d1fc967af744081a5ea2de359ec1242)` {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:07:30.516188 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c542848-36b6-41c1-984f-d1c2ce8e5b40 admin admin] RBAC: Authorization granted {{(pid=81451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:07:30.564735 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-0c542848-36b6-41c1-984f-d1c2ce8e5b40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d1fc967af744081a5ea2de359ec1242', 'request_id': 'req-0c542848-36b6-41c1-984f-d1c2ce8e5b40'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:07:30.572220 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-0c542848-36b6-41c1-984f-d1c2ce8e5b40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d1fc967af744081a5ea2de359ec1242', 'request_id': 'req-0c542848-36b6-41c1-984f-d1c2ce8e5b40'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:07:30.578549 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-0c542848-36b6-41c1-984f-d1c2ce8e5b40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d1fc967af744081a5ea2de359ec1242', 'request_id': 'req-0c542848-36b6-41c1-984f-d1c2ce8e5b40'} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:07:30.590132 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-0c542848-36b6-41c1-984f-d1c2ce8e5b40 admin admin] The token cache is being invalidate because project 0d1fc967af744081a5ea2de359ec1242 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:07:30.590446 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-0c542848-36b6-41c1-984f-d1c2ce8e5b40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:07:30.591091 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG keystone.notifications [None req-0c542848-36b6-41c1-984f-d1c2ce8e5b40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:07:30.592607 dv-cinder-756711-11-smb devstack@keystone.service[81451]: [pid: 81451|app: 0|req: 1478/2942] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Sep 19 15:07:30 2022] DELETE /identity/v3/projects/0d1fc967af744081a5ea2de359ec1242 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:07:40.215046 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=71,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:07:40.586424 dv-cinder-756711-11-smb devstack@keystone.service[81451]: DEBUG dbcounter [-] [81451] Writing DB stats keystone:SELECT=71,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:10:14.434716 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f64004-3d5d-4e03-9095-8d97dfea1d73 service neutron] Authenticating user token {{(pid=81452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:14.436257 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-c4f64004-3d5d-4e03-9095-8d97dfea1d73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:14.505049 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f64004-3d5d-4e03-9095-8d97dfea1d73 service neutron] Validating token access rules against request {{(pid=81452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:14.563372 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c9cf22-1f37-47e2-9389-b9c29756388e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e7a0148db8462b8ba24bac6dd15298', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51af3a14d665498c9b7a35b34dac0ef1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:14.563973 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c9cf22-1f37-47e2-9389-b9c29756388e service placement] REQUEST_METHOD: `GET` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:14.564256 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c9cf22-1f37-47e2-9389-b9c29756388e service placement] SCRIPT_NAME: `/identity` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:14.564560 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c9cf22-1f37-47e2-9389-b9c29756388e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:14.566276 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.fernet_utils [None req-04c9cf22-1f37-47e2-9389-b9c29756388e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:14.577667 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c9cf22-1f37-47e2-9389-b9c29756388e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:14.579263 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c9cf22-1f37-47e2-9389-b9c29756388e service placement] RBAC: Authorization granted {{(pid=81452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:14.589176 dv-cinder-756711-11-smb devstack@keystone.service[81452]: [pid: 81452|app: 0|req: 1465/2943] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Sep 19 15:10:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:10:24.585014 dv-cinder-756711-11-smb devstack@keystone.service[81452]: DEBUG dbcounter [-] [81452] Writing DB stats keystone:SELECT=58 {{(pid=81452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}